-- Logs begin at Tue 2022-09-27 03:40:33 UTC, end at Tue 2022-09-27 04:45:28 UTC. -- Sep 27 04:05:34.278996 dv-cinder-859186-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 27 04:05:34.289321 dv-cinder-859186-3-smb devstack@keystone.service[81362]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 27 04:05:34.291364 dv-cinder-859186-3-smb devstack@keystone.service[81362]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 27 04:05:34 2022] *** Sep 27 04:05:34.291364 dv-cinder-859186-3-smb devstack@keystone.service[81362]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 27 04:05:34.291364 dv-cinder-859186-3-smb devstack@keystone.service[81362]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 27 04:05:34.291364 dv-cinder-859186-3-smb devstack@keystone.service[81362]: nodename: dv-cinder-859186-3-smb Sep 27 04:05:34.291364 dv-cinder-859186-3-smb devstack@keystone.service[81362]: machine: x86_64 Sep 27 04:05:34.291364 dv-cinder-859186-3-smb devstack@keystone.service[81362]: clock source: unix Sep 27 04:05:34.291364 dv-cinder-859186-3-smb devstack@keystone.service[81362]: pcre jit disabled Sep 27 04:05:34.291364 dv-cinder-859186-3-smb devstack@keystone.service[81362]: detected number of CPU cores: 4 Sep 27 04:05:34.291364 dv-cinder-859186-3-smb devstack@keystone.service[81362]: current working directory: / Sep 27 04:05:34.291364 dv-cinder-859186-3-smb devstack@keystone.service[81362]: detected binary path: /usr/bin/uwsgi-core Sep 27 04:05:34.291364 dv-cinder-859186-3-smb devstack@keystone.service[81362]: your processes number limit is 47680 Sep 27 04:05:34.292016 dv-cinder-859186-3-smb devstack@keystone.service[81362]: your memory page size is 4096 bytes Sep 27 04:05:34.292016 dv-cinder-859186-3-smb devstack@keystone.service[81362]: detected max file descriptor number: 2048 Sep 27 04:05:34.292016 dv-cinder-859186-3-smb devstack@keystone.service[81362]: lock engine: pthread robust mutexes Sep 27 04:05:34.292016 dv-cinder-859186-3-smb devstack@keystone.service[81362]: thunder lock: enabled Sep 27 04:05:34.292016 dv-cinder-859186-3-smb devstack@keystone.service[81362]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 27 04:05:34.292016 dv-cinder-859186-3-smb devstack@keystone.service[81362]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 27 04:05:34.331446 dv-cinder-859186-3-smb devstack@keystone.service[81362]: Python main interpreter initialized at 0x55de3b4a39c0 Sep 27 04:05:34.331446 dv-cinder-859186-3-smb devstack@keystone.service[81362]: python threads support enabled Sep 27 04:05:34.331446 dv-cinder-859186-3-smb devstack@keystone.service[81362]: your server socket listen backlog is limited to 100 connections Sep 27 04:05:34.331446 dv-cinder-859186-3-smb devstack@keystone.service[81362]: your mercy for graceful operations on workers is 90 seconds Sep 27 04:05:34.331782 dv-cinder-859186-3-smb devstack@keystone.service[81362]: mapped 403077 bytes (393 KB) for 2 cores Sep 27 04:05:34.331898 dv-cinder-859186-3-smb devstack@keystone.service[81362]: *** Operational MODE: preforking *** Sep 27 04:05:34.332166 dv-cinder-859186-3-smb devstack@keystone.service[81362]: *** uWSGI is running in multiple interpreter mode *** Sep 27 04:05:34.332166 dv-cinder-859186-3-smb devstack@keystone.service[81362]: spawned uWSGI master process (pid: 81362) Sep 27 04:05:34.332347 dv-cinder-859186-3-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 27 04:05:34.333743 dv-cinder-859186-3-smb devstack@keystone.service[81362]: spawned uWSGI worker 1 (pid: 81374, cores: 1) Sep 27 04:05:34.333743 dv-cinder-859186-3-smb devstack@keystone.service[81362]: spawned uWSGI worker 2 (pid: 81375, cores: 1) Sep 27 04:05:34.334750 dv-cinder-859186-3-smb devstack@keystone.service[81362]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 27 04:05:38.607370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 04:05:38.607370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: from cryptography.utils import int_from_bytes Sep 27 04:05:38.608339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 04:05:38.608339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: from cryptography.utils import int_from_bytes Sep 27 04:05:38.609080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 04:05:38.609080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: from cryptography.utils import int_from_bytes Sep 27 04:05:38.609641 dv-cinder-859186-3-smb devstack@keystone.service[81375]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 04:05:38.609641 dv-cinder-859186-3-smb devstack@keystone.service[81375]: from cryptography.utils import int_from_bytes Sep 27 04:05:38.658955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 04:05:38.659123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 04:05:38.659257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] command line args: [] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 04:05:38.659527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 04:05:38.659704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ================================================================================ {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 04:05:38.659958 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] admin_token = **** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.660201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] config_dir = [] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.660386 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.660567 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] config_source = [] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.660743 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] debug = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.660940 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.662108 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.662108 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.662108 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.662108 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.662348 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 04:05:38.662348 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 04:05:38.662463 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] list_limit = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.662527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] command line args: [] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 04:05:38.662589 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] log_config_append = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.662589 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.662696 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 04:05:38.662784 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] log_dir = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.662859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ================================================================================ {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 04:05:38.662920 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] log_file = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.663116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] admin_token = **** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.663190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.663263 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] config_dir = [] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.663322 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.663449 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.663533 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.663606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] config_source = [] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.663763 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.663858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] debug = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.663942 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.664020 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.664115 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.664189 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.664343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.664455 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.664569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.664652 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.664800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.664981 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.665601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.665686 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] list_limit = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.665838 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] log_config_append = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.665922 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.666037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.666120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.666180 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] log_dir = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.666304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.666420 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] log_file = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.666531 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.666642 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.666819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.666953 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.667067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.667306 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.667431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.667551 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.667672 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] publish_errors = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.667785 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.667898 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.668018 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.668146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.668146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.668367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.668481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.668593 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.668705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.668822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.668940 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] standard_threads = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.669050 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.669168 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.669287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.669400 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.669512 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.669623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.669742 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.669855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] use_journal = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.669855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] use_json = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.670093 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.670219 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] use_stderr = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.670219 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] use_syslog = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.670439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.670552 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.670674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] publish_errors = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.670818 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.670939 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.671052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.671165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.671277 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.671454 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.671572 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.671685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.671806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.671925 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.672038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.672158 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] standard_threads = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.672278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.672397 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.672516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.672630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.672630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.672857 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.672971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] use_journal = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.673089 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.673201 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] use_json = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.673201 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] use_stderr = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.673411 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.673531 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] use_syslog = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.673647 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.673759 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:05:38.673878 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.673991 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.674104 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.674224 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.674338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.674451 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.674563 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.674676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.674803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.674928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.675042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.675161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.675280 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.675398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.675524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.675650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.675764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.675882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.676001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.676119 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.676233 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.676353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.676466 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.676578 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.676690 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.676803 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.676915 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.677103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.677224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.677337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.677449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.677561 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.677682 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.677796 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.677909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.678026 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.678138 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.678256 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.678379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.678493 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.678605 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.678756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.678872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.678984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.679108 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.679222 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.679335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.679335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.679543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.679655 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.679778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.679899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.680012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.680124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.680235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.680347 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.680490 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.680609 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.680728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.680847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.680961 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.681074 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.681194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.681307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.681446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.681565 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.681678 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.681800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.681923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.682037 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.682150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.682263 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.682375 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.682488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.682679 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.682841 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.682965 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.683086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.683200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.683312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.683432 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.683546 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.683658 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.683769 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.683887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.684000 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.684121 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.684234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.684335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.684451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.684564 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.684676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.684796 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.684915 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.685029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.685142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.685254 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.685373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.685486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.685598 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.685722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.685844 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.685948 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.686044 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.686146 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.686242 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.686344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.686445 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.686547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.686643 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.686773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.686875 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.686996 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.687110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.687230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.687352 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.687473 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.687599 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.687713 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.687826 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.687939 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.688053 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.688166 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.688288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.688403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.688516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.688629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.688750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.688871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.688983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.689097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.689217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.689344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.689463 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.689641 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.689787 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.689902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.690021 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.690135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.690248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.690363 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.690483 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.690597 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.690725 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.690841 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.690954 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.691056 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.691184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.691301 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.691414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.691528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.691641 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.691759 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.691881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.691996 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.692109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.692223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.692336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.692451 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.692576 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.692691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.692805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.692918 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.693032 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.693145 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.693266 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.693391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.693513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.693513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.693728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.693841 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.694029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.694146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.694265 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.694385 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.694499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.694623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.694800 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.694926 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.695042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.695162 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.695277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.695390 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.695510 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.695633 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.695748 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.695867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.695982 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.696095 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] auth.external = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.696214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.696336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.696451 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.696451 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.696673 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.696787 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.696900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.697022 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.697137 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] auth.password = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.697251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.697364 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] auth.token = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.697485 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.697630 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.697755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.697879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.698005 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.698121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.698121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.698336 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.698450 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.698564 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.698686 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.698818 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.698932 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.699046 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.699160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] credential.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.699274 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.699399 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.699521 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] auth.external = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.699637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.699751 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.699866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.699980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.700102 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.700218 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.700332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.700446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] auth.password = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.700559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.700674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] auth.token = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.700796 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.700912 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.701027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.701141 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.701254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.701376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.701499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.701616 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.701616 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.701839 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.701839 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.702054 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.702054 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.702279 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.702393 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] credential.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.702507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.702621 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.702758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.702887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.703005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] federation.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.703127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.703242 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.703242 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.703456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.703578 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.703694 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.703808 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.703922 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.704036 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.704151 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.704276 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.704392 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.704506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.704620 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.704735 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.704856 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.704972 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.705088 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.705202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.705316 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.705430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.705552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.705668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.705782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.705896 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.706010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.706125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.706247 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] federation.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.706364 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.706484 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.706599 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.706726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.706843 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.706969 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.707086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.707200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.707314 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.707437 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.707552 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.707746 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.707864 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.707978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.708093 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.708207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.708321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.708443 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.708559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.708674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.708788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.708903 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.709018 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.709143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.709260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.709381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.709495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.709611 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.709725 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.709847 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.709963 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.710085 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.710201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.710317 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.710431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.710553 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.710668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.710836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.710952 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.710952 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.711179 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.711302 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.711419 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.711534 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.711648 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.712247 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.712366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.712489 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.712604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.712719 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.712833 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.712947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.713061 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.713183 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.713298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.713414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.713534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.713650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.713764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.713887 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.714002 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.714117 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.714231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.714346 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.714461 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.714584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.714700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.714835 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.714959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.715075 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.715189 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.715312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.715428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.715543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.715658 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.715772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.715894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.716016 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.716138 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.716253 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.716368 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.716482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.716605 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.716721 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.716835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.716949 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.717063 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.717177 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.717300 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.717415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.717530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.717645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.717759 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.717873 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.717995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.718367 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.718488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.718603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.718785 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.718904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.719032 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.719149 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.719264 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.719379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.719493 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.719608 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.719735 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.719851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.719966 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.720080 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.720194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.720309 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.720430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.720546 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.720661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.720777 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.720892 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.721007 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.721132 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.721248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.721363 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.721477 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.721592 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.721706 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.721830 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.721945 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.722060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.722175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.722293 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.722407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.722407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.722632 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.722764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.722881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.722995 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.723110 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.723235 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.723352 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.723466 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.723580 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.723694 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.723808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.723931 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.724047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.724162 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.724276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.724390 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.724510 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.724633 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.724749 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.724863 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.724978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.725093 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.725207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.725328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.725444 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.725558 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.725672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.725786 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.725900 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.726023 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.726139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.726253 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.726367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.726481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.726595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.726733 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.726860 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.726977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] resource.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.727092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.727206 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.727320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.728279 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.728404 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.728519 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.728633 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.728747 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.728862 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.728984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.729101 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.729216 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.729336 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.729452 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.729567 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.729689 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.729806 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.729921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.730035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.730150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] role.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.730265 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.730388 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] role.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.730504 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.730619 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.730820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.730935 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.731049 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.731176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.731294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.731409 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.731523 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.731637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.731823 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] resource.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.731941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.732056 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.732170 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.732285 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.732404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.732526 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.732642 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.732757 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.732877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.732993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.733107 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.733229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.733347 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.733462 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.733576 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.733691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.733805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.733928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.733928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] role.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.734144 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.734259 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] role.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.734374 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.734488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.734610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.734734 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.734852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.734967 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.735082 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.735195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.735321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.735321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.735547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.735663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.735777 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.735892 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.736014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.736129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.736244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.736357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.736472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.736586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.736708 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.736824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.736944 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.737059 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.737174 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.737288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.737409 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.737526 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.737640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.737755 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.737755 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.737976 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.738092 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.738206 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.738321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] token.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.738434 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.738549 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.738672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.738829 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.738945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.739059 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.739172 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.739286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.739413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.739530 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.739645 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.739760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.739874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.739988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.740110 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.740227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.740341 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.740454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.740569 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.740684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.740806 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.740923 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.741037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.741151 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.741265 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.741379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.741501 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.741618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.741733 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.741847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.741969 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.742094 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.742210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.742336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.742452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] token.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.742566 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.connection = **** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.742680 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.742874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.743008 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.743138 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.743255 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.743370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.743484 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.743598 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.743713 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.743836 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.743952 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.744067 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.744181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.744295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.744410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.744531 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.744647 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.744761 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.744876 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.744990 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.745105 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.745231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.745347 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.745538 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.745669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.745786 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.745786 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.746011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.746011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.746237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.746237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.746463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.746578 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.746692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.746867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.746996 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.connection = **** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.747119 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 04:05:38.747235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.747235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.747235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.747235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.747235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.747235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.747235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.747235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.747235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.748160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.748160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.748160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.748160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.748160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.748160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.748160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.748888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.748888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:05:38.748888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 04:05:38.773580 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:38.773807 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:38.774033 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:38.774116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:38.774899 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:38.775130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:38.782811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:38.783374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:38.810971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:38.811196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:38.811470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:38.811704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:38.864264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:38.864804 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:38.914085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:38.914242 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:38.918515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:38.918776 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.068477 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.068696 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.068881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.068970 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.069102 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.069205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.069323 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.069406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.069535 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.069617 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.069754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.069973 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.092971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.093218 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.093312 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.093419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.093552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.093636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.093784 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.093865 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.094012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.094104 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.094233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.094317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.094452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.094671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.105488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.105826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.117947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.118216 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.118303 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.118443 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.118526 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.118662 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.118760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.118900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.118982 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.119110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.119193 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.119320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.119401 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.119569 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:05:39.136301 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.136510 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 04:05:39.136853 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.136997 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.137079 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 04:05:39.137213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 04:05:39.137308 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.137556 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.137638 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.137758 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 04:05:39.137839 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.138038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.138122 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.138302 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.138565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.138857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.147666 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.147946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.148222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.148506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.148587 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.148788 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.149062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.149975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.156112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.156972 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.159040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.159325 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.159606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.159890 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.159971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.160177 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.160258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.160437 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.160520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.160704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.160832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.160976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.161066 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.161243 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.161323 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.161511 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.161589 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.161778 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.161859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.162050 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.162328 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.162601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.184453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.185355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.185872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.186154 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.186852 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.187143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.190860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.191146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.191429 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.191829 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.192116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.192402 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.198246 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.198533 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.199343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.199636 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.204097 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.204398 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.204690 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.204978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.205227 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.205308 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.205523 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.205603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.205797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.205882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.206071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.206159 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.206358 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.206635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.206933 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.207206 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.222116 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.222401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.223333 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.223576 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.226261 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.227505 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.229802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.230099 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.231038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.231338 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.234297 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.235566 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.237455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.238838 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.240693 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.240994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.241277 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.241556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.241845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.242071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.242154 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.242377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.242669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.243547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.243865 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.244153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.258497 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.259341 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.260019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.260019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.260901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.261200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.261557 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.261832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.267057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.268494 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.270029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.270411 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.270763 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.272635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.273504 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.273856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.274146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.274455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.274778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.274922 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.275055 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.277892 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.278357 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.278611 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.279106 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.279873 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.286476 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.286785 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.287185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.287520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.287927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.288216 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.288498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.293199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.293798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.294006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.294358 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.294890 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.295253 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.295753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.304596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.308435 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.311339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.312781 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.314259 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.314544 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.314624 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.314975 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.317494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.320436 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.321953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.322529 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.323447 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.324024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.324344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.324708 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.326332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.326738 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.327035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.327315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.331116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.332597 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.335108 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.335402 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.335510 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.335682 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.335911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.336199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.336478 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.342573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.342881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.343173 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.343449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.343723 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.343997 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.344269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.344394 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.344552 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.344693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.344819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.344977 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.345086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.345376 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.345653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.345976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.346256 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.351905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:05:39.352193 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.352514 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.352792 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.353334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.353610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.353885 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.354179 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.354452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.354746 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.355043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.355323 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.355615 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.355960 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:05:39.380888 dv-cinder-859186-3-smb devstack@keystone.service[81374]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55de3b4a39c0 pid: 81374 (default app) Sep 27 04:05:39.384785 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88ed70-a1e4-4dbb-ac87-1251c5b26e5c None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:39.385072 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88ed70-a1e4-4dbb-ac87-1251c5b26e5c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:39.385346 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88ed70-a1e4-4dbb-ac87-1251c5b26e5c None None] PATH_INFO: `/v3` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:39.389501 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Tue Sep 27 04:05:39 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:05:39.391166 dv-cinder-859186-3-smb devstack@keystone.service[81375]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55de3b4a39c0 pid: 81375 (default app) Sep 27 04:05:46.193947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84829f2-b99f-4e01-b3fc-67cb601f1d6f None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:46.194484 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84829f2-b99f-4e01-b3fc-67cb601f1d6f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:46.194484 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84829f2-b99f-4e01-b3fc-67cb601f1d6f None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:46.195889 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:05:46.203985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d24a9-f2ba-473d-83b9-9c71d4284ed3 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:46.204526 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d24a9-f2ba-473d-83b9-9c71d4284ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:46.204628 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d24a9-f2ba-473d-83b9-9c71d4284ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:46.274026 dv-cinder-859186-3-smb devstack@keystone.service[81375]: INFO dbcounter [None req-868d24a9-f2ba-473d-83b9-9c71d4284ed3 None None] Registered counter for database keystone Sep 27 04:05:46.292479 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG oslo_db.sqlalchemy.engines [None req-868d24a9-f2ba-473d-83b9-9c71d4284ed3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 04:05:46.298698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writer thread running {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 04:05:46.474606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG passlib.handlers.bcrypt [None req-868d24a9-f2ba-473d-83b9-9c71d4284ed3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81375) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 27 04:05:46.474952 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG passlib.handlers.bcrypt [None req-868d24a9-f2ba-473d-83b9-9c71d4284ed3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81375) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 27 04:05:46.533145 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-868d24a9-f2ba-473d-83b9-9c71d4284ed3 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:05:46.534797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-868d24a9-f2ba-473d-83b9-9c71d4284ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:05:46.663483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1/3] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:05:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 27 04:05:47.135374 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84829f2-b99f-4e01-b3fc-67cb601f1d6f None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:47.203788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: INFO dbcounter [None req-f84829f2-b99f-4e01-b3fc-67cb601f1d6f None None] Registered counter for database keystone Sep 27 04:05:47.225179 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG oslo_db.sqlalchemy.engines [None req-f84829f2-b99f-4e01-b3fc-67cb601f1d6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 04:05:47.231534 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writer thread running {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 04:05:47.348091 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84829f2-b99f-4e01-b3fc-67cb601f1d6f None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:47.352365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18890b81-6b65-4def-8e75-bcda5dbdf1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:47.353224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18890b81-6b65-4def-8e75-bcda5dbdf1df admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:47.353502 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18890b81-6b65-4def-8e75-bcda5dbdf1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:47.353771 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18890b81-6b65-4def-8e75-bcda5dbdf1df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:47.361785 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18890b81-6b65-4def-8e75-bcda5dbdf1df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:47.412752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: WARNING keystone.common.rbac_enforcer.enforcer [None req-18890b81-6b65-4def-8e75-bcda5dbdf1df admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 27 04:05:47.413095 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18890b81-6b65-4def-8e75-bcda5dbdf1df admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:47.422608 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Sep 27 04:05:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:05:47.428640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d24a9-f2ba-473d-83b9-9c71d4284ed3 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:47.445160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d24a9-f2ba-473d-83b9-9c71d4284ed3 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:47.450022 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bfa22-4bd6-4cdb-8878-d52ccfd5da4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:47.451295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bfa22-4bd6-4cdb-8878-d52ccfd5da4b admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:47.451581 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bfa22-4bd6-4cdb-8878-d52ccfd5da4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:47.451855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bfa22-4bd6-4cdb-8878-d52ccfd5da4b admin admin] PATH_INFO: `/v3/projects/97e2274f8eaa462ba6cf2944e7e36afb` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:47.453296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bfa22-4bd6-4cdb-8878-d52ccfd5da4b admin admin] RBAC: Authorizing `identity:get_project(project_id=97e2274f8eaa462ba6cf2944e7e36afb)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:47.506041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: WARNING keystone.common.rbac_enforcer.enforcer [None req-416bfa22-4bd6-4cdb-8878-d52ccfd5da4b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 27 04:05:47.506387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bfa22-4bd6-4cdb-8878-d52ccfd5da4b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:47.511497 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 2/5] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Sep 27 04:05:47 2022] GET /identity/v3/projects/97e2274f8eaa462ba6cf2944e7e36afb => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:05:49.596665 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec39f86-0bcf-4180-87ab-be5b06016853 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:49.597276 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec39f86-0bcf-4180-87ab-be5b06016853 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:49.597276 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec39f86-0bcf-4180-87ab-be5b06016853 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:49.601358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 4/6] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:05:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:05:49.607539 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6d60e-4f62-4df6-8438-af05f5beaa0e None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:49.607919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6d60e-4f62-4df6-8438-af05f5beaa0e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:49.608099 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6d60e-4f62-4df6-8438-af05f5beaa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:49.628316 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-77e6d60e-4f62-4df6-8438-af05f5beaa0e None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:05:49.629829 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-77e6d60e-4f62-4df6-8438-af05f5beaa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:05:49.637507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 3/7] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:05:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 27 04:05:49.899256 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec39f86-0bcf-4180-87ab-be5b06016853 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:49.911403 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec39f86-0bcf-4180-87ab-be5b06016853 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:49.916212 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33b725-3bfe-4ff7-9b3f-f5d4882a397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:49.916809 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33b725-3bfe-4ff7-9b3f-f5d4882a397c admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:49.917096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33b725-3bfe-4ff7-9b3f-f5d4882a397c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:49.917373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33b725-3bfe-4ff7-9b3f-f5d4882a397c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:49.924991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33b725-3bfe-4ff7-9b3f-f5d4882a397c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:49.926804 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33b725-3bfe-4ff7-9b3f-f5d4882a397c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:49.935463 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Sep 27 04:05:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:05:49.940563 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6d60e-4f62-4df6-8438-af05f5beaa0e None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:49.949458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6d60e-4f62-4df6-8438-af05f5beaa0e None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:49.953693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69f2db-09e5-4252-8ba6-5c991a2aa8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:49.954315 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69f2db-09e5-4252-8ba6-5c991a2aa8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:49.954595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69f2db-09e5-4252-8ba6-5c991a2aa8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:49.954908 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69f2db-09e5-4252-8ba6-5c991a2aa8b5 admin admin] PATH_INFO: `/v3/users/0a22ab389c9c45629af99658c60df95d` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:49.956201 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69f2db-09e5-4252-8ba6-5c991a2aa8b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=0a22ab389c9c45629af99658c60df95d)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:49.958017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69f2db-09e5-4252-8ba6-5c991a2aa8b5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:49.959544 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 4/9] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Sep 27 04:05:49 2022] GET /identity/v3/users/0a22ab389c9c45629af99658c60df95d => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:05:52.161421 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39183d44-23c5-461b-a66b-fc82947f1824 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:52.161959 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39183d44-23c5-461b-a66b-fc82947f1824 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:52.162055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39183d44-23c5-461b-a66b-fc82947f1824 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:52.163374 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:05:52.168778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4eeef-b521-4ff1-a18a-919d314c777c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:52.169225 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4eeef-b521-4ff1-a18a-919d314c777c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:52.169321 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4eeef-b521-4ff1-a18a-919d314c777c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:52.177484 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083f52d-f6d4-4a64-b207-a883198410fe None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:52.177775 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083f52d-f6d4-4a64-b207-a883198410fe None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:52.178045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083f52d-f6d4-4a64-b207-a883198410fe None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:52.179432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 7/11] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:05:52.184709 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fac82f-55ff-4033-b9c8-29a49b888bf2 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:52.184992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fac82f-55ff-4033-b9c8-29a49b888bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:52.185269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fac82f-55ff-4033-b9c8-29a49b888bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:52.188268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a8c4eeef-b521-4ff1-a18a-919d314c777c None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:05:52.189490 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a8c4eeef-b521-4ff1-a18a-919d314c777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:05:52.226502 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG passlib.handlers.bcrypt [None req-78fac82f-55ff-4033-b9c8-29a49b888bf2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81374) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 27 04:05:52.227446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG passlib.handlers.bcrypt [None req-78fac82f-55ff-4033-b9c8-29a49b888bf2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81374) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 27 04:05:52.270114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 5/12] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:05:52.276914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-78fac82f-55ff-4033-b9c8-29a49b888bf2 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:05:52.278480 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-78fac82f-55ff-4033-b9c8-29a49b888bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:05:52.377322 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 8/13] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:05:52.537435 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4eeef-b521-4ff1-a18a-919d314c777c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:52.562196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:05:52.641452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4eeef-b521-4ff1-a18a-919d314c777c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:52.641627 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fac82f-55ff-4033-b9c8-29a49b888bf2 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:52.678154 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fcbeb-c445-4922-869b-8667470faff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:52.678835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fcbeb-c445-4922-869b-8667470faff2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:52.679124 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fcbeb-c445-4922-869b-8667470faff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:52.679403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fcbeb-c445-4922-869b-8667470faff2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:52.696581 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fcbeb-c445-4922-869b-8667470faff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:05:52.705366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-f30fcbeb-c445-4922-869b-8667470faff2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:05:52.705366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:05:52.705366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:05:52.705366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:05:52.705366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:05:52.705366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:05:52.705366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:05:52.705366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:05:52.705366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:05:52.705366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:05:52.705366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:05:52.705366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:05:52.705366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:05:52.705366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:05:52.705366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:05:52.705366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:05:52.706267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:05:52.706267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:05:52.706267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:05:52.706267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:05:52.706267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:05:52.706267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:05:52.706267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:05:52.706267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:05:52.706267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:05:52.706267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:05:52.706267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:05:52.706267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:05:52.706267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:05:52.706267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:05:52.706267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:05:52.706267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:05:52.707155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:05:52.707155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:05:52.707155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:05:52.707155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:05:52.707155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:05:52.707155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:05:52.707155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:05:52.707155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:05:52.707155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:05:52.707155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:05:52.707155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:05:52.707155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:05:52.707155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 6/14] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:05:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:05:52.712773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fcbeb-c445-4922-869b-8667470faff2 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:52.746555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fac82f-55ff-4033-b9c8-29a49b888bf2 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:52.749258 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:05:52.784910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12133e5d-72e8-4284-a34e-0e53cd84fd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:52.785782 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12133e5d-72e8-4284-a34e-0e53cd84fd97 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:52.786065 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12133e5d-72e8-4284-a34e-0e53cd84fd97 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:52.786337 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12133e5d-72e8-4284-a34e-0e53cd84fd97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:52.793871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:05:52.812454 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fcbeb-c445-4922-869b-8667470faff2 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:52.848299 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6efc8-0def-4b8d-9c81-67da1c7a75c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:52.848896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6efc8-0def-4b8d-9c81-67da1c7a75c5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:52.849176 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6efc8-0def-4b8d-9c81-67da1c7a75c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:52.849457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6efc8-0def-4b8d-9c81-67da1c7a75c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:52.850114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6efc8-0def-4b8d-9c81-67da1c7a75c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:05:52.850414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6efc8-0def-4b8d-9c81-67da1c7a75c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:52.851837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6efc8-0def-4b8d-9c81-67da1c7a75c5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:52.852798 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12133e5d-72e8-4284-a34e-0e53cd84fd97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:52.854571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12133e5d-72e8-4284-a34e-0e53cd84fd97 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:52.863841 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 7/15] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:05:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:05:52.869899 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6efc8-0def-4b8d-9c81-67da1c7a75c5 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:52.950522 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 9/16] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:05:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 04:05:52.957184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12133e5d-72e8-4284-a34e-0e53cd84fd97 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:52.960122 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:05:52.969680 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6efc8-0def-4b8d-9c81-67da1c7a75c5 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:53.003133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fde84-966a-420a-8c1f-e67d811fc09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:53.003757 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fde84-966a-420a-8c1f-e67d811fc09a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:53.004042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fde84-966a-420a-8c1f-e67d811fc09a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:53.004317 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fde84-966a-420a-8c1f-e67d811fc09a None admin] PATH_INFO: `/v3/users/0a22ab389c9c45629af99658c60df95d` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:53.005442 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fde84-966a-420a-8c1f-e67d811fc09a None admin] RBAC: Authorizing `identity:get_user(user_id=0a22ab389c9c45629af99658c60df95d)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:53.006918 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fde84-966a-420a-8c1f-e67d811fc09a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:53.009069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 8/17] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:05:52 2022] GET /identity/v3/users/0a22ab389c9c45629af99658c60df95d => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:05:53.014355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fde84-966a-420a-8c1f-e67d811fc09a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:53.028259 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:05:53.055563 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12133e5d-72e8-4284-a34e-0e53cd84fd97 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:53.089025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909202a-546b-4767-8883-f4f96da95e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:53.089879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909202a-546b-4767-8883-f4f96da95e27 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:53.090168 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909202a-546b-4767-8883-f4f96da95e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:53.090449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909202a-546b-4767-8883-f4f96da95e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:53.109587 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909202a-546b-4767-8883-f4f96da95e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:53.110468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fde84-966a-420a-8c1f-e67d811fc09a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:53.111089 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909202a-546b-4767-8883-f4f96da95e27 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:53.130208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-c909202a-546b-4767-8883-f4f96da95e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:05:53.130208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:05:53.130208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:05:53.130208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:05:53.130208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:05:53.130208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:05:53.130208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:05:53.130208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:05:53.130208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:05:53.130208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:05:53.130208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:05:53.130208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:05:53.130208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:05:53.130208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:05:53.130208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:05:53.130208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:05:53.131140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:05:53.131140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:05:53.131140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:05:53.131140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:05:53.131140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:05:53.131140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:05:53.131140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:05:53.131140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:05:53.131140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:05:53.131140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:05:53.131140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:05:53.131140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:05:53.131140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:05:53.131140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:05:53.131140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:05:53.131140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:05:53.131140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:05:53.131946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:05:53.131946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:05:53.131946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:05:53.131946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 10/18] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:05:53.137746 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909202a-546b-4767-8883-f4f96da95e27 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:53.144063 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65afa9f-9242-402d-a1a8-d2676dc361a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:53.144697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65afa9f-9242-402d-a1a8-d2676dc361a4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:53.144980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65afa9f-9242-402d-a1a8-d2676dc361a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:53.145256 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65afa9f-9242-402d-a1a8-d2676dc361a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:53.146364 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65afa9f-9242-402d-a1a8-d2676dc361a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:53.147857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65afa9f-9242-402d-a1a8-d2676dc361a4 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:53.149436 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 9/19] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:05:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:05:53.154990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65afa9f-9242-402d-a1a8-d2676dc361a4 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:53.194164 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:05:53.234389 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:05:53.241023 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909202a-546b-4767-8883-f4f96da95e27 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:53.253931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65afa9f-9242-402d-a1a8-d2676dc361a4 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:53.275173 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfbcdc-7fea-4535-8165-dc35bf301e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:53.275774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfbcdc-7fea-4535-8165-dc35bf301e47 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:53.276055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfbcdc-7fea-4535-8165-dc35bf301e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:53.276331 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfbcdc-7fea-4535-8165-dc35bf301e47 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:53.276980 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfbcdc-7fea-4535-8165-dc35bf301e47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:05:53.277285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfbcdc-7fea-4535-8165-dc35bf301e47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:53.278674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfbcdc-7fea-4535-8165-dc35bf301e47 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:53.286597 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235bd26-784d-4082-bdef-8db43dc8bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:53.287235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235bd26-784d-4082-bdef-8db43dc8bfda None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:53.287520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235bd26-784d-4082-bdef-8db43dc8bfda None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:53.287796 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235bd26-784d-4082-bdef-8db43dc8bfda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:53.288530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235bd26-784d-4082-bdef-8db43dc8bfda None admin] RBAC: Adding query filter params (role.id=2613cf4a98d44744a094c7782b19b4b5, scope.domain.id=default, user.id=0a22ab389c9c45629af99658c60df95d) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:05:53.288842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235bd26-784d-4082-bdef-8db43dc8bfda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:53.290838 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235bd26-784d-4082-bdef-8db43dc8bfda None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:53.296054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:05:53.297299 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1322 bytes} [Tue Sep 27 04:05:53 2022] GET /identity/v3/role_assignments?user.id=0a22ab389c9c45629af99658c60df95d&scope.domain.id=default&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:05:55.581041 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0a7ab-848e-4c2a-86e3-df216302f3b8 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:55.581543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0a7ab-848e-4c2a-86e3-df216302f3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:55.581639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0a7ab-848e-4c2a-86e3-df216302f3b8 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:55.583250 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:05:55.590486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d27e48-4945-4764-93d4-09e4ac2463d3 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:55.590927 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d27e48-4945-4764-93d4-09e4ac2463d3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:55.591091 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d27e48-4945-4764-93d4-09e4ac2463d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:55.619691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c7d27e48-4945-4764-93d4-09e4ac2463d3 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:05:55.620891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c7d27e48-4945-4764-93d4-09e4ac2463d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:05:55.708994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:05:55.870078 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddd99a-67db-4eac-aa41-0172f2eefa84 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:55.870416 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddd99a-67db-4eac-aa41-0172f2eefa84 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:55.870628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddd99a-67db-4eac-aa41-0172f2eefa84 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:55.872132 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:05:55.877681 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d64538-d480-41f5-aad0-978a4a97e18b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:55.877973 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d64538-d480-41f5-aad0-978a4a97e18b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:55.878250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d64538-d480-41f5-aad0-978a4a97e18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:55.903917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d4d64538-d480-41f5-aad0-978a4a97e18b None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:05:55.905141 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d4d64538-d480-41f5-aad0-978a4a97e18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:05:55.913729 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730dd338-5c3d-40c1-936f-d0ab6249b4fc None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:55.914034 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730dd338-5c3d-40c1-936f-d0ab6249b4fc None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:55.914320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730dd338-5c3d-40c1-936f-d0ab6249b4fc None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:55.915696 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 14/25] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:05:55.922104 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b9f2f-c724-43a9-8299-6693b27dd932 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:55.922391 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b9f2f-c724-43a9-8299-6693b27dd932 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:55.922653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b9f2f-c724-43a9-8299-6693b27dd932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:55.952792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-137b9f2f-c724-43a9-8299-6693b27dd932 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:05:55.953983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-137b9f2f-c724-43a9-8299-6693b27dd932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:05:56.062088 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 12/26] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:05:56.104549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d64538-d480-41f5-aad0-978a4a97e18b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:56.108433 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 15/27] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:05:56.110417 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:05:56.254511 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d64538-d480-41f5-aad0-978a4a97e18b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:56.296162 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15407a1-907b-45ad-a90a-0033240b5bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:56.296803 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15407a1-907b-45ad-a90a-0033240b5bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:56.297088 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15407a1-907b-45ad-a90a-0033240b5bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:56.297371 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15407a1-907b-45ad-a90a-0033240b5bd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:56.312795 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15407a1-907b-45ad-a90a-0033240b5bd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:05:56.317835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-a15407a1-907b-45ad-a90a-0033240b5bd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:05:56.317835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:05:56.317835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:05:56.317835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:05:56.317835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:05:56.317835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:05:56.317835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:05:56.317835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:05:56.317835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:05:56.317835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:05:56.317835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:05:56.317835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:05:56.317835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:05:56.317835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:05:56.317835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:05:56.317835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:05:56.318671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:05:56.318671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:05:56.318671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:05:56.318671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:05:56.318671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:05:56.318671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:05:56.318671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:05:56.318671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:05:56.318671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:05:56.318671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:05:56.318671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:05:56.318671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:05:56.318671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:05:56.318671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:05:56.318671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:05:56.318671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:05:56.319469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:05:56.319469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:05:56.319469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:05:56.319469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:05:56.319469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:05:56.319469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:05:56.319469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:05:56.319469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:05:56.319469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:05:56.319469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:05:56.319469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:05:56.319469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:05:56.319469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 13/28] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:05:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:05:56.324866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b9f2f-c724-43a9-8299-6693b27dd932 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:56.387402 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:05:56.478580 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b9f2f-c724-43a9-8299-6693b27dd932 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:56.502989 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15407a1-907b-45ad-a90a-0033240b5bd9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:56.530146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4a9c5-6ede-4bce-9fea-1c4a131715ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:56.530805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4a9c5-6ede-4bce-9fea-1c4a131715ee None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:56.531087 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4a9c5-6ede-4bce-9fea-1c4a131715ee None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:56.531361 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4a9c5-6ede-4bce-9fea-1c4a131715ee None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:56.532045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4a9c5-6ede-4bce-9fea-1c4a131715ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:05:56.532356 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4a9c5-6ede-4bce-9fea-1c4a131715ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:56.533753 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4a9c5-6ede-4bce-9fea-1c4a131715ee None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:56.555371 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 16/29] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:05:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:05:56.562362 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4a9c5-6ede-4bce-9fea-1c4a131715ee None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:56.661393 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:05:56.720031 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15407a1-907b-45ad-a90a-0033240b5bd9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:56.743009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4a9c5-6ede-4bce-9fea-1c4a131715ee None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:56.753594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:05:56.772064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623137f-4acd-4bd1-bdb8-ace6b3872cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:56.773165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623137f-4acd-4bd1-bdb8-ace6b3872cbc None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:56.773991 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623137f-4acd-4bd1-bdb8-ace6b3872cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:56.774690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623137f-4acd-4bd1-bdb8-ace6b3872cbc None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:56.775764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623137f-4acd-4bd1-bdb8-ace6b3872cbc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:56.777988 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623137f-4acd-4bd1-bdb8-ace6b3872cbc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:56.781470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973be49-9646-45cf-856e-20336c059128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:56.782345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973be49-9646-45cf-856e-20336c059128 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:56.782840 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973be49-9646-45cf-856e-20336c059128 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:56.783265 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973be49-9646-45cf-856e-20336c059128 None admin] PATH_INFO: `/v3/users/0a22ab389c9c45629af99658c60df95d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:56.785124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973be49-9646-45cf-856e-20336c059128 None admin] RBAC: Authorizing `identity:get_user(user_id=0a22ab389c9c45629af99658c60df95d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:56.787006 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973be49-9646-45cf-856e-20336c059128 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:56.788941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 17/30] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:05:56 2022] GET /identity/v3/users/0a22ab389c9c45629af99658c60df95d => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:05:56.795551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973be49-9646-45cf-856e-20336c059128 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:56.905447 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973be49-9646-45cf-856e-20336c059128 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:56.919412 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 14/31] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Sep 27 04:05:56 2022] POST /identity/v3/roles => generated 219 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:05:56.921244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1715082-7eaf-422b-bc4e-791aa3170a2c None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:56.921747 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1715082-7eaf-422b-bc4e-791aa3170a2c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:56.922310 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1715082-7eaf-422b-bc4e-791aa3170a2c None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:56.924158 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 15/32] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:05:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:05:56.925167 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1715082-7eaf-422b-bc4e-791aa3170a2c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:56.954401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac197a1f-51c5-428f-9478-3f44e68751d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:56.959722 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac197a1f-51c5-428f-9478-3f44e68751d2 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:56.960622 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac197a1f-51c5-428f-9478-3f44e68751d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:56.962214 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac197a1f-51c5-428f-9478-3f44e68751d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:56.984423 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac197a1f-51c5-428f-9478-3f44e68751d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:56.987999 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac197a1f-51c5-428f-9478-3f44e68751d2 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:57.019615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-ac197a1f-51c5-428f-9478-3f44e68751d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:05:57.019615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:05:57.019615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:05:57.019615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:05:57.019615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:05:57.019615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:05:57.019615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:05:57.019615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:05:57.019615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:05:57.019615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:05:57.019615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:05:57.019615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:05:57.019615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:05:57.019615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:05:57.019615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:05:57.019615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:05:57.020556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:05:57.020556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:05:57.020556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:05:57.020556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:05:57.020556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:05:57.020556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:05:57.020556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:05:57.020556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:05:57.020556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:05:57.020556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:05:57.020556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:05:57.020556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:05:57.020556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:05:57.020556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:05:57.020556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:05:57.020556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:05:57.020556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:05:57.021354 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:05:57.021354 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:05:57.021354 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:05:57.025274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 18/33] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:05:57.028714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c89d0-6272-4638-b572-387c860798c9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:57.029385 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c89d0-6272-4638-b572-387c860798c9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:57.031497 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c89d0-6272-4638-b572-387c860798c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:57.070998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-fd5c89d0-6272-4638-b572-387c860798c9 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:05:57.072251 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fd5c89d0-6272-4638-b572-387c860798c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:05:57.119092 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:05:57.121935 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1715082-7eaf-422b-bc4e-791aa3170a2c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:57.160501 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:05:57.176775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a38dfa-4fa4-4641-b0da-9edf6201e22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:57.177707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a38dfa-4fa4-4641-b0da-9edf6201e22b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:57.178223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a38dfa-4fa4-4641-b0da-9edf6201e22b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:57.178681 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a38dfa-4fa4-4641-b0da-9edf6201e22b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:57.181060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a38dfa-4fa4-4641-b0da-9edf6201e22b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:57.181665 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 19/34] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:05:57.182592 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c89d0-6272-4638-b572-387c860798c9 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:57.183541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a38dfa-4fa4-4641-b0da-9edf6201e22b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:57.185570 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 16/35] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:05:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:05:57.191286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a38dfa-4fa4-4641-b0da-9edf6201e22b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:57.366246 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c89d0-6272-4638-b572-387c860798c9 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:57.370564 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a38dfa-4fa4-4641-b0da-9edf6201e22b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:57.455497 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8b8bf-ef01-40b2-a549-8c43ad1ded12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:57.457308 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8b8bf-ef01-40b2-a549-8c43ad1ded12 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:57.458121 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01170078-056d-4505-b54d-ad479b156b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:57.458624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8b8bf-ef01-40b2-a549-8c43ad1ded12 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:57.459135 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8b8bf-ef01-40b2-a549-8c43ad1ded12 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:57.459986 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01170078-056d-4505-b54d-ad479b156b68 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:57.460867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8b8bf-ef01-40b2-a549-8c43ad1ded12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:05:57.461864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01170078-056d-4505-b54d-ad479b156b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:57.462380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8b8bf-ef01-40b2-a549-8c43ad1ded12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:57.462880 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01170078-056d-4505-b54d-ad479b156b68 None admin] PATH_INFO: `/v3/domains/default/users/0a22ab389c9c45629af99658c60df95d/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:57.465145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8b8bf-ef01-40b2-a549-8c43ad1ded12 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:57.466907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01170078-056d-4505-b54d-ad479b156b68 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0a22ab389c9c45629af99658c60df95d, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:57.469896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01170078-056d-4505-b54d-ad479b156b68 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:57.487409 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 20/36] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:05:57.494781 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8b8bf-ef01-40b2-a549-8c43ad1ded12 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:57.509508 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 17/37] 10.222.0.48 () {58 vars in 1361 bytes} [Tue Sep 27 04:05:57 2022] PUT /identity/v3/domains/default/users/0a22ab389c9c45629af99658c60df95d/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:05:57.510801 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01170078-056d-4505-b54d-ad479b156b68 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:57.522046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:05:57.629886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8b8bf-ef01-40b2-a549-8c43ad1ded12 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:57.680038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb54fdc-227c-4b92-a201-86e03bad2dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:57.680674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb54fdc-227c-4b92-a201-86e03bad2dbb None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:57.680951 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb54fdc-227c-4b92-a201-86e03bad2dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:57.681221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb54fdc-227c-4b92-a201-86e03bad2dbb None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:57.681909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb54fdc-227c-4b92-a201-86e03bad2dbb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:57.683491 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb54fdc-227c-4b92-a201-86e03bad2dbb None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:57.712629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:05:57.772463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01170078-056d-4505-b54d-ad479b156b68 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:57.808608 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c3a91-4c5d-4fc0-aad0-1e8abb989800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:57.809261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c3a91-4c5d-4fc0-aad0-1e8abb989800 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:57.809592 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c3a91-4c5d-4fc0-aad0-1e8abb989800 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:57.809880 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c3a91-4c5d-4fc0-aad0-1e8abb989800 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:57.810786 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c3a91-4c5d-4fc0-aad0-1e8abb989800 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:57.812217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c3a91-4c5d-4fc0-aad0-1e8abb989800 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:57.829405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 18/38] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Sep 27 04:05:57 2022] POST /identity/v3/roles => generated 225 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:05:57.830654 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab18c9-ca20-4c35-b607-0c0bacfe79e2 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:57.831749 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab18c9-ca20-4c35-b607-0c0bacfe79e2 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:57.831749 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab18c9-ca20-4c35-b607-0c0bacfe79e2 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:57.832477 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 19/39] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:05:57.833586 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec59e6-30e0-4d76-8754-d0af3d432237 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:57.833977 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec59e6-30e0-4d76-8754-d0af3d432237 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:57.834263 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec59e6-30e0-4d76-8754-d0af3d432237 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:57.835537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 20/40] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:05:57.840725 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 21/41] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 27 04:05:57 2022] POST /identity/v3/projects => generated 301 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:05:57.841701 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94573c7-bd30-48b9-b7e2-d3af6df022df None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:57.842004 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94573c7-bd30-48b9-b7e2-d3af6df022df None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:57.842289 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94573c7-bd30-48b9-b7e2-d3af6df022df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:57.844883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79778287-008a-4ca7-8411-9679a0b95898 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:57.845174 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79778287-008a-4ca7-8411-9679a0b95898 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:57.845455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79778287-008a-4ca7-8411-9679a0b95898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:57.866404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-79778287-008a-4ca7-8411-9679a0b95898 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:05:57.868060 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-79778287-008a-4ca7-8411-9679a0b95898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:05:57.881821 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d94573c7-bd30-48b9-b7e2-d3af6df022df None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:05:57.884134 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d94573c7-bd30-48b9-b7e2-d3af6df022df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:05:57.943320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:05:57.948957 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 22/42] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:05:58.019059 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 21/43] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:05:58.246999 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79778287-008a-4ca7-8411-9679a0b95898 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:58.302358 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94573c7-bd30-48b9-b7e2-d3af6df022df None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:58.354625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79778287-008a-4ca7-8411-9679a0b95898 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:58.355908 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:05:58.393430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e14402-fc0f-4f50-8180-2c501fa25e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:58.394518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e14402-fc0f-4f50-8180-2c501fa25e6b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:58.395035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e14402-fc0f-4f50-8180-2c501fa25e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:58.395543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e14402-fc0f-4f50-8180-2c501fa25e6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:58.397804 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e14402-fc0f-4f50-8180-2c501fa25e6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:58.399711 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e14402-fc0f-4f50-8180-2c501fa25e6b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:58.401510 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 23/44] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:05:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:05:58.407335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e14402-fc0f-4f50-8180-2c501fa25e6b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:05:58.424959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94573c7-bd30-48b9-b7e2-d3af6df022df None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:58.462074 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e7a30-7f98-4cf1-a6c8-0d5f4e385f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:58.462821 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e7a30-7f98-4cf1-a6c8-0d5f4e385f1b None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:58.463110 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e7a30-7f98-4cf1-a6c8-0d5f4e385f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:58.463388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e7a30-7f98-4cf1-a6c8-0d5f4e385f1b None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:58.464074 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e7a30-7f98-4cf1-a6c8-0d5f4e385f1b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:58.465466 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e7a30-7f98-4cf1-a6c8-0d5f4e385f1b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:58.480494 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:05:58.481903 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Sep 27 04:05:58 2022] POST /identity/v3/roles => generated 223 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:05:58.522196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e14402-fc0f-4f50-8180-2c501fa25e6b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:05:58.559846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa6183-0e26-444b-9186-bd578580668c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:05:58.560478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa6183-0e26-444b-9186-bd578580668c None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:58.560829 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa6183-0e26-444b-9186-bd578580668c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:58.561173 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa6183-0e26-444b-9186-bd578580668c None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:58.561916 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa6183-0e26-444b-9186-bd578580668c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:05:58.563516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa6183-0e26-444b-9186-bd578580668c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:05:58.594107 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 27 04:05:58 2022] POST /identity/v3/projects => generated 312 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:05:59.793395 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e3497-d8f7-4288-98d8-cd9fff22521a None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:59.793927 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e3497-d8f7-4288-98d8-cd9fff22521a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:59.794034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e3497-d8f7-4288-98d8-cd9fff22521a None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:59.795321 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 23/47] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:05:59.800706 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fd7e0-1a25-49ea-b680-29572395beb5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:05:59.801105 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fd7e0-1a25-49ea-b680-29572395beb5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:05:59.801354 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fd7e0-1a25-49ea-b680-29572395beb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:05:59.819571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-565fd7e0-1a25-49ea-b680-29572395beb5 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:05:59.821313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-565fd7e0-1a25-49ea-b680-29572395beb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:05:59.887004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 25/48] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:00.158779 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e3497-d8f7-4288-98d8-cd9fff22521a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:00.260928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e3497-d8f7-4288-98d8-cd9fff22521a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:00.262499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:00.306990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed3c23-26a9-420f-9a47-569d03c10cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:00.308516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed3c23-26a9-420f-9a47-569d03c10cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:00.309564 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed3c23-26a9-420f-9a47-569d03c10cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:00.309840 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed3c23-26a9-420f-9a47-569d03c10cd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:00.321304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed3c23-26a9-420f-9a47-569d03c10cd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:00.326064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-e3ed3c23-26a9-420f-9a47-569d03c10cd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:00.326064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:00.326064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:00.326064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:00.326064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:00.326064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:00.326064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:00.326064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:00.326064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:00.326064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:00.326064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:00.326064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:00.326064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:00.326064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:00.326064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:00.326064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:00.327082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:00.327082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:00.327082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:00.327082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:00.327082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:00.327082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:00.327082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:00.327082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:00.327082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:00.327082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:00.327082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:00.327082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:00.327082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:00.327082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:00.327082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:00.327082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:00.327883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:00.327883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:00.327883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:00.327883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:00.327883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:00.327883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:00.327883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:00.327883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:00.327883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:00.327883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:00.327883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:00.327883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:00.327883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 24/49] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:06:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:00.332964 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fd7e0-1a25-49ea-b680-29572395beb5 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:00.484396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:00.540034 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fd7e0-1a25-49ea-b680-29572395beb5 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:00.572412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56283c03-52e9-4913-9718-bf9bf8dc19c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:00.573019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56283c03-52e9-4913-9718-bf9bf8dc19c4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:00.573307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56283c03-52e9-4913-9718-bf9bf8dc19c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:00.573590 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56283c03-52e9-4913-9718-bf9bf8dc19c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:00.574282 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56283c03-52e9-4913-9718-bf9bf8dc19c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:00.574645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56283c03-52e9-4913-9718-bf9bf8dc19c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:00.576138 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56283c03-52e9-4913-9718-bf9bf8dc19c4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:00.584913 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 26/50] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:00.592152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed3c23-26a9-420f-9a47-569d03c10cd4 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:00.697306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed3c23-26a9-420f-9a47-569d03c10cd4 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:00.730938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aab81-a2de-477a-a09c-ccc2f00decb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:00.731572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aab81-a2de-477a-a09c-ccc2f00decb6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:00.731902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aab81-a2de-477a-a09c-ccc2f00decb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:00.732189 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aab81-a2de-477a-a09c-ccc2f00decb6 None admin] PATH_INFO: `/v3/users/0a22ab389c9c45629af99658c60df95d` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:00.733332 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567aab81-a2de-477a-a09c-ccc2f00decb6 None admin] RBAC: Authorizing `identity:get_user(user_id=0a22ab389c9c45629af99658c60df95d)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:00.734879 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567aab81-a2de-477a-a09c-ccc2f00decb6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:00.736412 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 25/51] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:00 2022] GET /identity/v3/users/0a22ab389c9c45629af99658c60df95d => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:00.741855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56283c03-52e9-4913-9718-bf9bf8dc19c4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:00.775514 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1965339-9ed0-4372-9549-8f563cb44b50 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:00.775898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1965339-9ed0-4372-9549-8f563cb44b50 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:00.776094 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1965339-9ed0-4372-9549-8f563cb44b50 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:00.777427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 26/52] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:06:00.782305 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ae163-a594-4fee-87ca-b9c144e441c7 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:00.782597 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ae163-a594-4fee-87ca-b9c144e441c7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:00.782909 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ae163-a594-4fee-87ca-b9c144e441c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:00.800883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-0b2ae163-a594-4fee-87ca-b9c144e441c7 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:00.802094 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0b2ae163-a594-4fee-87ca-b9c144e441c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:00.825890 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:00.843013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56283c03-52e9-4913-9718-bf9bf8dc19c4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:00.856450 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:00.869425 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 27/53] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:06:00.877739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81813cf-bb50-447e-a3f6-c38701ffa174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:00.878375 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81813cf-bb50-447e-a3f6-c38701ffa174 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:00.878664 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81813cf-bb50-447e-a3f6-c38701ffa174 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:00.878976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81813cf-bb50-447e-a3f6-c38701ffa174 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:00.880099 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81813cf-bb50-447e-a3f6-c38701ffa174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:00.881549 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81813cf-bb50-447e-a3f6-c38701ffa174 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:00.883162 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 27/54] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:06:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:00.888957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ae163-a594-4fee-87ca-b9c144e441c7 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:00.986138 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ae163-a594-4fee-87ca-b9c144e441c7 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:01.018682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e0a43-f5b9-4656-b3fe-1acdcfaba4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:01.019313 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e0a43-f5b9-4656-b3fe-1acdcfaba4bc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:01.019600 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e0a43-f5b9-4656-b3fe-1acdcfaba4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:01.019880 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e0a43-f5b9-4656-b3fe-1acdcfaba4bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:01.020616 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e0a43-f5b9-4656-b3fe-1acdcfaba4bc None admin] RBAC: Adding query filter params (role.id=2613cf4a98d44744a094c7782b19b4b5, scope.domain.id=default, user.id=0a22ab389c9c45629af99658c60df95d) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:01.020932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e0a43-f5b9-4656-b3fe-1acdcfaba4bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:01.022392 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e0a43-f5b9-4656-b3fe-1acdcfaba4bc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:01.028488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 28/55] 10.222.0.48 () {56 vars in 1322 bytes} [Tue Sep 27 04:06:00 2022] GET /identity/v3/role_assignments?user.id=0a22ab389c9c45629af99658c60df95d&scope.domain.id=default&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:01.140734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81813cf-bb50-447e-a3f6-c38701ffa174 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:01.248894 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81813cf-bb50-447e-a3f6-c38701ffa174 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:01.281876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24394f9d-1515-4ce9-9c46-ad2f17b1d042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:01.282502 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24394f9d-1515-4ce9-9c46-ad2f17b1d042 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:01.282817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24394f9d-1515-4ce9-9c46-ad2f17b1d042 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:01.283097 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24394f9d-1515-4ce9-9c46-ad2f17b1d042 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:01.284202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24394f9d-1515-4ce9-9c46-ad2f17b1d042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:01.285656 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24394f9d-1515-4ce9-9c46-ad2f17b1d042 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:01.287239 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 28/56] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:06:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:01.293409 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e0a43-f5b9-4656-b3fe-1acdcfaba4bc None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:01.317761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:01.389691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e0a43-f5b9-4656-b3fe-1acdcfaba4bc None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:01.422232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0a4b7-aa7d-4211-a420-7b0dd164f9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:01.422865 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0a4b7-aa7d-4211-a420-7b0dd164f9ed None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:01.423149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0a4b7-aa7d-4211-a420-7b0dd164f9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:01.423424 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0a4b7-aa7d-4211-a420-7b0dd164f9ed None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:01.424082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0a4b7-aa7d-4211-a420-7b0dd164f9ed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:01.425531 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0a4b7-aa7d-4211-a420-7b0dd164f9ed None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:01.452982 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 29/57] 10.222.0.48 () {60 vars in 1140 bytes} [Tue Sep 27 04:06:01 2022] POST /identity/v3/projects => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:06:03.559078 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc484495-d431-47e5-85e8-a907d5384436 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:03.559582 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc484495-d431-47e5-85e8-a907d5384436 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:03.559667 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc484495-d431-47e5-85e8-a907d5384436 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:03.560977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 29/58] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:03.566149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc244b-1d37-4334-b328-77bc85a1e16a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:03.566559 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc244b-1d37-4334-b328-77bc85a1e16a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:03.566743 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc244b-1d37-4334-b328-77bc85a1e16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:03.584583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-95fc244b-1d37-4334-b328-77bc85a1e16a None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:03.586276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-95fc244b-1d37-4334-b328-77bc85a1e16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:03.654851 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 30/59] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:03.924445 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc484495-d431-47e5-85e8-a907d5384436 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:03.979417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:04.029706 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc484495-d431-47e5-85e8-a907d5384436 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:04.062196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d53cc7-d660-4498-a7a9-8ab7cdf96221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:04.062843 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d53cc7-d660-4498-a7a9-8ab7cdf96221 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:04.063127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d53cc7-d660-4498-a7a9-8ab7cdf96221 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:04.063397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d53cc7-d660-4498-a7a9-8ab7cdf96221 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:04.064500 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d53cc7-d660-4498-a7a9-8ab7cdf96221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:04.065943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d53cc7-d660-4498-a7a9-8ab7cdf96221 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:04.067498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 30/60] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:06:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:04.073202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc244b-1d37-4334-b328-77bc85a1e16a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:04.082532 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:04.172191 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc244b-1d37-4334-b328-77bc85a1e16a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:04.203817 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d55efc-af42-429c-9932-17016c887863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:04.204369 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d55efc-af42-429c-9932-17016c887863 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:04.204654 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d55efc-af42-429c-9932-17016c887863 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:04.204932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d55efc-af42-429c-9932-17016c887863 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:04.205584 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d55efc-af42-429c-9932-17016c887863 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:04.207062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d55efc-af42-429c-9932-17016c887863 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:04.234270 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 31/61] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 27 04:06:04 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:06:07.344341 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5756c-c71f-4d5b-8adf-3f33cf24ee68 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:07.345208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5756c-c71f-4d5b-8adf-3f33cf24ee68 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:07.345639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5756c-c71f-4d5b-8adf-3f33cf24ee68 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:07.347186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 31/62] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:07.353383 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffaa14-9c4d-46ed-897a-02efbacf6c6f None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:07.354114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffaa14-9c4d-46ed-897a-02efbacf6c6f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:07.354544 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffaa14-9c4d-46ed-897a-02efbacf6c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:07.384192 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-55ffaa14-9c4d-46ed-897a-02efbacf6c6f None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:07.385643 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-55ffaa14-9c4d-46ed-897a-02efbacf6c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:07.454054 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:07.477729 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 32/63] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:07.624733 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dc00d-e29c-4506-9bf9-64e566d8abc0 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:07.625030 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dc00d-e29c-4506-9bf9-64e566d8abc0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:07.625225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dc00d-e29c-4506-9bf9-64e566d8abc0 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:07.627002 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 32/64] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:07.632520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05226b9e-6f33-4224-9f95-b73f4c915443 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:07.632823 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05226b9e-6f33-4224-9f95-b73f4c915443 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:07.633114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05226b9e-6f33-4224-9f95-b73f4c915443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:07.667760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-05226b9e-6f33-4224-9f95-b73f4c915443 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:07.668980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-05226b9e-6f33-4224-9f95-b73f4c915443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:07.746536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30a65c-b5d5-44fe-a719-92826d43e7f4 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:07.746862 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30a65c-b5d5-44fe-a719-92826d43e7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:07.747135 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30a65c-b5d5-44fe-a719-92826d43e7f4 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:07.748465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 33/65] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:06:07.753343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 33/66] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:06:07.754517 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb94e3d-9bef-481a-ac16-5247441564f2 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:07.754999 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb94e3d-9bef-481a-ac16-5247441564f2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:07.755429 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb94e3d-9bef-481a-ac16-5247441564f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:07.795737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ecb94e3d-9bef-481a-ac16-5247441564f2 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:07.797293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ecb94e3d-9bef-481a-ac16-5247441564f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:07.825302 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05226b9e-6f33-4224-9f95-b73f4c915443 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:07.928968 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 34/67] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:07.938660 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05226b9e-6f33-4224-9f95-b73f4c915443 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:07.967134 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:07.974826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23ce0c-7937-4f63-b4c4-004a33973d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:07.975727 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23ce0c-7937-4f63-b4c4-004a33973d67 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:07.976212 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23ce0c-7937-4f63-b4c4-004a33973d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:07.976748 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23ce0c-7937-4f63-b4c4-004a33973d67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:07.988291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23ce0c-7937-4f63-b4c4-004a33973d67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:07.993855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-be23ce0c-7937-4f63-b4c4-004a33973d67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:07.993855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:07.993855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:07.993855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:07.993855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:07.993855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:07.993855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:07.993855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:07.993855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:07.993855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:07.993855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:07.993855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:07.993855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:07.993855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:07.993855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:07.993855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:07.994703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:07.994703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:07.994703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:07.994703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:07.994703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:07.994703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:07.994703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:07.994703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:07.994703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:07.994703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:07.994703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:07.994703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:07.994703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:07.994703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:07.994703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:07.994703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:07.995533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:07.995533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:07.995533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:07.995533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:07.995533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:07.995533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:07.995533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:07.995533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:07.995533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:07.995533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:07.995533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:07.995533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:07.998100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 34/68] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:08.004256 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb94e3d-9bef-481a-ac16-5247441564f2 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:08.054421 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:08.063138 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23ce0c-7937-4f63-b4c4-004a33973d67 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:08.155013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb94e3d-9bef-481a-ac16-5247441564f2 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:08.198554 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a35ab-a364-4346-8b25-f0685132124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:08.199541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a35ab-a364-4346-8b25-f0685132124e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:08.200024 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a35ab-a364-4346-8b25-f0685132124e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:08.200497 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a35ab-a364-4346-8b25-f0685132124e None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:08.201367 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a35ab-a364-4346-8b25-f0685132124e None admin] RBAC: Adding query filter params (name=member) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:08.201875 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a35ab-a364-4346-8b25-f0685132124e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:08.203712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a35ab-a364-4346-8b25-f0685132124e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:08.213643 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 35/69] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:08.220887 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a35ab-a364-4346-8b25-f0685132124e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:08.270155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23ce0c-7937-4f63-b4c4-004a33973d67 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:08.306708 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47192d-0546-46f7-accd-7a4786db634b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:08.307361 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47192d-0546-46f7-accd-7a4786db634b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:08.307644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47192d-0546-46f7-accd-7a4786db634b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:08.307921 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47192d-0546-46f7-accd-7a4786db634b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:08.319103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47192d-0546-46f7-accd-7a4786db634b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:08.324955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-ca47192d-0546-46f7-accd-7a4786db634b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:08.324955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:08.324955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:08.324955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:08.324955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:08.324955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:08.324955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:08.324955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:08.324955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:08.324955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:08.324955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:08.324955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:08.324955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:08.324955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:08.324955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:08.324955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:08.325813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:08.325813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:08.325813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:08.325813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:08.325813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:08.325813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:08.325813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:08.325813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:08.325813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:08.325813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:08.325813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:08.325813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:08.325813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:08.325813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:08.325813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:08.325813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:08.326574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:08.326574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:08.326574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:08.326574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:08.326574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:08.326574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:08.326574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:08.326574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:08.326574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:08.326574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:08.326574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:08.326574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:08.326574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 35/70] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:06:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:06:08.327668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9cccc-d8ef-40e5-a740-6615e16d1d6f None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:08.327668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9cccc-d8ef-40e5-a740-6615e16d1d6f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:08.327781 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9cccc-d8ef-40e5-a740-6615e16d1d6f None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:08.329031 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 36/71] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:08.329711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9cccc-d8ef-40e5-a740-6615e16d1d6f None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:08.358217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a35ab-a364-4346-8b25-f0685132124e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:08.367541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:08.382547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:08.393275 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430ee71-381b-4376-922c-bb42414fa6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:08.394012 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430ee71-381b-4376-922c-bb42414fa6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:08.394317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430ee71-381b-4376-922c-bb42414fa6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:08.394602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430ee71-381b-4376-922c-bb42414fa6a8 None admin] PATH_INFO: `/v3/users/90a852f3923340a1a1dbce5574e80268` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:08.411927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430ee71-381b-4376-922c-bb42414fa6a8 None admin] RBAC: Authorizing `identity:get_user(user_id=90a852f3923340a1a1dbce5574e80268)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:08.413412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430ee71-381b-4376-922c-bb42414fa6a8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:08.415124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 36/72] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:08 2022] GET /identity/v3/users/90a852f3923340a1a1dbce5574e80268 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:08.415899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430ee71-381b-4376-922c-bb42414fa6a8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:08.442955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9cccc-d8ef-40e5-a740-6615e16d1d6f None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:08.476764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851abc48-664d-4e20-ad21-5d8c4485cac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:08.477349 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851abc48-664d-4e20-ad21-5d8c4485cac1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:08.477636 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851abc48-664d-4e20-ad21-5d8c4485cac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:08.478168 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851abc48-664d-4e20-ad21-5d8c4485cac1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:08.488265 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851abc48-664d-4e20-ad21-5d8c4485cac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:08.493625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-851abc48-664d-4e20-ad21-5d8c4485cac1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:08.493625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:08.493625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:08.493625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:08.493625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:08.493625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:08.493625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:08.493625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:08.493625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:08.493625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:08.493625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:08.493625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:08.493625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:08.493625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:08.493625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:08.493625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:08.494663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:08.494663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:08.494663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:08.494663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:08.494663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:08.494663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:08.494663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:08.494663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:08.494663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:08.494663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:08.494663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:08.494663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:08.494663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:08.494663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:08.494663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:08.494663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:08.495662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:08.495662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:08.495662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:08.495662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:08.495662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:08.495662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:08.495662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:08.495662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:08.495662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:08.495662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:08.495662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:08.495662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:08.495662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 37/73] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:06:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:08.496472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a7427-40a3-4a09-8268-697e3740ef28 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:08.496537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a7427-40a3-4a09-8268-697e3740ef28 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:08.497045 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a7427-40a3-4a09-8268-697e3740ef28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:08.514120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430ee71-381b-4376-922c-bb42414fa6a8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:08.515319 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c27a7427-40a3-4a09-8268-697e3740ef28 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:08.516511 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c27a7427-40a3-4a09-8268-697e3740ef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:08.547578 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c9428-39d2-446b-8cb5-84950dd5af62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:08.548198 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c9428-39d2-446b-8cb5-84950dd5af62 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:08.548488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c9428-39d2-446b-8cb5-84950dd5af62 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:08.548768 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c9428-39d2-446b-8cb5-84950dd5af62 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:08.549439 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c9428-39d2-446b-8cb5-84950dd5af62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:08.549747 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c9428-39d2-446b-8cb5-84950dd5af62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:08.551158 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c9428-39d2-446b-8cb5-84950dd5af62 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:08.559421 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 37/74] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:08.560563 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd38cf-4d87-44c3-ac05-94636c757130 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:08.560854 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd38cf-4d87-44c3-ac05-94636c757130 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:08.561137 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd38cf-4d87-44c3-ac05-94636c757130 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:08.562639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 38/75] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:08.563377 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd38cf-4d87-44c3-ac05-94636c757130 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:08.587154 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 38/76] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:08.596579 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a7427-40a3-4a09-8268-697e3740ef28 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:08.596686 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:08.635852 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:08.672574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd38cf-4d87-44c3-ac05-94636c757130 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:08.709463 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c24ee-37ca-45d3-a0e2-dfa9f3bca058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:08.709634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a7427-40a3-4a09-8268-697e3740ef28 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:08.710079 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c24ee-37ca-45d3-a0e2-dfa9f3bca058 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:08.710368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c24ee-37ca-45d3-a0e2-dfa9f3bca058 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:08.710708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c24ee-37ca-45d3-a0e2-dfa9f3bca058 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:08.746965 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5732227-c175-4000-af3f-9bb93aedf4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:08.747502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5732227-c175-4000-af3f-9bb93aedf4dd None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:08.747792 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5732227-c175-4000-af3f-9bb93aedf4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:08.748172 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5732227-c175-4000-af3f-9bb93aedf4dd None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:08.748862 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5732227-c175-4000-af3f-9bb93aedf4dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:08.749296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5732227-c175-4000-af3f-9bb93aedf4dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:08.750729 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5732227-c175-4000-af3f-9bb93aedf4dd None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:08.759561 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 39/77] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:06:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:08.760515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5732227-c175-4000-af3f-9bb93aedf4dd None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:08.781245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c24ee-37ca-45d3-a0e2-dfa9f3bca058 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:08.783267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c24ee-37ca-45d3-a0e2-dfa9f3bca058 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:08.810848 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:08.863757 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:08.870881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5732227-c175-4000-af3f-9bb93aedf4dd None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:08.892439 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 39/78] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:08.893687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa2da5-bc84-42b2-adf9-90f76e6c028f None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:08.893978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa2da5-bc84-42b2-adf9-90f76e6c028f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:08.894257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa2da5-bc84-42b2-adf9-90f76e6c028f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:08.905635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779d4c1-f8ae-4a78-8939-29c36ff32a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:08.906315 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779d4c1-f8ae-4a78-8939-29c36ff32a1c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:08.906603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779d4c1-f8ae-4a78-8939-29c36ff32a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:08.906911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779d4c1-f8ae-4a78-8939-29c36ff32a1c None admin] PATH_INFO: `/v3/users/0a22ab389c9c45629af99658c60df95d` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:08.908041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779d4c1-f8ae-4a78-8939-29c36ff32a1c None admin] RBAC: Authorizing `identity:get_user(user_id=0a22ab389c9c45629af99658c60df95d)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:08.909486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779d4c1-f8ae-4a78-8939-29c36ff32a1c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:08.911080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 40/79] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:08 2022] GET /identity/v3/users/0a22ab389c9c45629af99658c60df95d => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:08.911848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779d4c1-f8ae-4a78-8939-29c36ff32a1c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:08.916470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-03aa2da5-bc84-42b2-adf9-90f76e6c028f None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:08.917709 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-03aa2da5-bc84-42b2-adf9-90f76e6c028f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:08.982057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 40/80] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:08.982757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa2da5-bc84-42b2-adf9-90f76e6c028f None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:09.024403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779d4c1-f8ae-4a78-8939-29c36ff32a1c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:09.041090 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:09.061031 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123fad7-0d7b-42ca-97d1-ecf1a4ba4c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:09.061672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123fad7-0d7b-42ca-97d1-ecf1a4ba4c99 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:09.061961 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123fad7-0d7b-42ca-97d1-ecf1a4ba4c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:09.062373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123fad7-0d7b-42ca-97d1-ecf1a4ba4c99 None admin] PATH_INFO: `/v3/users/90a852f3923340a1a1dbce5574e80268` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:09.063402 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123fad7-0d7b-42ca-97d1-ecf1a4ba4c99 None admin] RBAC: Authorizing `identity:get_user(user_id=90a852f3923340a1a1dbce5574e80268)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:09.064860 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123fad7-0d7b-42ca-97d1-ecf1a4ba4c99 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:09.070855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 41/81] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:08 2022] GET /identity/v3/users/90a852f3923340a1a1dbce5574e80268 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:09.070855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123fad7-0d7b-42ca-97d1-ecf1a4ba4c99 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:09.089123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa2da5-bc84-42b2-adf9-90f76e6c028f None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:09.104183 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:09.125749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cea201-02d9-42e7-bec1-cbca05be60d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:09.126379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cea201-02d9-42e7-bec1-cbca05be60d8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:09.126665 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cea201-02d9-42e7-bec1-cbca05be60d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:09.127177 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cea201-02d9-42e7-bec1-cbca05be60d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:09.128082 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cea201-02d9-42e7-bec1-cbca05be60d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:09.129541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cea201-02d9-42e7-bec1-cbca05be60d8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:09.131121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 41/82] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:06:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:09.136206 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cea201-02d9-42e7-bec1-cbca05be60d8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:09.177573 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123fad7-0d7b-42ca-97d1-ecf1a4ba4c99 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:09.213131 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38110f-9055-4ab9-a5c0-a1f9831c9f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:09.213767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38110f-9055-4ab9-a5c0-a1f9831c9f6e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:09.214055 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38110f-9055-4ab9-a5c0-a1f9831c9f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:09.214337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38110f-9055-4ab9-a5c0-a1f9831c9f6e None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:09.215502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38110f-9055-4ab9-a5c0-a1f9831c9f6e None admin] RBAC: Authorizing `identity:get_project(project_id=26f3d9baa4614c7ab91952d7e5132734)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:09.216959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38110f-9055-4ab9-a5c0-a1f9831c9f6e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:09.218590 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 42/83] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:09 2022] GET /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:09.219400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38110f-9055-4ab9-a5c0-a1f9831c9f6e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:09.245284 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cea201-02d9-42e7-bec1-cbca05be60d8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:09.270417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:09.280182 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd1afa-e491-4ee1-961d-26843598100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:09.280758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd1afa-e491-4ee1-961d-26843598100d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:09.281040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd1afa-e491-4ee1-961d-26843598100d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:09.281322 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd1afa-e491-4ee1-961d-26843598100d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:09.314692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:09.318770 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38110f-9055-4ab9-a5c0-a1f9831c9f6e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:09.353855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd1afa-e491-4ee1-961d-26843598100d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:09.355401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd1afa-e491-4ee1-961d-26843598100d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:09.357279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3823dc8-067b-4b5f-814b-26a98131ab79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:09.357901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3823dc8-067b-4b5f-814b-26a98131ab79 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:09.358184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3823dc8-067b-4b5f-814b-26a98131ab79 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:09.358468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3823dc8-067b-4b5f-814b-26a98131ab79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:09.426643 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3823dc8-067b-4b5f-814b-26a98131ab79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:09.428211 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3823dc8-067b-4b5f-814b-26a98131ab79 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:09.453628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 42/84] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:09.459014 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd1afa-e491-4ee1-961d-26843598100d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:09.484886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:09.519880 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:09.525222 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 43/85] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:09.530554 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3823dc8-067b-4b5f-814b-26a98131ab79 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:09.556828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd1afa-e491-4ee1-961d-26843598100d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:09.589672 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c7e59-241b-4f2f-bab7-b221a6f79414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:09.590276 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c7e59-241b-4f2f-bab7-b221a6f79414 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:09.590560 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c7e59-241b-4f2f-bab7-b221a6f79414 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:09.590872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c7e59-241b-4f2f-bab7-b221a6f79414 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:09.591530 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c7e59-241b-4f2f-bab7-b221a6f79414 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:09.592975 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c7e59-241b-4f2f-bab7-b221a6f79414 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:09.621288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 43/86] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 27 04:06:09 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:06:09.622123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c7e59-241b-4f2f-bab7-b221a6f79414 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:09.627462 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3823dc8-067b-4b5f-814b-26a98131ab79 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:09.665355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fbc7d-836e-406b-9e65-61da877943a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:09.666084 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fbc7d-836e-406b-9e65-61da877943a6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:09.666379 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fbc7d-836e-406b-9e65-61da877943a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:09.666676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fbc7d-836e-406b-9e65-61da877943a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:09.667458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fbc7d-836e-406b-9e65-61da877943a6 None admin] RBAC: Adding query filter params (role.id=71cc6516aeff47eea3961db1a3d57f21, scope.project.id=26f3d9baa4614c7ab91952d7e5132734, user.id=90a852f3923340a1a1dbce5574e80268) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:09.667778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fbc7d-836e-406b-9e65-61da877943a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:09.669267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fbc7d-836e-406b-9e65-61da877943a6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:09.675274 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 44/87] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:06:09 2022] GET /identity/v3/role_assignments?user.id=90a852f3923340a1a1dbce5574e80268&scope.project.id=26f3d9baa4614c7ab91952d7e5132734&role.id=71cc6516aeff47eea3961db1a3d57f21 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:09.676160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fbc7d-836e-406b-9e65-61da877943a6 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:09.741900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:09.769226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c7e59-241b-4f2f-bab7-b221a6f79414 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:09.778936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:09.815340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c07143-477c-476c-8e6d-c9e320202c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:09.815935 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c07143-477c-476c-8e6d-c9e320202c32 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:09.816217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c07143-477c-476c-8e6d-c9e320202c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:09.816495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c07143-477c-476c-8e6d-c9e320202c32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:09.828820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fbc7d-836e-406b-9e65-61da877943a6 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:09.832256 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c07143-477c-476c-8e6d-c9e320202c32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:09.840120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-82c07143-477c-476c-8e6d-c9e320202c32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:09.840120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:09.840120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:09.840120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:09.840120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:09.840120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:09.840120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:09.840120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:09.840120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:09.840120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:09.840120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:09.840120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:09.840120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:09.840120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:09.840120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:09.840120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:09.841027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:09.841027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:09.841027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:09.841027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:09.841027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:09.841027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:09.841027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:09.841027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:09.841027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:09.841027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:09.841027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:09.841027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:09.841027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:09.841027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:09.841027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:09.841027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:09.841789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:09.841789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:09.841789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:09.841789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:09.841789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:09.841789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:09.841789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:09.841789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:09.841789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:09.841789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:09.841789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:09.841789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:06:09.843999 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 44/88] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:09.845019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c07143-477c-476c-8e6d-c9e320202c32 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:09.878079 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe57c3-2e26-434e-a337-bbb952682e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:09.879043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe57c3-2e26-434e-a337-bbb952682e2f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:09.880061 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe57c3-2e26-434e-a337-bbb952682e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:09.880541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe57c3-2e26-434e-a337-bbb952682e2f None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:09.881940 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe57c3-2e26-434e-a337-bbb952682e2f None admin] RBAC: Authorizing `identity:get_project(project_id=26f3d9baa4614c7ab91952d7e5132734)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:09.884115 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe57c3-2e26-434e-a337-bbb952682e2f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:09.890750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 45/89] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:09 2022] GET /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:09.890750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe57c3-2e26-434e-a337-bbb952682e2f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:09.981950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c07143-477c-476c-8e6d-c9e320202c32 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:10.021927 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe57c3-2e26-434e-a337-bbb952682e2f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:10.024658 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0c81d-91df-4a40-afff-7a9f74b10ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:10.026151 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0c81d-91df-4a40-afff-7a9f74b10ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:10.026442 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0c81d-91df-4a40-afff-7a9f74b10ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:10.026770 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0c81d-91df-4a40-afff-7a9f74b10ef2 None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:10.027979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0c81d-91df-4a40-afff-7a9f74b10ef2 None admin] RBAC: Authorizing `identity:get_project(project_id=26f3d9baa4614c7ab91952d7e5132734)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:10.031029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0c81d-91df-4a40-afff-7a9f74b10ef2 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:10.032887 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 45/90] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:09 2022] GET /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:10.033885 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0c81d-91df-4a40-afff-7a9f74b10ef2 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:10.053414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:10.058522 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:10.070215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7a5bf-b479-4870-82ad-99510d4243a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:10.071225 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7a5bf-b479-4870-82ad-99510d4243a8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:10.071997 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7a5bf-b479-4870-82ad-99510d4243a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:10.072820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7a5bf-b479-4870-82ad-99510d4243a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:10.074336 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7a5bf-b479-4870-82ad-99510d4243a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:10.075174 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7a5bf-b479-4870-82ad-99510d4243a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:10.077403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7a5bf-b479-4870-82ad-99510d4243a8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:10.088444 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 46/91] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:10.089556 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7a5bf-b479-4870-82ad-99510d4243a8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:10.167284 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0c81d-91df-4a40-afff-7a9f74b10ef2 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:10.219375 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7a5bf-b479-4870-82ad-99510d4243a8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:10.226064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064bd93-ed32-4979-895b-565e80f70e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:10.226682 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064bd93-ed32-4979-895b-565e80f70e7c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:10.227650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064bd93-ed32-4979-895b-565e80f70e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:10.228209 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064bd93-ed32-4979-895b-565e80f70e7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:10.230039 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064bd93-ed32-4979-895b-565e80f70e7c None admin] RBAC: Adding query filter params (role.id=2613cf4a98d44744a094c7782b19b4b5, scope.project.id=26f3d9baa4614c7ab91952d7e5132734, user.id=0a22ab389c9c45629af99658c60df95d) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:10.230362 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064bd93-ed32-4979-895b-565e80f70e7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:10.231924 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064bd93-ed32-4979-895b-565e80f70e7c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:10.241890 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 46/92] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:06:10 2022] GET /identity/v3/role_assignments?user.id=0a22ab389c9c45629af99658c60df95d&scope.project.id=26f3d9baa4614c7ab91952d7e5132734&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:10.242797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064bd93-ed32-4979-895b-565e80f70e7c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:10.307170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed73c16-3e50-4d52-a772-7e99f6fd22cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:10.308146 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed73c16-3e50-4d52-a772-7e99f6fd22cc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:10.308621 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed73c16-3e50-4d52-a772-7e99f6fd22cc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:10.309079 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed73c16-3e50-4d52-a772-7e99f6fd22cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:10.310032 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed73c16-3e50-4d52-a772-7e99f6fd22cc None admin] RBAC: Adding query filter params (role.id=9e2965c7d68d423a965894a8eb16903f, scope.project.id=26f3d9baa4614c7ab91952d7e5132734, user.id=90a852f3923340a1a1dbce5574e80268) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:10.310542 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed73c16-3e50-4d52-a772-7e99f6fd22cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:10.312266 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed73c16-3e50-4d52-a772-7e99f6fd22cc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:10.328832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 47/93] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:06:10 2022] GET /identity/v3/role_assignments?user.id=90a852f3923340a1a1dbce5574e80268&scope.project.id=26f3d9baa4614c7ab91952d7e5132734&role.id=9e2965c7d68d423a965894a8eb16903f => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:10.335486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:10.370068 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064bd93-ed32-4979-895b-565e80f70e7c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:10.410486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bf54f-ca71-4341-81ce-3595d6e106b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:10.411182 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bf54f-ca71-4341-81ce-3595d6e106b7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:10.411473 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bf54f-ca71-4341-81ce-3595d6e106b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:10.411758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bf54f-ca71-4341-81ce-3595d6e106b7 None admin] PATH_INFO: `/v3/users/90a852f3923340a1a1dbce5574e80268` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:10.413035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bf54f-ca71-4341-81ce-3595d6e106b7 None admin] RBAC: Authorizing `identity:get_user(user_id=90a852f3923340a1a1dbce5574e80268)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:10.415315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bf54f-ca71-4341-81ce-3595d6e106b7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:10.417489 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 47/94] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:10 2022] GET /identity/v3/users/90a852f3923340a1a1dbce5574e80268 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:10.422979 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed73c16-3e50-4d52-a772-7e99f6fd22cc None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:10.520658 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:10.579840 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed73c16-3e50-4d52-a772-7e99f6fd22cc None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:10.623508 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc565a7-3b7b-4544-ad8d-54286c009001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:10.624179 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc565a7-3b7b-4544-ad8d-54286c009001 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:10.624471 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc565a7-3b7b-4544-ad8d-54286c009001 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:10.624750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc565a7-3b7b-4544-ad8d-54286c009001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:10.699381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc565a7-3b7b-4544-ad8d-54286c009001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:10.700874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc565a7-3b7b-4544-ad8d-54286c009001 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:10.768663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:10.828524 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 48/95] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:10.834177 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bf54f-ca71-4341-81ce-3595d6e106b7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:10.958764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bf54f-ca71-4341-81ce-3595d6e106b7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:10.993890 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ada7d9-7d0e-479c-be4c-96d2e2120098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:10.994535 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ada7d9-7d0e-479c-be4c-96d2e2120098 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:10.994852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ada7d9-7d0e-479c-be4c-96d2e2120098 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:10.995132 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ada7d9-7d0e-479c-be4c-96d2e2120098 None admin] PATH_INFO: `/v3/projects/76576f318a6d497ebf3709211b1432ba` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:10.996284 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ada7d9-7d0e-479c-be4c-96d2e2120098 None admin] RBAC: Authorizing `identity:get_project(project_id=76576f318a6d497ebf3709211b1432ba)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:10.997755 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ada7d9-7d0e-479c-be4c-96d2e2120098 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:10.999440 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 48/96] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:10 2022] GET /identity/v3/projects/76576f318a6d497ebf3709211b1432ba => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:11.005433 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc565a7-3b7b-4544-ad8d-54286c009001 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:11.118600 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc565a7-3b7b-4544-ad8d-54286c009001 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:11.156912 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d311e8-0301-4d59-b221-65b51399c282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:11.157529 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d311e8-0301-4d59-b221-65b51399c282 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:11.157817 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d311e8-0301-4d59-b221-65b51399c282 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:11.158099 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d311e8-0301-4d59-b221-65b51399c282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:11.158884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d311e8-0301-4d59-b221-65b51399c282 None admin] RBAC: Adding query filter params (role.id=71cc6516aeff47eea3961db1a3d57f21, scope.project.id=76576f318a6d497ebf3709211b1432ba, user.id=90a852f3923340a1a1dbce5574e80268) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:11.159203 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d311e8-0301-4d59-b221-65b51399c282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:11.160775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d311e8-0301-4d59-b221-65b51399c282 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:11.169967 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 49/97] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:06:11 2022] GET /identity/v3/role_assignments?user.id=90a852f3923340a1a1dbce5574e80268&scope.project.id=76576f318a6d497ebf3709211b1432ba&role.id=71cc6516aeff47eea3961db1a3d57f21 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:12.503124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9f83a-857e-4537-b7e3-71defeb84c4b None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:12.503648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9f83a-857e-4537-b7e3-71defeb84c4b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:12.503753 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9f83a-857e-4537-b7e3-71defeb84c4b None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:12.505151 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 49/98] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:12.523167 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997b280-8c45-4951-ac87-17fded86c4b6 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:12.523657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997b280-8c45-4951-ac87-17fded86c4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:12.524367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997b280-8c45-4951-ac87-17fded86c4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:12.545952 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-3997b280-8c45-4951-ac87-17fded86c4b6 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:12.547188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3997b280-8c45-4951-ac87-17fded86c4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:12.568148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:12.630650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 50/99] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:13.026963 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c0b13-ca9f-44bd-92e9-3695112d0a22 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:13.027353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c0b13-ca9f-44bd-92e9-3695112d0a22 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:13.027563 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c0b13-ca9f-44bd-92e9-3695112d0a22 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:13.029144 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 50/100] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:13.047243 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c076ea-ae1f-4ce2-9861-88f29885cf65 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:13.047558 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c076ea-ae1f-4ce2-9861-88f29885cf65 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:13.047810 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c076ea-ae1f-4ce2-9861-88f29885cf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:13.075794 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-51c076ea-ae1f-4ce2-9861-88f29885cf65 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:13.077017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-51c076ea-ae1f-4ce2-9861-88f29885cf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:13.148492 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c0b13-ca9f-44bd-92e9-3695112d0a22 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:13.162197 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:13.179190 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 51/101] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:13.181157 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9631c86-dcd7-49da-ad3f-e41362f8aa3b None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:13.181839 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9631c86-dcd7-49da-ad3f-e41362f8aa3b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:13.182130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9631c86-dcd7-49da-ad3f-e41362f8aa3b None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:13.183789 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 52/102] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:13.190249 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98618b9d-1e58-4b9d-b9e1-19786b583650 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:13.190537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98618b9d-1e58-4b9d-b9e1-19786b583650 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:13.190838 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98618b9d-1e58-4b9d-b9e1-19786b583650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:13.229543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-98618b9d-1e58-4b9d-b9e1-19786b583650 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:13.230919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-98618b9d-1e58-4b9d-b9e1-19786b583650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:13.355480 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c0b13-ca9f-44bd-92e9-3695112d0a22 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:13.417018 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 53/103] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:06:13.434579 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dadee-7536-4e2a-96ee-5b3ef79dc1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:13.435255 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dadee-7536-4e2a-96ee-5b3ef79dc1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:13.435539 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dadee-7536-4e2a-96ee-5b3ef79dc1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:13.435818 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dadee-7536-4e2a-96ee-5b3ef79dc1f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:13.462660 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68dadee-7536-4e2a-96ee-5b3ef79dc1f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:13.476685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-d68dadee-7536-4e2a-96ee-5b3ef79dc1f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:13.476685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:13.476685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:13.476685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:13.476685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:13.476685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:13.476685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:13.476685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:13.476685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:13.476685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:13.476685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:13.476685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:13.476685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:13.476685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:13.476685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:13.476685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:13.478357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:13.478357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:13.478357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:13.478357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:13.478357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:13.478357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:13.478357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:13.478357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:13.478357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:13.478357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:13.478357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:13.478357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:13.478357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:13.478357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:13.478357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:13.478357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:13.479156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:13.479156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:13.479156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:13.479156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:13.479156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:13.479156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:13.479156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:13.479156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:13.479156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:13.479156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:13.479156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:13.479156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:06:13.479156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 51/104] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:06:13.486410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98618b9d-1e58-4b9d-b9e1-19786b583650 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:13.510532 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:13.585535 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dadee-7536-4e2a-96ee-5b3ef79dc1f7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:13.629248 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98618b9d-1e58-4b9d-b9e1-19786b583650 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:13.694623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:13.695353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9336f-e487-41a0-8a77-768d7bbaa0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:13.699334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9336f-e487-41a0-8a77-768d7bbaa0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:13.699653 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9336f-e487-41a0-8a77-768d7bbaa0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:13.699992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9336f-e487-41a0-8a77-768d7bbaa0c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:13.701878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9336f-e487-41a0-8a77-768d7bbaa0c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:13.702201 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9336f-e487-41a0-8a77-768d7bbaa0c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:13.703695 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9336f-e487-41a0-8a77-768d7bbaa0c5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:13.724376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 54/105] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:13.731229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9336f-e487-41a0-8a77-768d7bbaa0c5 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:13.740043 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dadee-7536-4e2a-96ee-5b3ef79dc1f7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:13.788348 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e83da-cc73-4f11-a3e4-950266197a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:13.788994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e83da-cc73-4f11-a3e4-950266197a40 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:13.789283 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e83da-cc73-4f11-a3e4-950266197a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:13.790201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e83da-cc73-4f11-a3e4-950266197a40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:13.795404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e83da-cc73-4f11-a3e4-950266197a40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:13.796893 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e83da-cc73-4f11-a3e4-950266197a40 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:13.798502 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 52/106] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:06:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:13.799755 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400769ec-1186-42bc-bb6e-fd9048e4db17 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:13.800060 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400769ec-1186-42bc-bb6e-fd9048e4db17 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:13.800345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400769ec-1186-42bc-bb6e-fd9048e4db17 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:13.801547 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 53/107] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:13.808594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400769ec-1186-42bc-bb6e-fd9048e4db17 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:13.835395 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:13.856249 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9336f-e487-41a0-8a77-768d7bbaa0c5 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:13.895248 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60301f-b944-4520-8d94-ffd41612129f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:13.895862 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60301f-b944-4520-8d94-ffd41612129f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:13.896211 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60301f-b944-4520-8d94-ffd41612129f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:13.896495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60301f-b944-4520-8d94-ffd41612129f None admin] PATH_INFO: `/v3/users/90a852f3923340a1a1dbce5574e80268` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:13.898374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60301f-b944-4520-8d94-ffd41612129f None admin] RBAC: Authorizing `identity:get_user(user_id=90a852f3923340a1a1dbce5574e80268)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:13.900290 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60301f-b944-4520-8d94-ffd41612129f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:13.902214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 55/108] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:13 2022] GET /identity/v3/users/90a852f3923340a1a1dbce5574e80268 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:13.904025 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeb8b1-1451-442a-aeeb-338d1a255deb None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:13.904318 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeb8b1-1451-442a-aeeb-338d1a255deb None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:13.904601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeb8b1-1451-442a-aeeb-338d1a255deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:13.927425 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9adeb8b1-1451-442a-aeeb-338d1a255deb None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:13.928644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9adeb8b1-1451-442a-aeeb-338d1a255deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:13.944510 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400769ec-1186-42bc-bb6e-fd9048e4db17 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:13.981688 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b4d44-4229-4d4b-9897-36ccfff182a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:13.982309 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b4d44-4229-4d4b-9897-36ccfff182a9 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:13.982597 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b4d44-4229-4d4b-9897-36ccfff182a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:13.982909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b4d44-4229-4d4b-9897-36ccfff182a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:13.983582 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b4d44-4229-4d4b-9897-36ccfff182a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:13.985063 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b4d44-4229-4d4b-9897-36ccfff182a9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:13.995049 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:14.004281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 56/109] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:14.005594 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fffbf8-c341-48c9-9cf0-74f1142ddbfe None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:14.005900 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fffbf8-c341-48c9-9cf0-74f1142ddbfe None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:14.006240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fffbf8-c341-48c9-9cf0-74f1142ddbfe None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:14.007649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 57/110] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:14.008796 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fffbf8-c341-48c9-9cf0-74f1142ddbfe None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:14.026690 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 54/111] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 27 04:06:13 2022] POST /identity/v3/projects => generated 302 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:06:14.027422 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b4d44-4229-4d4b-9897-36ccfff182a9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:14.148921 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:14.206683 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b4d44-4229-4d4b-9897-36ccfff182a9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:14.232097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fffbf8-c341-48c9-9cf0-74f1142ddbfe None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:14.244677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac83d77-f679-4e3b-b138-758ee36154da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:14.245327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac83d77-f679-4e3b-b138-758ee36154da None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:14.245717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac83d77-f679-4e3b-b138-758ee36154da None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:14.246006 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac83d77-f679-4e3b-b138-758ee36154da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:14.256816 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac83d77-f679-4e3b-b138-758ee36154da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:14.262225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-3ac83d77-f679-4e3b-b138-758ee36154da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:06:14.262225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:14.262225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:14.262225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:14.262225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:14.262225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:14.262225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:14.262225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:14.262225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:14.262225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:14.262225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:14.262225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:14.262225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:14.262225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:14.262225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:14.262225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:14.263317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:14.263317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:14.263317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:14.263317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:14.263317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:14.263317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:14.263317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:14.263317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:14.263317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:14.263317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:14.263317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:14.263317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:14.263317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:14.263317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:14.263317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:14.263317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:14.264055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:14.264055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:14.264055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:14.264055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:14.264055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:14.264055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:14.264055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:14.264055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:14.264055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:14.264055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:14.264055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:06:14.264055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:06:14.264055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 55/112] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:14.264673 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35023fae-b558-43ac-925c-7fefeb2c3d0b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:14.265483 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35023fae-b558-43ac-925c-7fefeb2c3d0b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:14.265483 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35023fae-b558-43ac-925c-7fefeb2c3d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:14.277042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5ecb1-c735-4c81-8e82-755df5fbdf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:14.278074 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5ecb1-c735-4c81-8e82-755df5fbdf8c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:14.278624 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5ecb1-c735-4c81-8e82-755df5fbdf8c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:14.279121 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5ecb1-c735-4c81-8e82-755df5fbdf8c None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:14.281175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5ecb1-c735-4c81-8e82-755df5fbdf8c None admin] RBAC: Authorizing `identity:get_project(project_id=26f3d9baa4614c7ab91952d7e5132734)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:14.283048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5ecb1-c735-4c81-8e82-755df5fbdf8c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:14.284652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-35023fae-b558-43ac-925c-7fefeb2c3d0b None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:14.285333 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 58/113] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:14 2022] GET /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:14.285875 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-35023fae-b558-43ac-925c-7fefeb2c3d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:14.286597 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5ecb1-c735-4c81-8e82-755df5fbdf8c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:14.340216 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:14.363779 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 56/114] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:14.363779 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35023fae-b558-43ac-925c-7fefeb2c3d0b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:14.438615 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5ecb1-c735-4c81-8e82-755df5fbdf8c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:14.479143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18344dcb-18c2-42a2-93d4-abb4be772057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:14.480147 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18344dcb-18c2-42a2-93d4-abb4be772057 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:14.480723 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18344dcb-18c2-42a2-93d4-abb4be772057 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:14.481217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18344dcb-18c2-42a2-93d4-abb4be772057 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:14.482148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18344dcb-18c2-42a2-93d4-abb4be772057 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:14.482673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18344dcb-18c2-42a2-93d4-abb4be772057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:14.484339 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18344dcb-18c2-42a2-93d4-abb4be772057 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:14.490471 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:14.495738 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 59/115] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:14.496754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18344dcb-18c2-42a2-93d4-abb4be772057 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:14.498050 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35023fae-b558-43ac-925c-7fefeb2c3d0b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:14.554801 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3113f-59dc-47c3-943d-fb846ad9bb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:14.556056 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3113f-59dc-47c3-943d-fb846ad9bb48 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:14.556346 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3113f-59dc-47c3-943d-fb846ad9bb48 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:14.556633 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3113f-59dc-47c3-943d-fb846ad9bb48 None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734/users/90a852f3923340a1a1dbce5574e80268/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:14.558699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3113f-59dc-47c3-943d-fb846ad9bb48 None admin] RBAC: Authorizing `identity:create_grant(project_id=26f3d9baa4614c7ab91952d7e5132734, user_id=90a852f3923340a1a1dbce5574e80268, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:14.560279 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3113f-59dc-47c3-943d-fb846ad9bb48 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:14.589770 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 57/116] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:06:14 2022] PUT /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734/users/90a852f3923340a1a1dbce5574e80268/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:06:14.590497 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3113f-59dc-47c3-943d-fb846ad9bb48 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:14.608632 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18344dcb-18c2-42a2-93d4-abb4be772057 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:14.643236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:14.647804 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1145bc-5154-485b-a904-19667f16c632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:14.649319 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1145bc-5154-485b-a904-19667f16c632 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:14.649978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1145bc-5154-485b-a904-19667f16c632 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:14.650540 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1145bc-5154-485b-a904-19667f16c632 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:14.662435 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1145bc-5154-485b-a904-19667f16c632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:14.675859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-da1145bc-5154-485b-a904-19667f16c632 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:14.675859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:14.675859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:14.675859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:14.675859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:14.675859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:14.675859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:14.675859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:14.675859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:14.675859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:14.675859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:14.675859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:14.675859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:14.675859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:14.675859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:14.675859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:14.676767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:14.676767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:14.676767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:14.676767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:14.676767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:14.676767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:14.676767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:14.676767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:14.676767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:14.676767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:14.676767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:14.676767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:14.676767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:14.676767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:14.676767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:14.676767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:14.677538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:14.677538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:14.677538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:14.677538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:14.677538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:14.677538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:14.677538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:14.677538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:14.677538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:14.677538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:14.677538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:14.677538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:14.680863 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 60/117] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:06:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:14.683247 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dbeee-d977-47d3-be22-eafa40e85c76 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:14.683784 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dbeee-d977-47d3-be22-eafa40e85c76 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:14.684277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dbeee-d977-47d3-be22-eafa40e85c76 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:14.685985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 61/118] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:14.691942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dbeee-d977-47d3-be22-eafa40e85c76 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:14.736521 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3113f-59dc-47c3-943d-fb846ad9bb48 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:14.762658 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:14.791558 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1185e-bea1-4fee-9678-4c4932950a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:14.792610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1185e-bea1-4fee-9678-4c4932950a58 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:14.793006 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1185e-bea1-4fee-9678-4c4932950a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:14.793772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1185e-bea1-4fee-9678-4c4932950a58 None admin] PATH_INFO: `/v3/users/433e75aa58bb492f83b621c30081fd22` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:14.811530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dbeee-d977-47d3-be22-eafa40e85c76 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:14.813861 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1185e-bea1-4fee-9678-4c4932950a58 None admin] RBAC: Authorizing `identity:get_user(user_id=433e75aa58bb492f83b621c30081fd22)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:14.816657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1185e-bea1-4fee-9678-4c4932950a58 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:14.818937 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 58/119] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:14 2022] GET /identity/v3/users/433e75aa58bb492f83b621c30081fd22 => generated 289 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:14.820332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3068401-4219-4b8e-8539-09aa18c8f79b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:14.821239 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3068401-4219-4b8e-8539-09aa18c8f79b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:14.821586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3068401-4219-4b8e-8539-09aa18c8f79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:14.843799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-a3068401-4219-4b8e-8539-09aa18c8f79b None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:14.845318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a3068401-4219-4b8e-8539-09aa18c8f79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:14.859137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e3388-9c97-4ccf-bd23-b99c82df58eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:14.859768 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e3388-9c97-4ccf-bd23-b99c82df58eb None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:14.860059 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e3388-9c97-4ccf-bd23-b99c82df58eb None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:14.860341 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e3388-9c97-4ccf-bd23-b99c82df58eb None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:14.861035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e3388-9c97-4ccf-bd23-b99c82df58eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:14.861346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e3388-9c97-4ccf-bd23-b99c82df58eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:14.862782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e3388-9c97-4ccf-bd23-b99c82df58eb None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:14.874169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 62/120] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:14.877122 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e3388-9c97-4ccf-bd23-b99c82df58eb None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:14.945329 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 59/121] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:14.946242 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3068401-4219-4b8e-8539-09aa18c8f79b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:14.983124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:14.996075 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e3388-9c97-4ccf-bd23-b99c82df58eb None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:15.034183 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:15.058266 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810dabb-0dd7-4a4b-a981-219a632811d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:15.058943 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810dabb-0dd7-4a4b-a981-219a632811d7 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:15.059235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810dabb-0dd7-4a4b-a981-219a632811d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:15.059527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810dabb-0dd7-4a4b-a981-219a632811d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:15.084957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810dabb-0dd7-4a4b-a981-219a632811d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:15.091362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-c810dabb-0dd7-4a4b-a981-219a632811d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:15.091362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:15.091362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:15.091362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:15.091362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:15.091362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:15.091362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:15.091362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:15.091362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:15.091362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:15.091362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:15.091362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:15.091362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:15.091362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:15.091362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:15.091362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:15.092210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:15.092210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:15.092210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:15.092210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:15.092210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:15.092210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:15.092210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:15.092210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:15.092210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:15.092210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:15.092210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:15.092210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:15.092210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:15.092210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:15.092210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:15.092210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:15.093108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:15.093108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:15.093108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:15.093108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:15.093108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:15.093108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:15.093108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:15.093108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:15.093108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:15.093108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:15.093108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:15.093108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:15.093108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 63/122] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:06:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:15.093836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810dabb-0dd7-4a4b-a981-219a632811d7 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:15.122420 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3068401-4219-4b8e-8539-09aa18c8f79b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:15.161952 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70654e63-1a68-4102-bdc7-1da0f547dee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:15.163956 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70654e63-1a68-4102-bdc7-1da0f547dee5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:15.163956 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70654e63-1a68-4102-bdc7-1da0f547dee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:15.163956 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70654e63-1a68-4102-bdc7-1da0f547dee5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:15.244997 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70654e63-1a68-4102-bdc7-1da0f547dee5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:15.246568 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70654e63-1a68-4102-bdc7-1da0f547dee5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:15.311145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:15.321909 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810dabb-0dd7-4a4b-a981-219a632811d7 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:15.359105 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 60/123] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:15.360472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70654e63-1a68-4102-bdc7-1da0f547dee5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:15.366222 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be869c4c-976e-419d-a6b2-a478dc75be65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:15.367065 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be869c4c-976e-419d-a6b2-a478dc75be65 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:15.367558 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be869c4c-976e-419d-a6b2-a478dc75be65 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:15.367982 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be869c4c-976e-419d-a6b2-a478dc75be65 None admin] PATH_INFO: `/v3/users/0a22ab389c9c45629af99658c60df95d` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:15.369332 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be869c4c-976e-419d-a6b2-a478dc75be65 None admin] RBAC: Authorizing `identity:get_user(user_id=0a22ab389c9c45629af99658c60df95d)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:15.371959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be869c4c-976e-419d-a6b2-a478dc75be65 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:15.374550 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 64/124] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:15 2022] GET /identity/v3/users/0a22ab389c9c45629af99658c60df95d => generated 247 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:15.375630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be869c4c-976e-419d-a6b2-a478dc75be65 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:15.443299 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:15.488381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70654e63-1a68-4102-bdc7-1da0f547dee5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:15.497871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be869c4c-976e-419d-a6b2-a478dc75be65 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:15.517353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:15.527716 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e5724-23f5-45d1-97f8-9c76c8e65690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:15.528534 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e5724-23f5-45d1-97f8-9c76c8e65690 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:15.528967 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e5724-23f5-45d1-97f8-9c76c8e65690 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:15.529492 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e5724-23f5-45d1-97f8-9c76c8e65690 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:15.530412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e5724-23f5-45d1-97f8-9c76c8e65690 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:15.530941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e5724-23f5-45d1-97f8-9c76c8e65690 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:15.532507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e5724-23f5-45d1-97f8-9c76c8e65690 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:15.542849 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 61/125] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:06:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:15.543382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446c52b-4159-45f2-a941-b49437d3112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:15.544142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e5724-23f5-45d1-97f8-9c76c8e65690 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:15.544271 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446c52b-4159-45f2-a941-b49437d3112c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:15.544533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446c52b-4159-45f2-a941-b49437d3112c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:15.544889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446c52b-4159-45f2-a941-b49437d3112c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:15.558003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446c52b-4159-45f2-a941-b49437d3112c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:15.565941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-5446c52b-4159-45f2-a941-b49437d3112c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:15.565941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:15.565941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:15.565941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:15.565941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:15.565941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:15.565941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:15.565941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:15.565941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:15.565941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:15.565941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:15.565941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:15.565941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:15.565941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:15.565941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:15.565941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:15.566835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:15.566835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:15.566835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:15.566835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:15.566835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:15.566835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:15.566835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:15.566835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:15.566835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:15.566835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:15.566835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:15.566835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:15.566835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:15.566835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:15.566835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:15.566835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:15.567604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:15.567604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:15.567604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:15.567604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:15.567604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:15.567604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:15.567604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:15.567604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:15.567604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:15.567604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:15.567604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:15.567604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:15.567604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 65/126] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:15.568230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446c52b-4159-45f2-a941-b49437d3112c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:15.677613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446c52b-4159-45f2-a941-b49437d3112c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:15.680692 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e5724-23f5-45d1-97f8-9c76c8e65690 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:15.702754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:15.750545 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8c6f4-844e-4239-bf9e-727589627721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:15.752108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8c6f4-844e-4239-bf9e-727589627721 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:15.752108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8c6f4-844e-4239-bf9e-727589627721 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:15.752108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8c6f4-844e-4239-bf9e-727589627721 None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:15.758738 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8c6f4-844e-4239-bf9e-727589627721 None admin] RBAC: Authorizing `identity:get_project(project_id=26f3d9baa4614c7ab91952d7e5132734)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:15.758738 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8c6f4-844e-4239-bf9e-727589627721 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:15.758738 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 66/127] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:15 2022] GET /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:15.766739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7836f50-ce73-4b64-affe-a446b1432fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:15.766739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7836f50-ce73-4b64-affe-a446b1432fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:15.766739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7836f50-ce73-4b64-affe-a446b1432fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:15.766739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7836f50-ce73-4b64-affe-a446b1432fd0 None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:15.767065 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7836f50-ce73-4b64-affe-a446b1432fd0 None admin] RBAC: Authorizing `identity:get_project(project_id=26f3d9baa4614c7ab91952d7e5132734)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:15.767065 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7836f50-ce73-4b64-affe-a446b1432fd0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:15.768818 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 62/128] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:15 2022] GET /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:15.770091 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7836f50-ce73-4b64-affe-a446b1432fd0 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:15.774743 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8c6f4-844e-4239-bf9e-727589627721 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:15.887177 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:15.974741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7836f50-ce73-4b64-affe-a446b1432fd0 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:15.978736 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8c6f4-844e-4239-bf9e-727589627721 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:16.034750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b082e-ddcb-4b17-8360-f3b47eec8087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:16.035348 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b082e-ddcb-4b17-8360-f3b47eec8087 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:16.038737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b082e-ddcb-4b17-8360-f3b47eec8087 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:16.038737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b082e-ddcb-4b17-8360-f3b47eec8087 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:16.038737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b082e-ddcb-4b17-8360-f3b47eec8087 None admin] RBAC: Adding query filter params (name=member) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:16.038737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b082e-ddcb-4b17-8360-f3b47eec8087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:16.038737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b082e-ddcb-4b17-8360-f3b47eec8087 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:16.046097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fe4b9-1005-4e72-88db-0619ffb5b91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:16.046762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fe4b9-1005-4e72-88db-0619ffb5b91d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:16.047058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fe4b9-1005-4e72-88db-0619ffb5b91d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:16.050740 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fe4b9-1005-4e72-88db-0619ffb5b91d None admin] PATH_INFO: `/v3/users/90a852f3923340a1a1dbce5574e80268` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:16.053128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fe4b9-1005-4e72-88db-0619ffb5b91d None admin] RBAC: Authorizing `identity:get_user(user_id=90a852f3923340a1a1dbce5574e80268)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:16.054765 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fe4b9-1005-4e72-88db-0619ffb5b91d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:16.057462 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 67/129] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:15 2022] GET /identity/v3/users/90a852f3923340a1a1dbce5574e80268 => generated 275 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:16.058240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fe4b9-1005-4e72-88db-0619ffb5b91d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:16.060727 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 63/130] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:16.065153 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b082e-ddcb-4b17-8360-f3b47eec8087 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:16.147935 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:16.219757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b082e-ddcb-4b17-8360-f3b47eec8087 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:16.219946 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fe4b9-1005-4e72-88db-0619ffb5b91d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:16.240754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:16.258802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6d83d-35f5-4eb7-a8dc-fa198bb509ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:16.259630 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6d83d-35f5-4eb7-a8dc-fa198bb509ef None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:16.260123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6d83d-35f5-4eb7-a8dc-fa198bb509ef None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:16.260549 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6d83d-35f5-4eb7-a8dc-fa198bb509ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:16.261606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6d83d-35f5-4eb7-a8dc-fa198bb509ef None admin] RBAC: Adding query filter params (role.id=d8b538ae7b664438823dd39746467d37, scope.project.id=26f3d9baa4614c7ab91952d7e5132734, user.id=433e75aa58bb492f83b621c30081fd22) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:16.262120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6d83d-35f5-4eb7-a8dc-fa198bb509ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:16.263748 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6d83d-35f5-4eb7-a8dc-fa198bb509ef None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:16.266510 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4da30-24ec-4bfb-97f6-2ecb4d33f049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:16.267663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4da30-24ec-4bfb-97f6-2ecb4d33f049 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:16.267958 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4da30-24ec-4bfb-97f6-2ecb4d33f049 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:16.268397 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4da30-24ec-4bfb-97f6-2ecb4d33f049 None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734/users/0a22ab389c9c45629af99658c60df95d/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:16.277058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4da30-24ec-4bfb-97f6-2ecb4d33f049 None admin] RBAC: Authorizing `identity:create_grant(project_id=26f3d9baa4614c7ab91952d7e5132734, user_id=0a22ab389c9c45629af99658c60df95d, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:16.277058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4da30-24ec-4bfb-97f6-2ecb4d33f049 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:16.277845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 64/131] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:06:16 2022] GET /identity/v3/role_assignments?user.id=433e75aa58bb492f83b621c30081fd22&scope.project.id=26f3d9baa4614c7ab91952d7e5132734&role.id=d8b538ae7b664438823dd39746467d37 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:16.277845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6d83d-35f5-4eb7-a8dc-fa198bb509ef None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:16.294670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 68/132] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:06:16 2022] PUT /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734/users/0a22ab389c9c45629af99658c60df95d/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:06:16.305361 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4da30-24ec-4bfb-97f6-2ecb4d33f049 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:16.517342 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6d83d-35f5-4eb7-a8dc-fa198bb509ef None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:16.568905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4da30-24ec-4bfb-97f6-2ecb4d33f049 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:16.570072 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f596edd-4396-4584-9380-c2eb02920ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:16.571834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f596edd-4396-4584-9380-c2eb02920ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:16.572351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f596edd-4396-4584-9380-c2eb02920ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:16.572883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f596edd-4396-4584-9380-c2eb02920ab7 None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:16.574319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f596edd-4396-4584-9380-c2eb02920ab7 None admin] RBAC: Authorizing `identity:get_project(project_id=26f3d9baa4614c7ab91952d7e5132734)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:16.577061 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f596edd-4396-4584-9380-c2eb02920ab7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:16.579392 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 65/133] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:16 2022] GET /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:16.582524 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:16.584963 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f596edd-4396-4584-9380-c2eb02920ab7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:16.651639 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7345a-9538-4a4d-8763-86b88c6515d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:16.652299 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7345a-9538-4a4d-8763-86b88c6515d3 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:16.652593 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7345a-9538-4a4d-8763-86b88c6515d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:16.652880 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7345a-9538-4a4d-8763-86b88c6515d3 None admin] PATH_INFO: `/v3/users/90a852f3923340a1a1dbce5574e80268` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:16.656188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7345a-9538-4a4d-8763-86b88c6515d3 None admin] RBAC: Authorizing `identity:get_user(user_id=90a852f3923340a1a1dbce5574e80268)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:16.656188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7345a-9538-4a4d-8763-86b88c6515d3 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:16.657142 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 69/134] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:16 2022] GET /identity/v3/users/90a852f3923340a1a1dbce5574e80268 => generated 275 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:16.663789 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7345a-9538-4a4d-8763-86b88c6515d3 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:16.689506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:16.752714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f596edd-4396-4584-9380-c2eb02920ab7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:16.800956 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe66a6-ea0b-4a2f-8020-fc9c4c360700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:16.801990 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe66a6-ea0b-4a2f-8020-fc9c4c360700 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:16.802745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe66a6-ea0b-4a2f-8020-fc9c4c360700 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:16.803739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe66a6-ea0b-4a2f-8020-fc9c4c360700 None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734/users/90a852f3923340a1a1dbce5574e80268/roles/9e2965c7d68d423a965894a8eb16903f` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:16.807729 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe66a6-ea0b-4a2f-8020-fc9c4c360700 None admin] RBAC: Authorizing `identity:create_grant(project_id=26f3d9baa4614c7ab91952d7e5132734, user_id=90a852f3923340a1a1dbce5574e80268, role_id=9e2965c7d68d423a965894a8eb16903f)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:16.809454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe66a6-ea0b-4a2f-8020-fc9c4c360700 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:16.826005 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7345a-9538-4a4d-8763-86b88c6515d3 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:16.829491 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 66/135] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:06:16 2022] PUT /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734/users/90a852f3923340a1a1dbce5574e80268/roles/9e2965c7d68d423a965894a8eb16903f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:06:16.831118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765083f-9da5-4770-ac16-733f1c4dcb2f None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:16.831623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765083f-9da5-4770-ac16-733f1c4dcb2f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:16.832096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765083f-9da5-4770-ac16-733f1c4dcb2f None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:16.834575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 67/136] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:16.839654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450480b-31c9-4391-a409-2b4f94184a23 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:16.840949 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450480b-31c9-4391-a409-2b4f94184a23 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:16.841430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450480b-31c9-4391-a409-2b4f94184a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:16.864291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-9450480b-31c9-4391-a409-2b4f94184a23 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:16.865874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9450480b-31c9-4391-a409-2b4f94184a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:16.897382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d778684-a1e8-4f19-9cc1-efa479386a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:16.898056 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d778684-a1e8-4f19-9cc1-efa479386a58 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:16.898348 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d778684-a1e8-4f19-9cc1-efa479386a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:16.898679 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d778684-a1e8-4f19-9cc1-efa479386a58 None admin] PATH_INFO: `/v3/projects/76576f318a6d497ebf3709211b1432ba` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:16.901125 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d778684-a1e8-4f19-9cc1-efa479386a58 None admin] RBAC: Authorizing `identity:get_project(project_id=76576f318a6d497ebf3709211b1432ba)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:16.902707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d778684-a1e8-4f19-9cc1-efa479386a58 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:16.904810 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 70/137] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:16 2022] GET /identity/v3/projects/76576f318a6d497ebf3709211b1432ba => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:16.910469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d778684-a1e8-4f19-9cc1-efa479386a58 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:16.955063 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 68/138] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:17.006555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:17.080119 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d778684-a1e8-4f19-9cc1-efa479386a58 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:17.124338 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb7ee5-08d3-4da4-b4d8-b0b2e6a8e272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:17.125033 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb7ee5-08d3-4da4-b4d8-b0b2e6a8e272 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:17.125317 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb7ee5-08d3-4da4-b4d8-b0b2e6a8e272 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:17.125598 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb7ee5-08d3-4da4-b4d8-b0b2e6a8e272 None admin] PATH_INFO: `/v3/projects/76576f318a6d497ebf3709211b1432ba/users/90a852f3923340a1a1dbce5574e80268/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:17.127630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb7ee5-08d3-4da4-b4d8-b0b2e6a8e272 None admin] RBAC: Authorizing `identity:create_grant(project_id=76576f318a6d497ebf3709211b1432ba, user_id=90a852f3923340a1a1dbce5574e80268, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:17.129187 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb7ee5-08d3-4da4-b4d8-b0b2e6a8e272 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:17.154378 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 71/139] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:06:16 2022] PUT /identity/v3/projects/76576f318a6d497ebf3709211b1432ba/users/90a852f3923340a1a1dbce5574e80268/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:06:17.189683 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000be14d-557e-40d2-9718-22cfae33f9e0 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:17.190331 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000be14d-557e-40d2-9718-22cfae33f9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:17.190842 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000be14d-557e-40d2-9718-22cfae33f9e0 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:17.192437 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 69/140] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:17.198185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ee7f6-68e0-4650-a215-91bb971d9b0c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:17.198476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ee7f6-68e0-4650-a215-91bb971d9b0c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:17.198782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ee7f6-68e0-4650-a215-91bb971d9b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:17.225878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-741ee7f6-68e0-4650-a215-91bb971d9b0c None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:17.227685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-741ee7f6-68e0-4650-a215-91bb971d9b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:17.310355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 72/141] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:17.462085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000be14d-557e-40d2-9718-22cfae33f9e0 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:17.516498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:17.592751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000be14d-557e-40d2-9718-22cfae33f9e0 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:17.638229 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a086536-1774-4142-9c8b-452da238a7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:17.639260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a086536-1774-4142-9c8b-452da238a7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:17.639741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a086536-1774-4142-9c8b-452da238a7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:17.640216 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a086536-1774-4142-9c8b-452da238a7d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:17.641545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a086536-1774-4142-9c8b-452da238a7d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:17.643275 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a086536-1774-4142-9c8b-452da238a7d2 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:17.645067 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 70/142] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:06:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:17.652758 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ee7f6-68e0-4650-a215-91bb971d9b0c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:17.703448 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:17.716111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a086536-1774-4142-9c8b-452da238a7d2 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:17.854605 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a086536-1774-4142-9c8b-452da238a7d2 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:17.866468 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:17.872658 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ee7f6-68e0-4650-a215-91bb971d9b0c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:17.909992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5de58-d575-44a8-b355-8cd7ed5ed321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:17.910559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5de58-d575-44a8-b355-8cd7ed5ed321 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:17.910874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5de58-d575-44a8-b355-8cd7ed5ed321 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:17.911160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5de58-d575-44a8-b355-8cd7ed5ed321 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:17.939905 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5de58-d575-44a8-b355-8cd7ed5ed321 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:17.945350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-09c5de58-d575-44a8-b355-8cd7ed5ed321 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:17.945350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:17.945350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:17.945350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:17.945350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:17.945350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:17.945350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:17.945350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:17.945350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:17.945350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:17.945350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:17.945350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:17.945350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:17.945350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:17.945350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:17.945350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:17.946228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:17.946228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:17.946228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:17.946228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:17.946228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:17.946228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:17.946228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:17.946228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:17.946228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:17.946228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:17.946228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:17.946228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:17.946228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:17.946228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:17.946228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:17.946228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:17.946992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:17.946992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:17.946992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:17.946992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:17.946992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:17.946992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:17.946992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:17.946992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:17.946992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:17.946992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:17.946992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:17.946992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:06:17.946992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 71/143] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:17.953691 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5de58-d575-44a8-b355-8cd7ed5ed321 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:17.960180 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380a310-cc0b-4a5b-9a16-02e00c2a4e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:17.961497 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a310-cc0b-4a5b-9a16-02e00c2a4e13 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:17.961497 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a310-cc0b-4a5b-9a16-02e00c2a4e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:17.961497 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a310-cc0b-4a5b-9a16-02e00c2a4e13 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:17.962047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380a310-cc0b-4a5b-9a16-02e00c2a4e13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:17.963596 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380a310-cc0b-4a5b-9a16-02e00c2a4e13 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:17.999089 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 73/144] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 27 04:06:17 2022] POST /identity/v3/users => generated 283 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:06:18.142329 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5de58-d575-44a8-b355-8cd7ed5ed321 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:18.184190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbee1b-a4e7-4017-8b34-803177d0ce1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:18.184812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbee1b-a4e7-4017-8b34-803177d0ce1c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:18.185103 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbee1b-a4e7-4017-8b34-803177d0ce1c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:18.185386 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbee1b-a4e7-4017-8b34-803177d0ce1c None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:18.186070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbee1b-a4e7-4017-8b34-803177d0ce1c None admin] RBAC: Adding query filter params (name=member) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:18.186383 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbee1b-a4e7-4017-8b34-803177d0ce1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:18.187869 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbee1b-a4e7-4017-8b34-803177d0ce1c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:18.202538 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 72/145] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:18.208462 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380a310-cc0b-4a5b-9a16-02e00c2a4e13 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:18.347238 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:18.372779 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380a310-cc0b-4a5b-9a16-02e00c2a4e13 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:18.435860 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70002faa-8599-4de2-8232-a2285a8cbe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:18.436432 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70002faa-8599-4de2-8232-a2285a8cbe8f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:18.436725 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70002faa-8599-4de2-8232-a2285a8cbe8f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:18.437042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70002faa-8599-4de2-8232-a2285a8cbe8f None admin] PATH_INFO: `/v3/users/90a852f3923340a1a1dbce5574e80268` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:18.443424 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70002faa-8599-4de2-8232-a2285a8cbe8f None admin] RBAC: Authorizing `identity:get_user(user_id=90a852f3923340a1a1dbce5574e80268)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:18.444898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70002faa-8599-4de2-8232-a2285a8cbe8f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:18.446742 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 74/146] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:18 2022] GET /identity/v3/users/90a852f3923340a1a1dbce5574e80268 => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:18.452235 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbee1b-a4e7-4017-8b34-803177d0ce1c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:18.490624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:18.575285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbee1b-a4e7-4017-8b34-803177d0ce1c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:18.613479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5fea4-dc3f-4f3e-b019-5a2efe9259d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:18.614103 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5fea4-dc3f-4f3e-b019-5a2efe9259d6 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:18.614389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5fea4-dc3f-4f3e-b019-5a2efe9259d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:18.614669 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5fea4-dc3f-4f3e-b019-5a2efe9259d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:18.699313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5fea4-dc3f-4f3e-b019-5a2efe9259d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:18.700736 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5fea4-dc3f-4f3e-b019-5a2efe9259d6 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:18.744845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:18.820145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 73/147] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:18.826060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70002faa-8599-4de2-8232-a2285a8cbe8f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:18.963700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70002faa-8599-4de2-8232-a2285a8cbe8f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:19.011055 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2032e-87f0-4059-96e9-fc8a57c96111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:19.011934 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2032e-87f0-4059-96e9-fc8a57c96111 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:19.012372 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2032e-87f0-4059-96e9-fc8a57c96111 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:19.012793 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2032e-87f0-4059-96e9-fc8a57c96111 None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:19.014104 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2032e-87f0-4059-96e9-fc8a57c96111 None admin] RBAC: Authorizing `identity:get_project(project_id=26f3d9baa4614c7ab91952d7e5132734)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:19.015751 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2032e-87f0-4059-96e9-fc8a57c96111 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:19.017912 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 75/148] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:18 2022] GET /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:19.024620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5fea4-dc3f-4f3e-b019-5a2efe9259d6 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:19.160234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5fea4-dc3f-4f3e-b019-5a2efe9259d6 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:19.192328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:19.197196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b16a3f-ef24-474e-9c4c-354bb8c9ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:19.197841 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b16a3f-ef24-474e-9c4c-354bb8c9ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:19.198528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b16a3f-ef24-474e-9c4c-354bb8c9ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:19.198832 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b16a3f-ef24-474e-9c4c-354bb8c9ffe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:19.199582 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b16a3f-ef24-474e-9c4c-354bb8c9ffe5 None admin] RBAC: Adding query filter params (role.id=71cc6516aeff47eea3961db1a3d57f21, scope.project.id=26f3d9baa4614c7ab91952d7e5132734, user.id=90a852f3923340a1a1dbce5574e80268) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:19.200169 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b16a3f-ef24-474e-9c4c-354bb8c9ffe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:19.201974 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b16a3f-ef24-474e-9c4c-354bb8c9ffe5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:19.208283 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 74/149] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:06:19 2022] GET /identity/v3/role_assignments?user.id=90a852f3923340a1a1dbce5574e80268&scope.project.id=26f3d9baa4614c7ab91952d7e5132734&role.id=71cc6516aeff47eea3961db1a3d57f21 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:19.831035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1e5f0-d75d-4577-9f23-43e7147e6bbe None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:19.831761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1e5f0-d75d-4577-9f23-43e7147e6bbe None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:19.832251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1e5f0-d75d-4577-9f23-43e7147e6bbe None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:19.833831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 76/150] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:19.839593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e31f2-28ea-48ed-a0d3-1d2aaeed98bf None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:19.840738 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e31f2-28ea-48ed-a0d3-1d2aaeed98bf None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:19.841230 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e31f2-28ea-48ed-a0d3-1d2aaeed98bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:19.864099 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ee1e31f2-28ea-48ed-a0d3-1d2aaeed98bf None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:19.865636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ee1e31f2-28ea-48ed-a0d3-1d2aaeed98bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:19.940416 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 75/151] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:20.009805 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca1138-6677-4d2c-abe1-208c5800b5e1 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:20.010786 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca1138-6677-4d2c-abe1-208c5800b5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:20.011292 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca1138-6677-4d2c-abe1-208c5800b5e1 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:20.012917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 77/152] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:20.019009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a52ab5-950e-4521-83ea-d5e96baec348 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:20.019638 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a52ab5-950e-4521-83ea-d5e96baec348 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:20.020116 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a52ab5-950e-4521-83ea-d5e96baec348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:20.047431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-07a52ab5-950e-4521-83ea-d5e96baec348 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:20.048948 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-07a52ab5-950e-4521-83ea-d5e96baec348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:20.114635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45ff70-bbec-4100-8537-4de22ec6a56e None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:20.115334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45ff70-bbec-4100-8537-4de22ec6a56e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:20.115809 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45ff70-bbec-4100-8537-4de22ec6a56e None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:20.118075 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 78/153] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:20.123868 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817b2fd-5853-48bb-bb9c-580f0ea1cca3 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:20.124439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817b2fd-5853-48bb-bb9c-580f0ea1cca3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:20.124912 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817b2fd-5853-48bb-bb9c-580f0ea1cca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:20.155406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d817b2fd-5853-48bb-bb9c-580f0ea1cca3 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:20.159755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d817b2fd-5853-48bb-bb9c-580f0ea1cca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:20.163945 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 76/154] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:20.180781 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad18cfe-041e-4ed1-a6c9-a0e9e929b27f None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:20.181425 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad18cfe-041e-4ed1-a6c9-a0e9e929b27f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:20.181907 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad18cfe-041e-4ed1-a6c9-a0e9e929b27f None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:20.183559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 77/155] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:06:20.190042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc184b-ce04-4b51-abd9-580f7ac12117 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:20.190602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc184b-ce04-4b51-abd9-580f7ac12117 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:20.191102 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc184b-ce04-4b51-abd9-580f7ac12117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:20.214133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:20.231652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-30bc184b-ce04-4b51-abd9-580f7ac12117 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:20.234440 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-30bc184b-ce04-4b51-abd9-580f7ac12117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:20.319463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 79/156] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:06:20.320356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817b2fd-5853-48bb-bb9c-580f0ea1cca3 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:20.331483 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:20.358375 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 78/157] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:06:20.455814 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817b2fd-5853-48bb-bb9c-580f0ea1cca3 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:20.497214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65613f9a-4f54-4073-8f0e-c5aee90189ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:20.497846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65613f9a-4f54-4073-8f0e-c5aee90189ff None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:20.498127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65613f9a-4f54-4073-8f0e-c5aee90189ff None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:20.498399 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65613f9a-4f54-4073-8f0e-c5aee90189ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:20.509605 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65613f9a-4f54-4073-8f0e-c5aee90189ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:20.515086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-65613f9a-4f54-4073-8f0e-c5aee90189ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:06:20.515086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:20.515086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:20.515086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:20.515086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:20.515086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:20.515086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:20.515086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:20.515086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:20.515086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:20.515086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:20.515086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:20.515086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:20.515086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:20.515086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:20.515086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:20.515975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:20.515975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:20.515975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:20.515975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:20.515975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:20.515975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:20.515975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:20.515975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:20.515975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:20.515975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:20.515975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:20.515975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:20.515975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:20.515975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:20.515975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:20.515975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:20.516778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:20.516778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:20.516778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:20.516778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:20.516778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:20.516778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:20.516778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:20.516778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:20.516778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:20.516778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:20.516778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:06:20.516778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:20.516778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 80/158] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:20.522161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc184b-ce04-4b51-abd9-580f7ac12117 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:20.630363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc184b-ce04-4b51-abd9-580f7ac12117 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:20.665419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32029cf1-7610-4b57-8403-d93b5961d2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:20.666030 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32029cf1-7610-4b57-8403-d93b5961d2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:20.666304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32029cf1-7610-4b57-8403-d93b5961d2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:20.666573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32029cf1-7610-4b57-8403-d93b5961d2e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:20.667288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32029cf1-7610-4b57-8403-d93b5961d2e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:20.667592 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32029cf1-7610-4b57-8403-d93b5961d2e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:20.668966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32029cf1-7610-4b57-8403-d93b5961d2e3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:20.677647 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 79/159] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:20.683754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65613f9a-4f54-4073-8f0e-c5aee90189ff None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:20.701445 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:20.714467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32029cf1-7610-4b57-8403-d93b5961d2e3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:20.771227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:20.816990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65613f9a-4f54-4073-8f0e-c5aee90189ff None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:20.825472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32029cf1-7610-4b57-8403-d93b5961d2e3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:20.860326 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f35689-0186-48ca-a041-6e3783673728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:20.861887 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f35689-0186-48ca-a041-6e3783673728 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:20.862378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f35689-0186-48ca-a041-6e3783673728 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:20.862893 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f35689-0186-48ca-a041-6e3783673728 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:20.874438 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f35689-0186-48ca-a041-6e3783673728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:20.881327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-a3f35689-0186-48ca-a041-6e3783673728 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:20.881327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:20.881327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:20.881327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:20.881327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:20.881327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:20.881327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:20.881327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:20.881327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:20.881327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:20.881327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:20.881327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:20.881327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:20.881327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:20.881327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:20.881327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:20.882252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:20.882252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:20.882252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:20.882252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:20.882252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:20.882252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:20.882252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:20.882252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:20.882252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:20.882252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:20.882252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:20.882252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:20.882252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:20.882252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:20.882252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:20.882252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:20.883125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:20.883125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:20.883125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:20.883125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:20.883125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:20.883125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:20.883125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:20.883125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:20.883125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:20.883125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:20.883125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:20.883125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:06:20.883718 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd1725-54a0-4008-870f-a787c900beb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:20.884264 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd1725-54a0-4008-870f-a787c900beb0 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:20.884370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd1725-54a0-4008-870f-a787c900beb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:20.884601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd1725-54a0-4008-870f-a787c900beb0 None admin] PATH_INFO: `/v3/users/433e75aa58bb492f83b621c30081fd22` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:20.885781 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd1725-54a0-4008-870f-a787c900beb0 None admin] RBAC: Authorizing `identity:get_user(user_id=433e75aa58bb492f83b621c30081fd22)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:20.886230 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 80/160] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:06:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:20.890740 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd1725-54a0-4008-870f-a787c900beb0 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:20.890740 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 81/161] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:20 2022] GET /identity/v3/users/433e75aa58bb492f83b621c30081fd22 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:20.891990 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f35689-0186-48ca-a041-6e3783673728 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:20.894340 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd1725-54a0-4008-870f-a787c900beb0 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:21.050135 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f35689-0186-48ca-a041-6e3783673728 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:21.062525 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:21.072737 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:21.088883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1fff2-054b-4460-b67e-625abb72654f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:21.089914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1fff2-054b-4460-b67e-625abb72654f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:21.090412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1fff2-054b-4460-b67e-625abb72654f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:21.090972 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1fff2-054b-4460-b67e-625abb72654f None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:21.091868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1fff2-054b-4460-b67e-625abb72654f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:21.092502 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1fff2-054b-4460-b67e-625abb72654f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:21.094165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1fff2-054b-4460-b67e-625abb72654f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:21.103961 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 81/162] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:21.105045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1fff2-054b-4460-b67e-625abb72654f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:21.120185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd1725-54a0-4008-870f-a787c900beb0 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:21.203862 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f401d-a504-4873-8625-a03ad37d1d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:21.204610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f401d-a504-4873-8625-a03ad37d1d5a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:21.204847 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f401d-a504-4873-8625-a03ad37d1d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:21.205131 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f401d-a504-4873-8625-a03ad37d1d5a None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:21.207407 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f401d-a504-4873-8625-a03ad37d1d5a None admin] RBAC: Authorizing `identity:get_project(project_id=26f3d9baa4614c7ab91952d7e5132734)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:21.208887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f401d-a504-4873-8625-a03ad37d1d5a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:21.211595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 82/163] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:20 2022] GET /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734 => generated 298 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:21.212406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f401d-a504-4873-8625-a03ad37d1d5a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:21.213633 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1fff2-054b-4460-b67e-625abb72654f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:21.253747 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70995904-005b-4c43-bfaa-9bf9c85d7874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:21.255046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70995904-005b-4c43-bfaa-9bf9c85d7874 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:21.255741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70995904-005b-4c43-bfaa-9bf9c85d7874 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:21.256230 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70995904-005b-4c43-bfaa-9bf9c85d7874 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:21.267748 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70995904-005b-4c43-bfaa-9bf9c85d7874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:21.274236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-70995904-005b-4c43-bfaa-9bf9c85d7874 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:21.274236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:21.274236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:21.274236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:21.274236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:21.274236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:21.274236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:21.274236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:21.274236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:21.274236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:21.274236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:21.274236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:21.274236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:21.274236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:21.274236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:21.274236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:21.275140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:21.275140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:21.275140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:21.275140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:21.275140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:21.275140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:21.275140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:21.275140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:21.275140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:21.275140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:21.275140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:21.275140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:21.275140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:21.275140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:21.275140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:21.275140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:21.275912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:21.275912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:21.275912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:21.275912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:21.275912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:21.275912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:21.275912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:21.275912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:21.275912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:21.275912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:21.275912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:21.275912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:06:21.278167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 82/164] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:06:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:21.279812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70995904-005b-4c43-bfaa-9bf9c85d7874 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:21.359233 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:21.386532 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70995904-005b-4c43-bfaa-9bf9c85d7874 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:21.428525 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5556c9-416a-498d-8a9d-86661d349663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:21.429298 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5556c9-416a-498d-8a9d-86661d349663 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:21.429718 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5556c9-416a-498d-8a9d-86661d349663 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:21.430169 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5556c9-416a-498d-8a9d-86661d349663 None admin] PATH_INFO: `/v3/users/0a22ab389c9c45629af99658c60df95d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:21.431439 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5556c9-416a-498d-8a9d-86661d349663 None admin] RBAC: Authorizing `identity:get_user(user_id=0a22ab389c9c45629af99658c60df95d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:21.433500 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5556c9-416a-498d-8a9d-86661d349663 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:21.435434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 83/165] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:21 2022] GET /identity/v3/users/0a22ab389c9c45629af99658c60df95d => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:21.436633 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5556c9-416a-498d-8a9d-86661d349663 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:21.499516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f401d-a504-4873-8625-a03ad37d1d5a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:21.543884 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5556c9-416a-498d-8a9d-86661d349663 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:21.547046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:21.581233 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f13438-07d7-4253-bcad-c2b4466aa694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:21.582018 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f13438-07d7-4253-bcad-c2b4466aa694 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:21.582374 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f13438-07d7-4253-bcad-c2b4466aa694 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:21.582750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f13438-07d7-4253-bcad-c2b4466aa694 None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734/users/433e75aa58bb492f83b621c30081fd22/roles/d8b538ae7b664438823dd39746467d37` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:21.584994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f13438-07d7-4253-bcad-c2b4466aa694 None admin] RBAC: Authorizing `identity:create_grant(project_id=26f3d9baa4614c7ab91952d7e5132734, user_id=433e75aa58bb492f83b621c30081fd22, role_id=d8b538ae7b664438823dd39746467d37)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:21.587265 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f13438-07d7-4253-bcad-c2b4466aa694 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:21.601144 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 84/166] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:06:21 2022] PUT /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734/users/433e75aa58bb492f83b621c30081fd22/roles/d8b538ae7b664438823dd39746467d37 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:06:21.603955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f13438-07d7-4253-bcad-c2b4466aa694 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:21.615560 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d8744-4923-41cb-962a-32f41f54d4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:21.616135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8744-4923-41cb-962a-32f41f54d4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:21.616418 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8744-4923-41cb-962a-32f41f54d4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:21.616692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8744-4923-41cb-962a-32f41f54d4d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:21.649337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d8744-4923-41cb-962a-32f41f54d4d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:21.663164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-401d8744-4923-41cb-962a-32f41f54d4d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:21.663164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:21.663164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:21.663164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:21.663164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:21.663164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:21.663164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:21.663164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:21.663164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:21.663164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:21.663164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:21.663164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:21.663164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:21.663164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:21.663164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:21.663164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:21.664139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:21.664139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:21.664139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:21.664139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:21.664139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:21.664139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:21.664139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:21.664139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:21.664139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:21.664139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:21.664139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:21.664139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:21.664139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:21.664139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:21.664139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:21.664139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:21.665427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:21.665427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:21.665427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:21.665427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:21.665427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:21.665427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:21.665427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:21.665427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:21.665427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:21.665427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:21.665427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:21.665427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:21.665427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 83/167] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:21.666083 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d8744-4923-41cb-962a-32f41f54d4d8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:21.696926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:21.824211 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d8744-4923-41cb-962a-32f41f54d4d8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:21.825612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f13438-07d7-4253-bcad-c2b4466aa694 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:21.870946 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c8220-8c69-4456-87cd-8eb35bbb1ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:21.871489 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c8220-8c69-4456-87cd-8eb35bbb1ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:21.871774 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c8220-8c69-4456-87cd-8eb35bbb1ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:21.872047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c8220-8c69-4456-87cd-8eb35bbb1ac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:21.899424 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744a806-6660-4eb8-94f3-e49c06fd0603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:21.900109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744a806-6660-4eb8-94f3-e49c06fd0603 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:21.900308 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744a806-6660-4eb8-94f3-e49c06fd0603 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:21.900581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744a806-6660-4eb8-94f3-e49c06fd0603 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:21.901256 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744a806-6660-4eb8-94f3-e49c06fd0603 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:21.901561 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744a806-6660-4eb8-94f3-e49c06fd0603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:21.904486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744a806-6660-4eb8-94f3-e49c06fd0603 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:21.923841 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 85/168] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:06:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:21.924483 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744a806-6660-4eb8-94f3-e49c06fd0603 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:21.953970 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:21.999614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c8220-8c69-4456-87cd-8eb35bbb1ac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:22.001543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c8220-8c69-4456-87cd-8eb35bbb1ac1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:22.025928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:22.105102 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744a806-6660-4eb8-94f3-e49c06fd0603 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:22.171418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccc2c6-01ec-4a05-b048-78f1bfedcd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:22.172459 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccc2c6-01ec-4a05-b048-78f1bfedcd7e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:22.172752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccc2c6-01ec-4a05-b048-78f1bfedcd7e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:22.173027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccc2c6-01ec-4a05-b048-78f1bfedcd7e None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:22.173849 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccc2c6-01ec-4a05-b048-78f1bfedcd7e None admin] RBAC: Adding query filter params (name=member) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:22.174177 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccc2c6-01ec-4a05-b048-78f1bfedcd7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:22.177057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccc2c6-01ec-4a05-b048-78f1bfedcd7e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:22.188123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 86/169] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:22.188786 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccc2c6-01ec-4a05-b048-78f1bfedcd7e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:22.221691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 84/170] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:22.223350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c8220-8c69-4456-87cd-8eb35bbb1ac1 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:22.344911 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:22.382651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccc2c6-01ec-4a05-b048-78f1bfedcd7e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:22.420897 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5186ab-b2e9-4531-9585-578fb6d51003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:22.421602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5186ab-b2e9-4531-9585-578fb6d51003 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:22.421831 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5186ab-b2e9-4531-9585-578fb6d51003 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:22.422113 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5186ab-b2e9-4531-9585-578fb6d51003 None admin] PATH_INFO: `/v3/users/90a852f3923340a1a1dbce5574e80268` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:22.422419 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c8220-8c69-4456-87cd-8eb35bbb1ac1 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:22.427752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5186ab-b2e9-4531-9585-578fb6d51003 None admin] RBAC: Authorizing `identity:get_user(user_id=90a852f3923340a1a1dbce5574e80268)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:22.429244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5186ab-b2e9-4531-9585-578fb6d51003 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:22.431061 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 87/171] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:22 2022] GET /identity/v3/users/90a852f3923340a1a1dbce5574e80268 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:22.431946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5186ab-b2e9-4531-9585-578fb6d51003 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:22.448037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:22.508486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0774f40-28ac-468f-9345-d5ccae1f8a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:22.509134 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0774f40-28ac-468f-9345-d5ccae1f8a7a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:22.509412 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0774f40-28ac-468f-9345-d5ccae1f8a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:22.509680 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0774f40-28ac-468f-9345-d5ccae1f8a7a None admin] PATH_INFO: `/v3/users/90a852f3923340a1a1dbce5574e80268` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:22.515405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0774f40-28ac-468f-9345-d5ccae1f8a7a None admin] RBAC: Authorizing `identity:get_user(user_id=90a852f3923340a1a1dbce5574e80268)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:22.516883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0774f40-28ac-468f-9345-d5ccae1f8a7a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:22.518468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 85/172] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:22 2022] GET /identity/v3/users/90a852f3923340a1a1dbce5574e80268 => generated 275 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:22.519275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0774f40-28ac-468f-9345-d5ccae1f8a7a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:22.641090 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5186ab-b2e9-4531-9585-578fb6d51003 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:22.687185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0774f40-28ac-468f-9345-d5ccae1f8a7a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:22.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334eb20-697a-45b0-904a-bb3a73a5c22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:22.705061 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334eb20-697a-45b0-904a-bb3a73a5c22b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:22.705555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334eb20-697a-45b0-904a-bb3a73a5c22b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:22.706144 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334eb20-697a-45b0-904a-bb3a73a5c22b None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:22.712092 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334eb20-697a-45b0-904a-bb3a73a5c22b None admin] RBAC: Authorizing `identity:get_project(project_id=26f3d9baa4614c7ab91952d7e5132734)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:22.713801 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334eb20-697a-45b0-904a-bb3a73a5c22b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:22.715684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 88/173] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:22 2022] GET /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:22.716751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334eb20-697a-45b0-904a-bb3a73a5c22b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:22.725571 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fdc02-f23a-4b4b-9742-a93bfa2ac85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:22.726416 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fdc02-f23a-4b4b-9742-a93bfa2ac85a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:22.728281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fdc02-f23a-4b4b-9742-a93bfa2ac85a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:22.728714 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fdc02-f23a-4b4b-9742-a93bfa2ac85a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:22.757818 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:22.805454 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:22.832141 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fdc02-f23a-4b4b-9742-a93bfa2ac85a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:22.834108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fdc02-f23a-4b4b-9742-a93bfa2ac85a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:22.957752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 86/174] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:22.959360 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334eb20-697a-45b0-904a-bb3a73a5c22b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:22.965203 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef8fc8-8e3b-4784-b6fd-1f6723758a17 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:22.965529 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef8fc8-8e3b-4784-b6fd-1f6723758a17 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:22.965756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef8fc8-8e3b-4784-b6fd-1f6723758a17 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:22.967182 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 87/175] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:22.968297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef8fc8-8e3b-4784-b6fd-1f6723758a17 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:23.003248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf4b73-6e9b-4b7f-8f37-579b92472bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:23.003872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf4b73-6e9b-4b7f-8f37-579b92472bfd None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:23.004158 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf4b73-6e9b-4b7f-8f37-579b92472bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:23.004437 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf4b73-6e9b-4b7f-8f37-579b92472bfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:23.065283 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:23.074473 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf4b73-6e9b-4b7f-8f37-579b92472bfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:23.076437 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf4b73-6e9b-4b7f-8f37-579b92472bfd None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:23.090333 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef8fc8-8e3b-4784-b6fd-1f6723758a17 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:23.096029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:23.125560 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1b472-266a-4bec-983f-6c907a7f8075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:23.126490 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1b472-266a-4bec-983f-6c907a7f8075 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:23.126862 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1b472-266a-4bec-983f-6c907a7f8075 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:23.127145 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1b472-266a-4bec-983f-6c907a7f8075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:23.127878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1b472-266a-4bec-983f-6c907a7f8075 None admin] RBAC: Adding query filter params (role.id=2613cf4a98d44744a094c7782b19b4b5, scope.project.id=26f3d9baa4614c7ab91952d7e5132734, user.id=0a22ab389c9c45629af99658c60df95d) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:23.128192 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1b472-266a-4bec-983f-6c907a7f8075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:23.129625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1b472-266a-4bec-983f-6c907a7f8075 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:23.135460 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 88/176] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:06:22 2022] GET /identity/v3/role_assignments?user.id=0a22ab389c9c45629af99658c60df95d&scope.project.id=26f3d9baa4614c7ab91952d7e5132734&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:23.136443 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b31c0-7229-43e1-a3d5-55807136b6ff None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:23.136729 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b31c0-7229-43e1-a3d5-55807136b6ff None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:23.137005 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b31c0-7229-43e1-a3d5-55807136b6ff None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:23.142756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 89/177] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:23.142756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b31c0-7229-43e1-a3d5-55807136b6ff None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:23.217342 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 89/178] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:23.219215 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648770d-6cd1-4cc1-92b3-93c1c505fb04 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:23.219743 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648770d-6cd1-4cc1-92b3-93c1c505fb04 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:23.220782 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648770d-6cd1-4cc1-92b3-93c1c505fb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:23.247296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d648770d-6cd1-4cc1-92b3-93c1c505fb04 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:23.248730 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d648770d-6cd1-4cc1-92b3-93c1c505fb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:23.267250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b31c0-7229-43e1-a3d5-55807136b6ff None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:23.315706 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9409b65-e08e-4ebc-9730-f7c1d7038ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:23.317112 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9409b65-e08e-4ebc-9730-f7c1d7038ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:23.317681 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9409b65-e08e-4ebc-9730-f7c1d7038ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:23.318154 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9409b65-e08e-4ebc-9730-f7c1d7038ef8 None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:23.319877 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9409b65-e08e-4ebc-9730-f7c1d7038ef8 None admin] RBAC: Authorizing `identity:get_project(project_id=26f3d9baa4614c7ab91952d7e5132734)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:23.321614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9409b65-e08e-4ebc-9730-f7c1d7038ef8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:23.323768 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 90/179] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:23 2022] GET /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:23.325280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093b86a-2a28-4479-8ef4-ba9bdd53aa5d None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:23.325827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093b86a-2a28-4479-8ef4-ba9bdd53aa5d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:23.326112 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093b86a-2a28-4479-8ef4-ba9bdd53aa5d None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:23.327593 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 91/180] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:23.328617 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65f70c-bc28-4598-a52c-d78693b96431 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:23.328893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65f70c-bc28-4598-a52c-d78693b96431 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:23.329167 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65f70c-bc28-4598-a52c-d78693b96431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:23.329523 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 90/181] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:23.330246 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648770d-6cd1-4cc1-92b3-93c1c505fb04 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:23.354835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-cf65f70c-bc28-4598-a52c-d78693b96431 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:23.356037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cf65f70c-bc28-4598-a52c-d78693b96431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:23.359774 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:23.418927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:23.440426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 92/182] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:23.441439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65f70c-bc28-4598-a52c-d78693b96431 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:23.499045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648770d-6cd1-4cc1-92b3-93c1c505fb04 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:23.559436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e51b0-a4b1-4291-8b08-2db7a3b3a536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:23.560083 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e51b0-a4b1-4291-8b08-2db7a3b3a536 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:23.560363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e51b0-a4b1-4291-8b08-2db7a3b3a536 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:23.560635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e51b0-a4b1-4291-8b08-2db7a3b3a536 None admin] PATH_INFO: `/v3/projects/76576f318a6d497ebf3709211b1432ba` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:23.561812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e51b0-a4b1-4291-8b08-2db7a3b3a536 None admin] RBAC: Authorizing `identity:get_project(project_id=76576f318a6d497ebf3709211b1432ba)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:23.563283 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e51b0-a4b1-4291-8b08-2db7a3b3a536 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:23.564920 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 91/183] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:23 2022] GET /identity/v3/projects/76576f318a6d497ebf3709211b1432ba => generated 312 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:23.565195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65f70c-bc28-4598-a52c-d78693b96431 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:23.566008 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf453710-6809-48de-9559-c13bf23b74dc None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:23.566286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf453710-6809-48de-9559-c13bf23b74dc None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:23.566557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf453710-6809-48de-9559-c13bf23b74dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:23.604211 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-cf453710-6809-48de-9559-c13bf23b74dc None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:23.605385 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-cf453710-6809-48de-9559-c13bf23b74dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:23.606097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174c985-50ba-4519-af4a-b4731992a246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:23.606799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c985-50ba-4519-af4a-b4731992a246 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:23.607095 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c985-50ba-4519-af4a-b4731992a246 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:23.607514 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c985-50ba-4519-af4a-b4731992a246 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:23.608448 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174c985-50ba-4519-af4a-b4731992a246 None admin] RBAC: Adding query filter params (role.id=9e2965c7d68d423a965894a8eb16903f, scope.project.id=26f3d9baa4614c7ab91952d7e5132734, user.id=90a852f3923340a1a1dbce5574e80268) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:23.608770 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174c985-50ba-4519-af4a-b4731992a246 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:23.610292 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174c985-50ba-4519-af4a-b4731992a246 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:23.616859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 93/184] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:06:23 2022] GET /identity/v3/role_assignments?user.id=90a852f3923340a1a1dbce5574e80268&scope.project.id=26f3d9baa4614c7ab91952d7e5132734&role.id=9e2965c7d68d423a965894a8eb16903f => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:23.618310 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174c985-50ba-4519-af4a-b4731992a246 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:23.635190 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:23.740821 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 92/185] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:23.792332 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174c985-50ba-4519-af4a-b4731992a246 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:23.826957 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf453710-6809-48de-9559-c13bf23b74dc None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:23.880060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ca87e-3ebe-4ecc-83a8-0a0b71c10fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:23.880694 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ca87e-3ebe-4ecc-83a8-0a0b71c10fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:23.881138 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ca87e-3ebe-4ecc-83a8-0a0b71c10fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:23.881420 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ca87e-3ebe-4ecc-83a8-0a0b71c10fd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:23.882170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ca87e-3ebe-4ecc-83a8-0a0b71c10fd3 None admin] RBAC: Adding query filter params (role.id=71cc6516aeff47eea3961db1a3d57f21, scope.project.id=76576f318a6d497ebf3709211b1432ba, user.id=90a852f3923340a1a1dbce5574e80268) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:23.882874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ca87e-3ebe-4ecc-83a8-0a0b71c10fd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:23.884595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ca87e-3ebe-4ecc-83a8-0a0b71c10fd3 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:23.892994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 94/186] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:06:23 2022] GET /identity/v3/role_assignments?user.id=90a852f3923340a1a1dbce5574e80268&scope.project.id=76576f318a6d497ebf3709211b1432ba&role.id=71cc6516aeff47eea3961db1a3d57f21 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:23.893833 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ca87e-3ebe-4ecc-83a8-0a0b71c10fd3 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:23.906706 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:23.985876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf453710-6809-48de-9559-c13bf23b74dc None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:23.987402 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:24.027414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8936744-3e1a-40f0-a592-b1e8ed79c461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:24.027933 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ca87e-3ebe-4ecc-83a8-0a0b71c10fd3 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:24.028121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8936744-3e1a-40f0-a592-b1e8ed79c461 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:24.028338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8936744-3e1a-40f0-a592-b1e8ed79c461 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:24.028611 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8936744-3e1a-40f0-a592-b1e8ed79c461 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:24.029755 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8936744-3e1a-40f0-a592-b1e8ed79c461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:24.031244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8936744-3e1a-40f0-a592-b1e8ed79c461 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:24.033111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 93/187] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:06:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:24.040321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8936744-3e1a-40f0-a592-b1e8ed79c461 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:24.068767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa0fca-8d6e-4c34-856e-116d00952494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:24.069386 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa0fca-8d6e-4c34-856e-116d00952494 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:24.069671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa0fca-8d6e-4c34-856e-116d00952494 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:24.070026 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa0fca-8d6e-4c34-856e-116d00952494 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:24.083928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa0fca-8d6e-4c34-856e-116d00952494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:24.090100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-93aa0fca-8d6e-4c34-856e-116d00952494 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:24.090100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:24.090100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:24.090100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:24.090100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:24.090100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:24.090100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:24.090100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:24.090100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:24.090100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:24.090100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:24.090100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:24.090100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:24.090100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:24.090100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:24.090100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:24.091130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:24.091130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:24.091130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:24.091130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:24.091130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:24.091130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:24.091130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:24.091130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:24.091130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:24.091130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:24.091130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:24.091130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:24.091130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:24.091130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:24.091130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:24.091130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:24.093257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:24.093257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:24.093257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:24.093257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:24.093257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:24.093257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:24.093257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:24.093257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:24.093257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:24.093257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:24.093257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:24.093257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:24.093257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 95/188] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:06:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:24.097789 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa0fca-8d6e-4c34-856e-116d00952494 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:24.222925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8936744-3e1a-40f0-a592-b1e8ed79c461 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:24.232001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa0fca-8d6e-4c34-856e-116d00952494 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:24.240307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:24.264234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de917a3f-5e6b-4f1c-8490-b852a1aef83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:24.265036 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de917a3f-5e6b-4f1c-8490-b852a1aef83b None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:24.265321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de917a3f-5e6b-4f1c-8490-b852a1aef83b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:24.265594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de917a3f-5e6b-4f1c-8490-b852a1aef83b None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:24.267231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de917a3f-5e6b-4f1c-8490-b852a1aef83b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:24.268276 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de917a3f-5e6b-4f1c-8490-b852a1aef83b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:24.278541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:24.283014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0252564-4857-41d5-bef4-8ce93edcf3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:24.284440 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0252564-4857-41d5-bef4-8ce93edcf3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:24.285245 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0252564-4857-41d5-bef4-8ce93edcf3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:24.285521 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0252564-4857-41d5-bef4-8ce93edcf3a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:24.286296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0252564-4857-41d5-bef4-8ce93edcf3a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:24.287718 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0252564-4857-41d5-bef4-8ce93edcf3a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:24.290014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0252564-4857-41d5-bef4-8ce93edcf3a9 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:24.296195 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 94/189] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 27 04:06:24 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:06:24.305288 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 96/190] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:24.305399 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de917a3f-5e6b-4f1c-8490-b852a1aef83b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:24.306472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0252564-4857-41d5-bef4-8ce93edcf3a9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:24.429442 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0252564-4857-41d5-bef4-8ce93edcf3a9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:24.440245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de917a3f-5e6b-4f1c-8490-b852a1aef83b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:24.467700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3db6a-ac92-4563-812e-cfa565d4858c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:24.468350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3db6a-ac92-4563-812e-cfa565d4858c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:24.468638 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3db6a-ac92-4563-812e-cfa565d4858c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:24.468916 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3db6a-ac92-4563-812e-cfa565d4858c None admin] PATH_INFO: `/v3/users/d8b411d85dc4412297868efd3416ba96` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:24.485729 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec2700-5252-4daf-9374-e002e632f011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:24.485979 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3db6a-ac92-4563-812e-cfa565d4858c None admin] RBAC: Authorizing `identity:get_user(user_id=d8b411d85dc4412297868efd3416ba96)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:24.486749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec2700-5252-4daf-9374-e002e632f011 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:24.486749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec2700-5252-4daf-9374-e002e632f011 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:24.486963 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec2700-5252-4daf-9374-e002e632f011 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:24.487861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3db6a-ac92-4563-812e-cfa565d4858c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:24.489554 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 97/191] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:24 2022] GET /identity/v3/users/d8b411d85dc4412297868efd3416ba96 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:24.490773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b8766-49c2-454e-bc53-023e0b84f077 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:24.491062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b8766-49c2-454e-bc53-023e0b84f077 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:24.491341 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b8766-49c2-454e-bc53-023e0b84f077 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:24.493329 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 98/192] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:24.495463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b8766-49c2-454e-bc53-023e0b84f077 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:24.500582 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec2700-5252-4daf-9374-e002e632f011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:24.506573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-89ec2700-5252-4daf-9374-e002e632f011 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:24.506573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:24.506573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:24.506573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:24.506573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:24.506573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:24.506573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:24.506573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:24.506573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:24.506573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:24.506573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:24.506573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:24.506573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:24.506573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:24.506573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:24.506573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:24.507760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:24.507760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:24.507760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:24.507760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:24.507760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:24.507760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:24.507760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:24.507760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:24.507760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:24.507760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:24.507760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:24.507760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:24.507760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:24.507760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:24.507760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:24.507760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:24.509557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:24.509557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:24.509557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:24.509557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:24.509557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:24.509557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:24.509557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:24.509557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:24.509557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:24.509557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:24.509557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:24.509557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:06:24.509557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 95/193] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:06:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:24.509557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f20dc-f719-461e-91cb-6c3dc385363b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:24.510445 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f20dc-f719-461e-91cb-6c3dc385363b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:24.510445 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f20dc-f719-461e-91cb-6c3dc385363b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:24.529048 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1c6f20dc-f719-461e-91cb-6c3dc385363b None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:24.530227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1c6f20dc-f719-461e-91cb-6c3dc385363b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:24.555713 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:24.559527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:24.620245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 96/194] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:24.620974 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f20dc-f719-461e-91cb-6c3dc385363b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:24.630187 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b8766-49c2-454e-bc53-023e0b84f077 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:24.671725 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555a4ec-8db5-49f1-a383-91ef9d10bfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:24.672344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555a4ec-8db5-49f1-a383-91ef9d10bfaa None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:24.672998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555a4ec-8db5-49f1-a383-91ef9d10bfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:24.673280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555a4ec-8db5-49f1-a383-91ef9d10bfaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:24.752704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f20dc-f719-461e-91cb-6c3dc385363b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:24.760347 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555a4ec-8db5-49f1-a383-91ef9d10bfaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:24.761839 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555a4ec-8db5-49f1-a383-91ef9d10bfaa None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:24.796413 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bc715-47a0-4446-98cf-77e26f60f2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:24.797083 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bc715-47a0-4446-98cf-77e26f60f2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:24.797364 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bc715-47a0-4446-98cf-77e26f60f2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:24.797637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bc715-47a0-4446-98cf-77e26f60f2a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:24.798485 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bc715-47a0-4446-98cf-77e26f60f2a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:24.798980 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bc715-47a0-4446-98cf-77e26f60f2a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:24.801237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bc715-47a0-4446-98cf-77e26f60f2a2 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:24.817307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 97/195] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:06:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:24.823647 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bc715-47a0-4446-98cf-77e26f60f2a2 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:24.829265 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:24.868406 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:24.888231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 99/196] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:24.894594 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555a4ec-8db5-49f1-a383-91ef9d10bfaa None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:24.989636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bc715-47a0-4446-98cf-77e26f60f2a2 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:25.025440 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555a4ec-8db5-49f1-a383-91ef9d10bfaa None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:25.031059 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df8e77-63d5-409f-be26-8e238869a5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:25.031938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df8e77-63d5-409f-be26-8e238869a5af None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:25.032336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df8e77-63d5-409f-be26-8e238869a5af None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:25.032704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df8e77-63d5-409f-be26-8e238869a5af None admin] PATH_INFO: `/v3/users/d8b411d85dc4412297868efd3416ba96` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:25.034349 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df8e77-63d5-409f-be26-8e238869a5af None admin] RBAC: Authorizing `identity:get_user(user_id=d8b411d85dc4412297868efd3416ba96)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:25.036295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df8e77-63d5-409f-be26-8e238869a5af None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:25.038885 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 98/197] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:24 2022] GET /identity/v3/users/d8b411d85dc4412297868efd3416ba96 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:25.039820 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df8e77-63d5-409f-be26-8e238869a5af None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:25.072204 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9772f-296b-46d4-922d-abf52db0c1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:25.073107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9772f-296b-46d4-922d-abf52db0c1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:25.073403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9772f-296b-46d4-922d-abf52db0c1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:25.073687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9772f-296b-46d4-922d-abf52db0c1a3 None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:25.075014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9772f-296b-46d4-922d-abf52db0c1a3 None admin] RBAC: Authorizing `identity:get_project(project_id=a4a05ac2e47b41afb49b5304780a242e)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:25.077088 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9772f-296b-46d4-922d-abf52db0c1a3 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:25.079672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 100/198] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:24 2022] GET /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:25.080577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9772f-296b-46d4-922d-abf52db0c1a3 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:25.107127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:25.150417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:25.162418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df8e77-63d5-409f-be26-8e238869a5af None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:25.200705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf347c86-5760-4b88-b378-7bb4510c0c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:25.201071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9772f-296b-46d4-922d-abf52db0c1a3 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:25.201338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf347c86-5760-4b88-b378-7bb4510c0c90 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:25.201616 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf347c86-5760-4b88-b378-7bb4510c0c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:25.201889 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf347c86-5760-4b88-b378-7bb4510c0c90 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:25.213029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf347c86-5760-4b88-b378-7bb4510c0c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:25.219320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-cf347c86-5760-4b88-b378-7bb4510c0c90 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:06:25.219320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:25.219320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:25.219320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:25.219320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:25.219320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:25.219320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:25.219320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:25.219320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:25.219320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:25.219320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:25.219320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:25.219320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:25.219320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:25.219320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:25.219320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:25.220226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:25.220226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:25.220226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:25.220226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:25.220226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:25.220226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:25.220226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:25.220226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:25.220226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:25.220226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:25.220226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:25.220226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:25.220226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:25.220226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:25.220226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:25.220226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:25.221040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:25.221040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:25.221040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:25.221040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:25.221040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:25.221040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:25.221040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:25.221040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:25.221040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:25.221040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:25.221040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:06:25.221040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:06:25.221040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 99/199] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:25.221699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf347c86-5760-4b88-b378-7bb4510c0c90 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:25.241148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661adcc-bb4b-49c7-98ee-83dc94ca0a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:25.241676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661adcc-bb4b-49c7-98ee-83dc94ca0a91 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:25.241961 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661adcc-bb4b-49c7-98ee-83dc94ca0a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:25.242776 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661adcc-bb4b-49c7-98ee-83dc94ca0a91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:25.313296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661adcc-bb4b-49c7-98ee-83dc94ca0a91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:25.314918 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661adcc-bb4b-49c7-98ee-83dc94ca0a91 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:25.333714 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:25.350321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf347c86-5760-4b88-b378-7bb4510c0c90 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:25.390753 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ad4d2-486d-40c0-b4c4-5c7c252ca6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:25.391358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ad4d2-486d-40c0-b4c4-5c7c252ca6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:25.391640 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ad4d2-486d-40c0-b4c4-5c7c252ca6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:25.391912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ad4d2-486d-40c0-b4c4-5c7c252ca6a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:25.392651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ad4d2-486d-40c0-b4c4-5c7c252ca6a8 None admin] RBAC: Adding query filter params (role.id=2613cf4a98d44744a094c7782b19b4b5, scope.project.id=a4a05ac2e47b41afb49b5304780a242e, user.id=d8b411d85dc4412297868efd3416ba96) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:25.392958 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ad4d2-486d-40c0-b4c4-5c7c252ca6a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:25.402857 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ad4d2-486d-40c0-b4c4-5c7c252ca6a8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:25.410083 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 100/200] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:06:25 2022] GET /identity/v3/role_assignments?user.id=d8b411d85dc4412297868efd3416ba96&scope.project.id=a4a05ac2e47b41afb49b5304780a242e&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:25.411444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ad4d2-486d-40c0-b4c4-5c7c252ca6a8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:25.434231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:25.437455 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 101/201] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:25.444005 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661adcc-bb4b-49c7-98ee-83dc94ca0a91 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:25.583546 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661adcc-bb4b-49c7-98ee-83dc94ca0a91 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:25.605033 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ad4d2-486d-40c0-b4c4-5c7c252ca6a8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:25.632571 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:25.644372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cd501-8515-42c9-8919-18cab927d124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:25.645067 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cd501-8515-42c9-8919-18cab927d124 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:25.645348 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cd501-8515-42c9-8919-18cab927d124 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:25.645620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cd501-8515-42c9-8919-18cab927d124 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:25.646351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82cd501-8515-42c9-8919-18cab927d124 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:25.646661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82cd501-8515-42c9-8919-18cab927d124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:25.650746 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82cd501-8515-42c9-8919-18cab927d124 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:25.658632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 101/202] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:25.665182 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cd501-8515-42c9-8919-18cab927d124 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:25.684332 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8d439-857a-42ed-b519-41f311b37688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:25.685083 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8d439-857a-42ed-b519-41f311b37688 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:25.685474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8d439-857a-42ed-b519-41f311b37688 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:25.685759 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8d439-857a-42ed-b519-41f311b37688 None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:25.687457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8d439-857a-42ed-b519-41f311b37688 None admin] RBAC: Authorizing `identity:get_project(project_id=a4a05ac2e47b41afb49b5304780a242e)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:25.689163 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8d439-857a-42ed-b519-41f311b37688 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:25.691361 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 102/203] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:25 2022] GET /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:25.697619 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8d439-857a-42ed-b519-41f311b37688 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:25.761446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:25.794804 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cd501-8515-42c9-8919-18cab927d124 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:25.863938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57debebd-638c-4ee1-b8af-ff4dab016597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:25.864496 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57debebd-638c-4ee1-b8af-ff4dab016597 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:25.864778 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57debebd-638c-4ee1-b8af-ff4dab016597 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:25.865057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57debebd-638c-4ee1-b8af-ff4dab016597 None admin] PATH_INFO: `/v3/users/433e75aa58bb492f83b621c30081fd22` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:25.867545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57debebd-638c-4ee1-b8af-ff4dab016597 None admin] RBAC: Authorizing `identity:get_user(user_id=433e75aa58bb492f83b621c30081fd22)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:25.868994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57debebd-638c-4ee1-b8af-ff4dab016597 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:25.878903 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 102/204] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:25 2022] GET /identity/v3/users/433e75aa58bb492f83b621c30081fd22 => generated 289 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:25.879994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8d439-857a-42ed-b519-41f311b37688 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:25.883342 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57debebd-638c-4ee1-b8af-ff4dab016597 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:25.931673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1df88-a344-44f5-90d3-9a7e48dd7aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:25.932286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1df88-a344-44f5-90d3-9a7e48dd7aeb None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:25.932572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1df88-a344-44f5-90d3-9a7e48dd7aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:25.932850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1df88-a344-44f5-90d3-9a7e48dd7aeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:25.933608 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1df88-a344-44f5-90d3-9a7e48dd7aeb None admin] RBAC: Adding query filter params (role.id=9e2965c7d68d423a965894a8eb16903f, scope.project.id=a4a05ac2e47b41afb49b5304780a242e, user.id=d8b411d85dc4412297868efd3416ba96) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:25.934000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1df88-a344-44f5-90d3-9a7e48dd7aeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:25.935470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1df88-a344-44f5-90d3-9a7e48dd7aeb None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:25.941546 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 103/205] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:06:25 2022] GET /identity/v3/role_assignments?user.id=d8b411d85dc4412297868efd3416ba96&scope.project.id=a4a05ac2e47b41afb49b5304780a242e&role.id=9e2965c7d68d423a965894a8eb16903f => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:26.060335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57debebd-638c-4ee1-b8af-ff4dab016597 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:26.106454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d401b13-4d01-4d6e-b08a-2d98011bc5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:26.107516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d401b13-4d01-4d6e-b08a-2d98011bc5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:26.108023 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d401b13-4d01-4d6e-b08a-2d98011bc5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:26.108502 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d401b13-4d01-4d6e-b08a-2d98011bc5e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:26.130120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:26.188549 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d401b13-4d01-4d6e-b08a-2d98011bc5e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:26.190075 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d401b13-4d01-4d6e-b08a-2d98011bc5e8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:26.310578 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 103/206] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 04:06:26.319839 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1df88-a344-44f5-90d3-9a7e48dd7aeb None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:26.382651 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:26.464957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1df88-a344-44f5-90d3-9a7e48dd7aeb None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:26.510973 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a995bd-2763-4608-b837-6eca03dffcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:26.511614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a995bd-2763-4608-b837-6eca03dffcc8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:26.511904 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a995bd-2763-4608-b837-6eca03dffcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:26.512181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a995bd-2763-4608-b837-6eca03dffcc8 None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:26.513328 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a995bd-2763-4608-b837-6eca03dffcc8 None admin] RBAC: Authorizing `identity:get_project(project_id=26f3d9baa4614c7ab91952d7e5132734)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:26.514805 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a995bd-2763-4608-b837-6eca03dffcc8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:26.516637 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 104/207] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:26 2022] GET /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:26.522652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d401b13-4d01-4d6e-b08a-2d98011bc5e8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:26.582603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:26.654857 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d401b13-4d01-4d6e-b08a-2d98011bc5e8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:26.697243 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15e423-1416-4e65-b3de-9bce2c17f2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:26.698231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15e423-1416-4e65-b3de-9bce2c17f2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:26.698740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15e423-1416-4e65-b3de-9bce2c17f2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:26.699223 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15e423-1416-4e65-b3de-9bce2c17f2f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:26.700162 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15e423-1416-4e65-b3de-9bce2c17f2f6 None admin] RBAC: Adding query filter params (role.id=d8b538ae7b664438823dd39746467d37, scope.project.id=26f3d9baa4614c7ab91952d7e5132734, user.id=433e75aa58bb492f83b621c30081fd22) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:26.700693 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15e423-1416-4e65-b3de-9bce2c17f2f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:26.702337 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15e423-1416-4e65-b3de-9bce2c17f2f6 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:26.708668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 104/208] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:06:26 2022] GET /identity/v3/role_assignments?user.id=433e75aa58bb492f83b621c30081fd22&scope.project.id=26f3d9baa4614c7ab91952d7e5132734&role.id=d8b538ae7b664438823dd39746467d37 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:27.081421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fa04b-fa5e-4d22-8d53-cb367dbc64e7 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:27.081793 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fa04b-fa5e-4d22-8d53-cb367dbc64e7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:27.082084 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fa04b-fa5e-4d22-8d53-cb367dbc64e7 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:27.083871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 105/209] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:06:27.090318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635ace1-6f28-42f4-95ac-ce88fa8acaee None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:27.090800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635ace1-6f28-42f4-95ac-ce88fa8acaee None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:27.090980 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635ace1-6f28-42f4-95ac-ce88fa8acaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:27.112356 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e635ace1-6f28-42f4-95ac-ce88fa8acaee None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:27.113859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e635ace1-6f28-42f4-95ac-ce88fa8acaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:27.134279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3c1dd-0c83-4959-95d0-c39809aeb861 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:27.134915 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3c1dd-0c83-4959-95d0-c39809aeb861 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:27.135797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3c1dd-0c83-4959-95d0-c39809aeb861 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:27.137395 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 106/210] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:27.146798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99fe94-80b2-45f0-a7ec-0a5d59108c9d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:27.147596 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99fe94-80b2-45f0-a7ec-0a5d59108c9d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:27.149029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99fe94-80b2-45f0-a7ec-0a5d59108c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:27.170228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9e99fe94-80b2-45f0-a7ec-0a5d59108c9d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:27.172121 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9e99fe94-80b2-45f0-a7ec-0a5d59108c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:27.202752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 105/211] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:27.271883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 107/212] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:27.499729 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635ace1-6f28-42f4-95ac-ce88fa8acaee None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:27.540190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:27.555429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99fe94-80b2-45f0-a7ec-0a5d59108c9d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:27.613016 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635ace1-6f28-42f4-95ac-ce88fa8acaee None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:27.615887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:27.654389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460bdca-1921-4ce0-83d3-385560457629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:27.654969 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460bdca-1921-4ce0-83d3-385560457629 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:27.655252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460bdca-1921-4ce0-83d3-385560457629 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:27.655530 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460bdca-1921-4ce0-83d3-385560457629 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:27.656650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460bdca-1921-4ce0-83d3-385560457629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:27.658255 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460bdca-1921-4ce0-83d3-385560457629 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:27.660008 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 106/213] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:06:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:27.666933 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460bdca-1921-4ce0-83d3-385560457629 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:27.683547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99fe94-80b2-45f0-a7ec-0a5d59108c9d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:27.720667 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31681d9-d2b9-4c4e-a045-ab02194ec2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:27.721537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31681d9-d2b9-4c4e-a045-ab02194ec2dc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:27.722093 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31681d9-d2b9-4c4e-a045-ab02194ec2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:27.722606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31681d9-d2b9-4c4e-a045-ab02194ec2dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:27.734463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31681d9-d2b9-4c4e-a045-ab02194ec2dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:27.740021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-c31681d9-d2b9-4c4e-a045-ab02194ec2dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:27.740021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:27.740021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:27.740021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:27.740021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:27.740021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:27.740021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:27.740021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:27.740021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:27.740021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:27.740021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:27.740021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:27.740021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:27.740021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:27.740021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:27.740021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:27.740895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:27.740895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:27.740895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:27.740895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:27.740895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:27.740895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:27.740895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:27.740895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:27.740895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:27.740895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:27.740895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:27.740895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:27.740895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:27.740895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:27.740895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:27.740895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:27.741712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:27.741712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:27.741712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:27.741712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:27.741712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:27.741712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:27.741712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:27.741712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:27.741712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:27.741712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:27.741712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:27.741712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:27.744657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 108/214] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:06:27.752339 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31681d9-d2b9-4c4e-a045-ab02194ec2dc None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:27.779324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460bdca-1921-4ce0-83d3-385560457629 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:27.787345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:27.819298 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e30dc4-cd3b-40af-8fff-8cfbdb6b952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:27.820023 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e30dc4-cd3b-40af-8fff-8cfbdb6b952b None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:27.820234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e30dc4-cd3b-40af-8fff-8cfbdb6b952b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:27.820515 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e30dc4-cd3b-40af-8fff-8cfbdb6b952b None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:27.821201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e30dc4-cd3b-40af-8fff-8cfbdb6b952b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:27.823314 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e30dc4-cd3b-40af-8fff-8cfbdb6b952b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:27.854750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 107/215] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 27 04:06:27 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:06:27.880928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31681d9-d2b9-4c4e-a045-ab02194ec2dc None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:27.898664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:27.920867 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b35602-4c98-421e-bb2f-8fd261567e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:27.921490 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b35602-4c98-421e-bb2f-8fd261567e69 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:27.921775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b35602-4c98-421e-bb2f-8fd261567e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:27.922051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b35602-4c98-421e-bb2f-8fd261567e69 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:27.922790 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b35602-4c98-421e-bb2f-8fd261567e69 None admin] RBAC: Adding query filter params (name=member) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:27.923105 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b35602-4c98-421e-bb2f-8fd261567e69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:27.924847 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b35602-4c98-421e-bb2f-8fd261567e69 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:27.936007 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab29d3-b910-4a59-bb61-92ec88b8b860 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:27.936345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab29d3-b910-4a59-bb61-92ec88b8b860 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:27.936571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab29d3-b910-4a59-bb61-92ec88b8b860 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:27.938115 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 108/216] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:06:27.939491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 109/217] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:27.943927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fa1d3-5af1-4268-8d3a-387051bbf306 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:27.944114 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fa1d3-5af1-4268-8d3a-387051bbf306 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:27.944322 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fa1d3-5af1-4268-8d3a-387051bbf306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:27.944915 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b35602-4c98-421e-bb2f-8fd261567e69 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:27.964638 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-9b6fa1d3-5af1-4268-8d3a-387051bbf306 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:27.965881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9b6fa1d3-5af1-4268-8d3a-387051bbf306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:28.051135 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 109/218] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:28.074021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b35602-4c98-421e-bb2f-8fd261567e69 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:28.111281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84695cfe-5fcf-41ad-8fb9-a7cfe167f428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:28.111919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84695cfe-5fcf-41ad-8fb9-a7cfe167f428 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:28.112199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84695cfe-5fcf-41ad-8fb9-a7cfe167f428 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:28.112473 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84695cfe-5fcf-41ad-8fb9-a7cfe167f428 None admin] PATH_INFO: `/v3/users/f21939f8cfa94802a5524b5bf3f63a2c` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:28.126903 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84695cfe-5fcf-41ad-8fb9-a7cfe167f428 None admin] RBAC: Authorizing `identity:get_user(user_id=f21939f8cfa94802a5524b5bf3f63a2c)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:28.128376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84695cfe-5fcf-41ad-8fb9-a7cfe167f428 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:28.130024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 110/219] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:27 2022] GET /identity/v3/users/f21939f8cfa94802a5524b5bf3f63a2c => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:28.136334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fa1d3-5af1-4268-8d3a-387051bbf306 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:28.254548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:28.265989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fa1d3-5af1-4268-8d3a-387051bbf306 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:28.310685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a90c71-6c97-42c1-a14e-2a0d4b9f9366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:28.311352 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a90c71-6c97-42c1-a14e-2a0d4b9f9366 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:28.311636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a90c71-6c97-42c1-a14e-2a0d4b9f9366 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:28.311969 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a90c71-6c97-42c1-a14e-2a0d4b9f9366 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:28.329131 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84695cfe-5fcf-41ad-8fb9-a7cfe167f428 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:28.363288 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:28.407336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a90c71-6c97-42c1-a14e-2a0d4b9f9366 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:28.409044 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a90c71-6c97-42c1-a14e-2a0d4b9f9366 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:28.456958 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84695cfe-5fcf-41ad-8fb9-a7cfe167f428 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:28.493920 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19e1cd-ecdd-44a1-9597-1f4608c0070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:28.494550 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19e1cd-ecdd-44a1-9597-1f4608c0070c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:28.494875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19e1cd-ecdd-44a1-9597-1f4608c0070c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:28.495149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19e1cd-ecdd-44a1-9597-1f4608c0070c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:28.506196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19e1cd-ecdd-44a1-9597-1f4608c0070c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:28.511846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-ee19e1cd-ecdd-44a1-9597-1f4608c0070c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:28.511846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:28.511846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:28.511846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:28.511846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:28.511846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:28.511846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:28.511846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:28.511846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:28.511846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:28.511846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:28.511846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:28.511846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:28.511846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:28.511846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:28.511846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:28.512721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:28.512721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:28.512721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:28.512721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:28.512721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:28.512721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:28.512721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:28.512721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:28.512721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:28.512721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:28.512721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:28.512721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:28.512721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:28.512721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:28.512721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:28.512721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:28.513516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:28.513516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:28.513516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:28.513516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:28.513516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:28.513516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:28.513516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:28.513516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:28.513516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:28.513516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:28.513516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:28.513516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:28.513516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 111/220] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:06:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:06:28.514628 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320e3f7-d23d-41fe-bd6f-fa18c5ebf335 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:28.514628 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320e3f7-d23d-41fe-bd6f-fa18c5ebf335 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:28.514835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320e3f7-d23d-41fe-bd6f-fa18c5ebf335 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:28.515999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 112/221] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:28.519133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320e3f7-d23d-41fe-bd6f-fa18c5ebf335 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:28.527178 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:28.538942 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 110/222] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:28.540773 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2db595-160c-422f-86b1-6ed702370ec2 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:28.541346 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2db595-160c-422f-86b1-6ed702370ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:28.541729 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2db595-160c-422f-86b1-6ed702370ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:28.566224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-eb2db595-160c-422f-86b1-6ed702370ec2 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:28.568455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-eb2db595-160c-422f-86b1-6ed702370ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:28.622565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:28.641894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320e3f7-d23d-41fe-bd6f-fa18c5ebf335 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:28.665784 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 111/223] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:28.667740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2db595-160c-422f-86b1-6ed702370ec2 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:28.685372 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dc1bc-deeb-4c87-81b8-ab0aea1206b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:28.686044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dc1bc-deeb-4c87-81b8-ab0aea1206b3 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:28.686329 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dc1bc-deeb-4c87-81b8-ab0aea1206b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:28.686601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dc1bc-deeb-4c87-81b8-ab0aea1206b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:28.687467 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dc1bc-deeb-4c87-81b8-ab0aea1206b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:28.687770 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dc1bc-deeb-4c87-81b8-ab0aea1206b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:28.689207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dc1bc-deeb-4c87-81b8-ab0aea1206b3 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:28.705317 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 113/224] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:28.722102 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dc1bc-deeb-4c87-81b8-ab0aea1206b3 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:28.795048 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2db595-160c-422f-86b1-6ed702370ec2 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:28.822653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:28.836086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f11f0-cf07-4865-ac03-76d56dd1251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:28.837572 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f11f0-cf07-4865-ac03-76d56dd1251b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:28.838140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f11f0-cf07-4865-ac03-76d56dd1251b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:28.838631 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f11f0-cf07-4865-ac03-76d56dd1251b None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:28.840715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f11f0-cf07-4865-ac03-76d56dd1251b None admin] RBAC: Authorizing `identity:get_project(project_id=a4a05ac2e47b41afb49b5304780a242e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:28.842933 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f11f0-cf07-4865-ac03-76d56dd1251b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:28.845481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 112/225] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:28 2022] GET /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:28.851394 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f11f0-cf07-4865-ac03-76d56dd1251b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:28.907216 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dc1bc-deeb-4c87-81b8-ab0aea1206b3 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:28.973246 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f11f0-cf07-4865-ac03-76d56dd1251b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:28.976507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c170f2-46ff-4abe-9b46-9f542db3eeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:28.976844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c170f2-46ff-4abe-9b46-9f542db3eeb6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:28.977132 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c170f2-46ff-4abe-9b46-9f542db3eeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:28.977416 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c170f2-46ff-4abe-9b46-9f542db3eeb6 None admin] PATH_INFO: `/v3/users/d8b411d85dc4412297868efd3416ba96` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:28.979471 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c170f2-46ff-4abe-9b46-9f542db3eeb6 None admin] RBAC: Authorizing `identity:get_user(user_id=d8b411d85dc4412297868efd3416ba96)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:28.982043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c170f2-46ff-4abe-9b46-9f542db3eeb6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:28.983713 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 114/226] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:28 2022] GET /identity/v3/users/d8b411d85dc4412297868efd3416ba96 => generated 283 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:28.988396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c170f2-46ff-4abe-9b46-9f542db3eeb6 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:29.007148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:29.026362 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a3e54-c9f1-47c1-8cbd-20d9b6a9db1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:29.028070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a3e54-c9f1-47c1-8cbd-20d9b6a9db1a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:29.028572 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a3e54-c9f1-47c1-8cbd-20d9b6a9db1a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:29.029037 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a3e54-c9f1-47c1-8cbd-20d9b6a9db1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:29.029976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a3e54-c9f1-47c1-8cbd-20d9b6a9db1a None admin] RBAC: Adding query filter params (role.id=71cc6516aeff47eea3961db1a3d57f21, scope.project.id=a4a05ac2e47b41afb49b5304780a242e, user.id=f21939f8cfa94802a5524b5bf3f63a2c) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:29.030475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a3e54-c9f1-47c1-8cbd-20d9b6a9db1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:29.032586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a3e54-c9f1-47c1-8cbd-20d9b6a9db1a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:29.040559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 113/227] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:06:28 2022] GET /identity/v3/role_assignments?user.id=f21939f8cfa94802a5524b5bf3f63a2c&scope.project.id=a4a05ac2e47b41afb49b5304780a242e&role.id=71cc6516aeff47eea3961db1a3d57f21 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:29.041717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a3e54-c9f1-47c1-8cbd-20d9b6a9db1a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:29.134755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c170f2-46ff-4abe-9b46-9f542db3eeb6 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:29.204752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbdc35-71b4-4bc0-af16-02bb89ea1fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:29.205414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbdc35-71b4-4bc0-af16-02bb89ea1fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:29.205696 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbdc35-71b4-4bc0-af16-02bb89ea1fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:29.205974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbdc35-71b4-4bc0-af16-02bb89ea1fa0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:29.219692 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:29.231757 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbdc35-71b4-4bc0-af16-02bb89ea1fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:29.237562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-4afbdc35-71b4-4bc0-af16-02bb89ea1fa0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:29.237562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:29.237562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:29.237562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:29.237562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:29.237562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:29.237562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:29.237562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:29.237562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:29.237562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:29.237562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:29.237562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:29.237562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:29.237562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:29.237562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:29.237562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:29.238446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:29.238446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:29.238446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:29.238446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:29.238446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:29.238446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:29.238446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:29.238446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:29.238446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:29.238446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:29.238446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:29.238446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:29.238446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:29.238446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:29.238446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:29.238446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:29.239689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:29.239689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:29.239689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:29.239689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:29.239689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:29.239689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:29.239689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:29.239689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:29.239689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:29.239689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:29.239689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:29.239689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:29.239689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 115/228] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:06:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:29.247359 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbdc35-71b4-4bc0-af16-02bb89ea1fa0 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:29.285196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a3e54-c9f1-47c1-8cbd-20d9b6a9db1a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:29.330785 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98d7e0-915d-4350-a788-a016c8cd0c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:29.331478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98d7e0-915d-4350-a788-a016c8cd0c13 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:29.331767 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98d7e0-915d-4350-a788-a016c8cd0c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:29.332042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98d7e0-915d-4350-a788-a016c8cd0c13 None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:29.333799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98d7e0-915d-4350-a788-a016c8cd0c13 None admin] RBAC: Authorizing `identity:get_project(project_id=a4a05ac2e47b41afb49b5304780a242e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:29.338448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98d7e0-915d-4350-a788-a016c8cd0c13 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:29.340142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 114/229] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:29 2022] GET /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:29.346016 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98d7e0-915d-4350-a788-a016c8cd0c13 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:29.381890 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:29.408635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbdc35-71b4-4bc0-af16-02bb89ea1fa0 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:29.453846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769927a7-f1b1-49f1-8272-36b4e410e689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:29.454468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769927a7-f1b1-49f1-8272-36b4e410e689 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:29.454773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769927a7-f1b1-49f1-8272-36b4e410e689 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:29.455051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769927a7-f1b1-49f1-8272-36b4e410e689 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:29.457687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769927a7-f1b1-49f1-8272-36b4e410e689 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:29.457997 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769927a7-f1b1-49f1-8272-36b4e410e689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:29.461585 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769927a7-f1b1-49f1-8272-36b4e410e689 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:29.479016 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 116/230] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:06:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:29.483484 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769927a7-f1b1-49f1-8272-36b4e410e689 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:29.555851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98d7e0-915d-4350-a788-a016c8cd0c13 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:29.607779 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:29.634207 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06eb2a-8252-475e-9eae-f0135134efd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:29.634903 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06eb2a-8252-475e-9eae-f0135134efd4 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:29.635188 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06eb2a-8252-475e-9eae-f0135134efd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:29.635469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06eb2a-8252-475e-9eae-f0135134efd4 None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e/users/d8b411d85dc4412297868efd3416ba96/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:29.638856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06eb2a-8252-475e-9eae-f0135134efd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4a05ac2e47b41afb49b5304780a242e, user_id=d8b411d85dc4412297868efd3416ba96, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:29.641408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06eb2a-8252-475e-9eae-f0135134efd4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:29.664799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 115/231] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:06:29 2022] PUT /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e/users/d8b411d85dc4412297868efd3416ba96/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:06:29.668739 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769927a7-f1b1-49f1-8272-36b4e410e689 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:29.713219 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44cd1e-54b6-4977-9764-a09f727a0b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:29.713864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44cd1e-54b6-4977-9764-a09f727a0b1e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:29.714150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44cd1e-54b6-4977-9764-a09f727a0b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:29.714435 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44cd1e-54b6-4977-9764-a09f727a0b1e None admin] PATH_INFO: `/v3/users/d8b411d85dc4412297868efd3416ba96` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:29.716247 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44cd1e-54b6-4977-9764-a09f727a0b1e None admin] RBAC: Authorizing `identity:get_user(user_id=d8b411d85dc4412297868efd3416ba96)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:29.717716 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44cd1e-54b6-4977-9764-a09f727a0b1e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:29.719548 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 117/232] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:29 2022] GET /identity/v3/users/d8b411d85dc4412297868efd3416ba96 => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:29.726425 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06eb2a-8252-475e-9eae-f0135134efd4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:29.849408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06eb2a-8252-475e-9eae-f0135134efd4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:29.885950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e8e64-0d87-4901-8243-41583806cbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:29.886605 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e8e64-0d87-4901-8243-41583806cbeb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:29.886921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e8e64-0d87-4901-8243-41583806cbeb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:29.887202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e8e64-0d87-4901-8243-41583806cbeb None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:29.888476 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e8e64-0d87-4901-8243-41583806cbeb None admin] RBAC: Authorizing `identity:get_project(project_id=a4a05ac2e47b41afb49b5304780a242e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:29.889959 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e8e64-0d87-4901-8243-41583806cbeb None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:29.891679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 116/233] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:29 2022] GET /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:29.897931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44cd1e-54b6-4977-9764-a09f727a0b1e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:29.908471 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:30.014667 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44cd1e-54b6-4977-9764-a09f727a0b1e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:30.050774 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f0501-62e7-445d-9732-2e7c50c36b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:30.051494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f0501-62e7-445d-9732-2e7c50c36b16 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:30.051779 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f0501-62e7-445d-9732-2e7c50c36b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:30.052133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f0501-62e7-445d-9732-2e7c50c36b16 None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e/users/d8b411d85dc4412297868efd3416ba96/roles/9e2965c7d68d423a965894a8eb16903f` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:30.054312 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f0501-62e7-445d-9732-2e7c50c36b16 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4a05ac2e47b41afb49b5304780a242e, user_id=d8b411d85dc4412297868efd3416ba96, role_id=9e2965c7d68d423a965894a8eb16903f)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:30.055838 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f0501-62e7-445d-9732-2e7c50c36b16 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:30.074945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 118/234] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:06:29 2022] PUT /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e/users/d8b411d85dc4412297868efd3416ba96/roles/9e2965c7d68d423a965894a8eb16903f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:06:30.740929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb34ba-36cc-44d2-a82b-70347f5b593c None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:30.740929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb34ba-36cc-44d2-a82b-70347f5b593c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:30.740929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb34ba-36cc-44d2-a82b-70347f5b593c None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:30.740929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 117/235] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:30.756318 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb43b85-bc5f-4dbd-bdbe-61c3c222f3d8 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:30.757231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb43b85-bc5f-4dbd-bdbe-61c3c222f3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:30.757753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb43b85-bc5f-4dbd-bdbe-61c3c222f3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:30.779070 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8cb43b85-bc5f-4dbd-bdbe-61c3c222f3d8 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:30.780576 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8cb43b85-bc5f-4dbd-bdbe-61c3c222f3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:30.811610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da3aa5-7df8-498f-bafb-ea919c598854 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:30.812365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da3aa5-7df8-498f-bafb-ea919c598854 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:30.812958 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da3aa5-7df8-498f-bafb-ea919c598854 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:30.815418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 118/236] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:06:30.821622 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ae8e6-5cbe-4f44-919f-03d913a30cf2 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:30.822454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ae8e6-5cbe-4f44-919f-03d913a30cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:30.822983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ae8e6-5cbe-4f44-919f-03d913a30cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:30.857609 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-667ae8e6-5cbe-4f44-919f-03d913a30cf2 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:30.858864 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-667ae8e6-5cbe-4f44-919f-03d913a30cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:30.896366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:30.914934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:30.932056 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 119/237] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:30.946367 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 119/238] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:06:31.341854 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb43b85-bc5f-4dbd-bdbe-61c3c222f3d8 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:31.460673 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ae8e6-5cbe-4f44-919f-03d913a30cf2 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:31.498440 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb43b85-bc5f-4dbd-bdbe-61c3c222f3d8 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:31.543326 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db0ca5-06fc-4291-a62b-a0fb128aae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:31.543890 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db0ca5-06fc-4291-a62b-a0fb128aae74 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:31.544178 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db0ca5-06fc-4291-a62b-a0fb128aae74 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:31.544455 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db0ca5-06fc-4291-a62b-a0fb128aae74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:31.564562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db0ca5-06fc-4291-a62b-a0fb128aae74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:31.567423 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ae8e6-5cbe-4f44-919f-03d913a30cf2 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:31.569766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-21db0ca5-06fc-4291-a62b-a0fb128aae74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:06:31.569766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:31.569766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:31.569766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:31.569766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:31.569766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:31.569766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:31.569766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:31.569766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:31.569766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:31.569766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:31.569766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:31.569766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:31.569766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:31.569766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:31.569766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:31.571235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:31.571235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:31.571235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:31.571235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:31.571235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:31.571235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:31.571235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:31.571235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:31.571235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:31.571235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:31.571235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:31.571235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:31.571235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:31.571235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:31.571235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:31.571235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:31.572630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:31.572630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:31.572630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:31.572630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:31.572630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:31.572630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:31.572630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:31.572630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:31.572630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:31.572630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:31.572630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:06:31.572630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:31.572630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 120/239] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:31.580005 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db0ca5-06fc-4291-a62b-a0fb128aae74 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:31.607195 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec51b6-2aa5-4847-8246-f2a99704104d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:31.608187 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec51b6-2aa5-4847-8246-f2a99704104d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:31.608691 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec51b6-2aa5-4847-8246-f2a99704104d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:31.609172 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec51b6-2aa5-4847-8246-f2a99704104d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:31.610600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec51b6-2aa5-4847-8246-f2a99704104d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:31.612325 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec51b6-2aa5-4847-8246-f2a99704104d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:31.618705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 120/240] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:06:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:31.620302 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec51b6-2aa5-4847-8246-f2a99704104d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:31.682332 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:31.734188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db0ca5-06fc-4291-a62b-a0fb128aae74 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:31.761300 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:31.775297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76fc7a-0368-4178-a9d8-c60b534e2d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:31.776441 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76fc7a-0368-4178-a9d8-c60b534e2d12 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:31.776903 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76fc7a-0368-4178-a9d8-c60b534e2d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:31.777327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76fc7a-0368-4178-a9d8-c60b534e2d12 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:31.778207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76fc7a-0368-4178-a9d8-c60b534e2d12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:31.778661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76fc7a-0368-4178-a9d8-c60b534e2d12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:31.780265 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76fc7a-0368-4178-a9d8-c60b534e2d12 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:31.789806 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 121/241] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:31.793883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3ea8b-719d-4e60-a813-c400072c5da7 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:31.794334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3ea8b-719d-4e60-a813-c400072c5da7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:31.794837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3ea8b-719d-4e60-a813-c400072c5da7 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:31.796427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 122/242] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:06:31.800236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3ea8b-719d-4e60-a813-c400072c5da7 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:31.855571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec51b6-2aa5-4847-8246-f2a99704104d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:31.903711 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35914138-946b-4310-9e6a-6e69dc2ef44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:31.905111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35914138-946b-4310-9e6a-6e69dc2ef44b None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:31.905842 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35914138-946b-4310-9e6a-6e69dc2ef44b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:31.906338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35914138-946b-4310-9e6a-6e69dc2ef44b None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:31.907555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35914138-946b-4310-9e6a-6e69dc2ef44b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:31.910147 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35914138-946b-4310-9e6a-6e69dc2ef44b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:31.917520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3ea8b-719d-4e60-a813-c400072c5da7 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:31.938078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:31.940650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 121/243] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 27 04:06:31 2022] POST /identity/v3/users => generated 293 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:06:31.943714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2ac33-641d-48be-a4e4-5d31345024c8 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:31.944440 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2ac33-641d-48be-a4e4-5d31345024c8 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:31.944964 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2ac33-641d-48be-a4e4-5d31345024c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:31.967363 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446707f-3457-4a04-b8f1-6cb5e45008ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:31.968255 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446707f-3457-4a04-b8f1-6cb5e45008ed None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:31.968764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446707f-3457-4a04-b8f1-6cb5e45008ed None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:31.969304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446707f-3457-4a04-b8f1-6cb5e45008ed None admin] PATH_INFO: `/v3/users/f36541fffeef45ffa536eeb75b2c9248` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:31.970149 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-caf2ac33-641d-48be-a4e4-5d31345024c8 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:31.971479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-caf2ac33-641d-48be-a4e4-5d31345024c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:31.987159 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446707f-3457-4a04-b8f1-6cb5e45008ed None admin] RBAC: Authorizing `identity:get_user(user_id=f36541fffeef45ffa536eeb75b2c9248)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:31.989097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446707f-3457-4a04-b8f1-6cb5e45008ed None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:31.991680 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 123/244] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:31 2022] GET /identity/v3/users/f36541fffeef45ffa536eeb75b2c9248 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:32.005405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446707f-3457-4a04-b8f1-6cb5e45008ed None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:32.058534 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 122/245] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:32.157471 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446707f-3457-4a04-b8f1-6cb5e45008ed None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:32.206645 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01ef8a-2867-47d3-a0ee-5d9c6a2de733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:32.207297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01ef8a-2867-47d3-a0ee-5d9c6a2de733 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:32.207579 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01ef8a-2867-47d3-a0ee-5d9c6a2de733 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:32.207853 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01ef8a-2867-47d3-a0ee-5d9c6a2de733 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:32.259583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:32.283619 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01ef8a-2867-47d3-a0ee-5d9c6a2de733 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:32.285110 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01ef8a-2867-47d3-a0ee-5d9c6a2de733 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:32.339565 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b1389-ca4d-4c52-a103-1dcfb77d11d7 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:32.339938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b1389-ca4d-4c52-a103-1dcfb77d11d7 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:32.340292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b1389-ca4d-4c52-a103-1dcfb77d11d7 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:32.341880 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 123/246] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:06:32.347346 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6825cb3-5514-40d5-ac42-a5d070db8f13 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:32.347839 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6825cb3-5514-40d5-ac42-a5d070db8f13 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:32.348200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6825cb3-5514-40d5-ac42-a5d070db8f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:32.373489 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c6825cb3-5514-40d5-ac42-a5d070db8f13 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:32.376345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c6825cb3-5514-40d5-ac42-a5d070db8f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:32.418418 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 124/247] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 04:06:32.418418 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01ef8a-2867-47d3-a0ee-5d9c6a2de733 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:32.424165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:32.474285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 124/248] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 27 04:06:32.474496 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6825cb3-5514-40d5-ac42-a5d070db8f13 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:32.536181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:32.569547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01ef8a-2867-47d3-a0ee-5d9c6a2de733 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:32.592203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6825cb3-5514-40d5-ac42-a5d070db8f13 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:32.619088 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ca896-d3cf-491f-a683-1a260d4d879d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:32.619738 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ca896-d3cf-491f-a683-1a260d4d879d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:32.620021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ca896-d3cf-491f-a683-1a260d4d879d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:32.620300 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ca896-d3cf-491f-a683-1a260d4d879d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:32.635510 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ca896-d3cf-491f-a683-1a260d4d879d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:32.639528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b161545-44df-4680-b816-beec2c04a6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:32.640415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b161545-44df-4680-b816-beec2c04a6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:32.640520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-740ca896-d3cf-491f-a683-1a260d4d879d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:32.640520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:32.640520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:32.640520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:32.640520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:32.640520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:32.640520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:32.640520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:32.640520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:32.640520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:32.640520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:32.640520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:32.640520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:32.640520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:32.640520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:32.640520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:32.641374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:32.641374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:32.641374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:32.641374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:32.641374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:32.641374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:32.641374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:32.641374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:32.641374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:32.641374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:32.641374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:32.641374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:32.641374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:32.641374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:32.641374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:32.641374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:32.642164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:32.642164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:32.642164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:32.642164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:32.642164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:32.642164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:32.642164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:32.642164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:32.642164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:32.642164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:32.642164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:32.642164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:32.642164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 125/249] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:32.645594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b161545-44df-4680-b816-beec2c04a6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:32.645594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b161545-44df-4680-b816-beec2c04a6e6 None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:32.645594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b161545-44df-4680-b816-beec2c04a6e6 None admin] RBAC: Authorizing `identity:get_project(project_id=a4a05ac2e47b41afb49b5304780a242e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:32.646244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b161545-44df-4680-b816-beec2c04a6e6 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:32.648781 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 125/250] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:32 2022] GET /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:32.650260 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ca896-d3cf-491f-a683-1a260d4d879d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:32.655738 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b161545-44df-4680-b816-beec2c04a6e6 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:32.694141 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:32.783621 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ca896-d3cf-491f-a683-1a260d4d879d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:32.784127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b161545-44df-4680-b816-beec2c04a6e6 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:32.826012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651818ed-6a61-4c45-8e9a-c6040677b1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:32.826628 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651818ed-6a61-4c45-8e9a-c6040677b1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:32.826939 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651818ed-6a61-4c45-8e9a-c6040677b1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:32.827219 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651818ed-6a61-4c45-8e9a-c6040677b1b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:32.827898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651818ed-6a61-4c45-8e9a-c6040677b1b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:32.828205 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651818ed-6a61-4c45-8e9a-c6040677b1b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:32.828359 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a5262-587a-4549-9e8a-3e147793629b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:32.828941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a5262-587a-4549-9e8a-3e147793629b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:32.829225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a5262-587a-4549-9e8a-3e147793629b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:32.829502 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a5262-587a-4549-9e8a-3e147793629b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:32.829592 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651818ed-6a61-4c45-8e9a-c6040677b1b0 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:32.830240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a5262-587a-4549-9e8a-3e147793629b None admin] RBAC: Adding query filter params (role.id=d8b538ae7b664438823dd39746467d37, scope.project.id=a4a05ac2e47b41afb49b5304780a242e, user.id=f36541fffeef45ffa536eeb75b2c9248) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:32.830555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a5262-587a-4549-9e8a-3e147793629b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:32.834178 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a5262-587a-4549-9e8a-3e147793629b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:32.834922 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:32.839948 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 126/251] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:32.841164 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 126/252] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:06:32 2022] GET /identity/v3/role_assignments?user.id=f36541fffeef45ffa536eeb75b2c9248&scope.project.id=a4a05ac2e47b41afb49b5304780a242e&role.id=d8b538ae7b664438823dd39746467d37 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:32.841553 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbaa1a-ea32-4c51-b75e-7dafa74daf1a None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:32.842064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbaa1a-ea32-4c51-b75e-7dafa74daf1a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:32.842414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a5262-587a-4549-9e8a-3e147793629b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:32.842518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbaa1a-ea32-4c51-b75e-7dafa74daf1a None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:32.844081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 127/253] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:32.849002 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbaa1a-ea32-4c51-b75e-7dafa74daf1a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:32.961316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:32.969046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a5262-587a-4549-9e8a-3e147793629b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:32.976038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbaa1a-ea32-4c51-b75e-7dafa74daf1a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:33.008986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e777e3-1380-4b34-beca-bde5b1d2e0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:33.009628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e777e3-1380-4b34-beca-bde5b1d2e0bc None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:33.009913 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e777e3-1380-4b34-beca-bde5b1d2e0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:33.010193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e777e3-1380-4b34-beca-bde5b1d2e0bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:33.020563 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949380f-8677-420f-8aa5-e482ece35ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:33.021518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949380f-8677-420f-8aa5-e482ece35ffa None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:33.021808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949380f-8677-420f-8aa5-e482ece35ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:33.021977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e777e3-1380-4b34-beca-bde5b1d2e0bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:33.022071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949380f-8677-420f-8aa5-e482ece35ffa None admin] PATH_INFO: `/v3/users/f21939f8cfa94802a5524b5bf3f63a2c` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:33.023349 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949380f-8677-420f-8aa5-e482ece35ffa None admin] RBAC: Authorizing `identity:get_user(user_id=f21939f8cfa94802a5524b5bf3f63a2c)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:33.024829 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949380f-8677-420f-8aa5-e482ece35ffa None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:33.026824 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 128/254] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:32 2022] GET /identity/v3/users/f21939f8cfa94802a5524b5bf3f63a2c => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:33.027737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-58e777e3-1380-4b34-beca-bde5b1d2e0bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:33.027737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:33.027737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:33.027737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:33.027737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:33.027737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:33.027737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:33.027737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:33.027737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:33.027737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:33.027737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:33.027737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:33.027737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:33.027737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:33.027737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:33.027737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:33.028585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:33.028585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:33.028585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:33.028585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:33.028585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:33.028585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:33.028585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:33.028585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:33.028585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:33.028585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:33.028585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:33.028585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:33.028585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:33.028585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:33.028585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:33.028585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:33.029373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:33.029373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:33.029373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:33.029373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:33.029373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:33.029373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:33.029373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:33.029373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:33.029373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:33.029373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:33.029373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:33.029373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:06:33.029977 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33767fc-4ba5-4c1d-a27f-996e08c1a8fa None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:33.029977 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33767fc-4ba5-4c1d-a27f-996e08c1a8fa None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:33.029977 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33767fc-4ba5-4c1d-a27f-996e08c1a8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:33.030155 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 127/255] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:06:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:33.036762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e777e3-1380-4b34-beca-bde5b1d2e0bc None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:33.050090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c33767fc-4ba5-4c1d-a27f-996e08c1a8fa None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:33.051347 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c33767fc-4ba5-4c1d-a27f-996e08c1a8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:33.162940 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:33.175409 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 129/256] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:33.176280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33767fc-4ba5-4c1d-a27f-996e08c1a8fa None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:33.184013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e777e3-1380-4b34-beca-bde5b1d2e0bc None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:33.223011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d986c10-84b0-4350-9882-2e097f07d55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:33.224384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d986c10-84b0-4350-9882-2e097f07d55a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:33.224868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d986c10-84b0-4350-9882-2e097f07d55a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:33.225423 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d986c10-84b0-4350-9882-2e097f07d55a None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:33.226946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d986c10-84b0-4350-9882-2e097f07d55a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:33.227428 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d986c10-84b0-4350-9882-2e097f07d55a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:33.229245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d986c10-84b0-4350-9882-2e097f07d55a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:33.238395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 128/257] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:33.244292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d986c10-84b0-4350-9882-2e097f07d55a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:33.278237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:33.433998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d986c10-84b0-4350-9882-2e097f07d55a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:33.448727 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33767fc-4ba5-4c1d-a27f-996e08c1a8fa None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:33.502365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351712c-22ef-4940-acc7-1e813892bf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:33.502956 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351712c-22ef-4940-acc7-1e813892bf1b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:33.503247 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351712c-22ef-4940-acc7-1e813892bf1b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:33.503528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351712c-22ef-4940-acc7-1e813892bf1b None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:33.504371 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76733a16-a34c-46b7-968b-a405de7fd949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:33.504662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351712c-22ef-4940-acc7-1e813892bf1b None admin] RBAC: Authorizing `identity:get_project(project_id=a4a05ac2e47b41afb49b5304780a242e)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:33.505009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76733a16-a34c-46b7-968b-a405de7fd949 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:33.505286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76733a16-a34c-46b7-968b-a405de7fd949 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:33.505557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76733a16-a34c-46b7-968b-a405de7fd949 None admin] PATH_INFO: `/v3/users/d8b411d85dc4412297868efd3416ba96` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:33.506137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351712c-22ef-4940-acc7-1e813892bf1b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:33.507417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76733a16-a34c-46b7-968b-a405de7fd949 None admin] RBAC: Authorizing `identity:get_user(user_id=d8b411d85dc4412297868efd3416ba96)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:33.507845 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 130/258] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:33 2022] GET /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e => generated 302 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:33.509182 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76733a16-a34c-46b7-968b-a405de7fd949 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:33.518789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 129/259] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:33 2022] GET /identity/v3/users/d8b411d85dc4412297868efd3416ba96 => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:33.520058 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76733a16-a34c-46b7-968b-a405de7fd949 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:33.520177 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351712c-22ef-4940-acc7-1e813892bf1b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:33.620009 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:33.674476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351712c-22ef-4940-acc7-1e813892bf1b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:33.692411 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:33.724470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76733a16-a34c-46b7-968b-a405de7fd949 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:33.751189 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e853c-3f45-452e-b1ee-1114dc771de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:33.751852 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e853c-3f45-452e-b1ee-1114dc771de1 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:33.752134 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e853c-3f45-452e-b1ee-1114dc771de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:33.752459 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e853c-3f45-452e-b1ee-1114dc771de1 None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e/users/f21939f8cfa94802a5524b5bf3f63a2c/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:33.760102 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e853c-3f45-452e-b1ee-1114dc771de1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4a05ac2e47b41afb49b5304780a242e, user_id=f21939f8cfa94802a5524b5bf3f63a2c, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:33.761575 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e853c-3f45-452e-b1ee-1114dc771de1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:33.776624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f9435-c2f1-4316-9c30-689a9724c35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:33.777375 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f9435-c2f1-4316-9c30-689a9724c35a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:33.777710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f9435-c2f1-4316-9c30-689a9724c35a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:33.777987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f9435-c2f1-4316-9c30-689a9724c35a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:33.791125 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 131/260] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:06:33 2022] PUT /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e/users/f21939f8cfa94802a5524b5bf3f63a2c/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:06:33.792000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e853c-3f45-452e-b1ee-1114dc771de1 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:33.859438 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f9435-c2f1-4316-9c30-689a9724c35a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:33.860969 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f9435-c2f1-4316-9c30-689a9724c35a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:33.964455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:33.984330 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 130/261] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:33.992612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f9435-c2f1-4316-9c30-689a9724c35a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:34.061033 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e853c-3f45-452e-b1ee-1114dc771de1 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:34.098990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:34.112649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bbe77-2ae7-424e-801f-805e4d279dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:34.113309 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bbe77-2ae7-424e-801f-805e4d279dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:34.113603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bbe77-2ae7-424e-801f-805e4d279dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:34.113891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bbe77-2ae7-424e-801f-805e4d279dc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:34.124522 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f9435-c2f1-4316-9c30-689a9724c35a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:34.126638 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bbe77-2ae7-424e-801f-805e4d279dc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:34.132184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-e54bbe77-2ae7-424e-801f-805e4d279dc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:34.132184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:34.132184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:34.132184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:34.132184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:34.132184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:34.132184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:34.132184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:34.132184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:34.132184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:34.132184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:34.132184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:34.132184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:34.132184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:34.132184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:34.132184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:34.133722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:34.133722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:34.133722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:34.133722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:34.133722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:34.133722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:34.133722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:34.133722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:34.133722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:34.133722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:34.133722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:34.133722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:34.133722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:34.133722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:34.133722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:34.133722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:34.134527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:34.134527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:34.134527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:34.134527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:34.134527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:34.134527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:34.134527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:34.134527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:34.134527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:34.134527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:34.134527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:34.134527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:34.134527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 132/262] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:06:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:34.141358 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bbe77-2ae7-424e-801f-805e4d279dc9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:34.185516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff1d7b-0988-4562-9739-a9a1da0c6b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:34.186555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff1d7b-0988-4562-9739-a9a1da0c6b2e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:34.187197 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff1d7b-0988-4562-9739-a9a1da0c6b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:34.187686 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff1d7b-0988-4562-9739-a9a1da0c6b2e None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:34.191635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff1d7b-0988-4562-9739-a9a1da0c6b2e None admin] RBAC: Authorizing `identity:get_project(project_id=a4a05ac2e47b41afb49b5304780a242e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:34.193429 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff1d7b-0988-4562-9739-a9a1da0c6b2e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:34.196166 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 131/263] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:33 2022] GET /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:34.202250 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff1d7b-0988-4562-9739-a9a1da0c6b2e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:34.297472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bbe77-2ae7-424e-801f-805e4d279dc9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:34.347858 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:34.357171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813bc1a-ed2b-45f2-b8f3-5eecb6a386ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:34.357783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813bc1a-ed2b-45f2-b8f3-5eecb6a386ac None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:34.358436 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813bc1a-ed2b-45f2-b8f3-5eecb6a386ac None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:34.358740 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813bc1a-ed2b-45f2-b8f3-5eecb6a386ac None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:34.359612 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813bc1a-ed2b-45f2-b8f3-5eecb6a386ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:34.359928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813bc1a-ed2b-45f2-b8f3-5eecb6a386ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:34.362703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813bc1a-ed2b-45f2-b8f3-5eecb6a386ac None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:34.379544 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 133/264] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:06:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:34.385322 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813bc1a-ed2b-45f2-b8f3-5eecb6a386ac None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:34.458761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:34.464817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff1d7b-0988-4562-9739-a9a1da0c6b2e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:34.551126 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813bc1a-ed2b-45f2-b8f3-5eecb6a386ac None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:34.555219 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb9165-2477-48d9-aafc-70d2c390eff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:34.555842 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb9165-2477-48d9-aafc-70d2c390eff9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:34.556124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb9165-2477-48d9-aafc-70d2c390eff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:34.556401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb9165-2477-48d9-aafc-70d2c390eff9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:34.557143 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb9165-2477-48d9-aafc-70d2c390eff9 None admin] RBAC: Adding query filter params (role.id=2613cf4a98d44744a094c7782b19b4b5, scope.project.id=a4a05ac2e47b41afb49b5304780a242e, user.id=d8b411d85dc4412297868efd3416ba96) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:34.557459 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb9165-2477-48d9-aafc-70d2c390eff9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:34.559379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb9165-2477-48d9-aafc-70d2c390eff9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:34.568217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 132/265] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:06:34 2022] GET /identity/v3/role_assignments?user.id=d8b411d85dc4412297868efd3416ba96&scope.project.id=a4a05ac2e47b41afb49b5304780a242e&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 608 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:34.591811 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bce7f-2034-4c92-b9f5-b7864c34290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:34.592461 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bce7f-2034-4c92-b9f5-b7864c34290a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:34.592754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bce7f-2034-4c92-b9f5-b7864c34290a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:34.593039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bce7f-2034-4c92-b9f5-b7864c34290a None admin] PATH_INFO: `/v3/users/d8b411d85dc4412297868efd3416ba96` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:34.594203 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bce7f-2034-4c92-b9f5-b7864c34290a None admin] RBAC: Authorizing `identity:get_user(user_id=d8b411d85dc4412297868efd3416ba96)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:34.595869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bce7f-2034-4c92-b9f5-b7864c34290a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:34.597801 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 134/266] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:34 2022] GET /identity/v3/users/d8b411d85dc4412297868efd3416ba96 => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:34.604468 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb9165-2477-48d9-aafc-70d2c390eff9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:34.724789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb9165-2477-48d9-aafc-70d2c390eff9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:34.749843 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:34.769842 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763af52-9639-43d1-ba4f-71c0788e80a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:34.770463 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763af52-9639-43d1-ba4f-71c0788e80a3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:34.770768 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763af52-9639-43d1-ba4f-71c0788e80a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:34.771049 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763af52-9639-43d1-ba4f-71c0788e80a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:34.852512 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763af52-9639-43d1-ba4f-71c0788e80a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:34.854273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763af52-9639-43d1-ba4f-71c0788e80a3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:35.002884 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 133/267] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:35.008656 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bce7f-2034-4c92-b9f5-b7864c34290a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:35.133405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bce7f-2034-4c92-b9f5-b7864c34290a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:35.147839 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:35.169667 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a7d3a-fbc6-4581-a3c4-db6486e9ee12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:35.170361 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a7d3a-fbc6-4581-a3c4-db6486e9ee12 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:35.170653 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a7d3a-fbc6-4581-a3c4-db6486e9ee12 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:35.171000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a7d3a-fbc6-4581-a3c4-db6486e9ee12 None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:35.172162 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a7d3a-fbc6-4581-a3c4-db6486e9ee12 None admin] RBAC: Authorizing `identity:get_project(project_id=a4a05ac2e47b41afb49b5304780a242e)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:35.173636 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a7d3a-fbc6-4581-a3c4-db6486e9ee12 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:35.175312 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 135/268] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:35 2022] GET /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:35.181361 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763af52-9639-43d1-ba4f-71c0788e80a3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:35.200700 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:35.300338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763af52-9639-43d1-ba4f-71c0788e80a3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:35.342378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b2c14-31a8-4d66-9302-1ebc4a51fbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:35.343090 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b2c14-31a8-4d66-9302-1ebc4a51fbe4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:35.343373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b2c14-31a8-4d66-9302-1ebc4a51fbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:35.343652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b2c14-31a8-4d66-9302-1ebc4a51fbe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:35.344423 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b2c14-31a8-4d66-9302-1ebc4a51fbe4 None admin] RBAC: Adding query filter params (role.id=9e2965c7d68d423a965894a8eb16903f, scope.project.id=a4a05ac2e47b41afb49b5304780a242e, user.id=d8b411d85dc4412297868efd3416ba96) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:35.344737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b2c14-31a8-4d66-9302-1ebc4a51fbe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:35.346236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b2c14-31a8-4d66-9302-1ebc4a51fbe4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:35.355786 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 134/269] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:06:35 2022] GET /identity/v3/role_assignments?user.id=d8b411d85dc4412297868efd3416ba96&scope.project.id=a4a05ac2e47b41afb49b5304780a242e&role.id=9e2965c7d68d423a965894a8eb16903f => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:35.470914 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dd0de-af51-405a-b54d-596588ade5bf None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:35.471257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dd0de-af51-405a-b54d-596588ade5bf None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:35.471485 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dd0de-af51-405a-b54d-596588ade5bf None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:35.472850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 136/270] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:35.479131 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115ec02-6272-42b2-855f-aaedfa456e2d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:35.479441 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115ec02-6272-42b2-855f-aaedfa456e2d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:35.479697 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115ec02-6272-42b2-855f-aaedfa456e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:35.502149 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c115ec02-6272-42b2-855f-aaedfa456e2d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:35.503451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c115ec02-6272-42b2-855f-aaedfa456e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:35.599835 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 135/271] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:35.642698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f95bd1-f2a6-41fd-9a7f-3a12d7bdf3ae None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:35.643024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f95bd1-f2a6-41fd-9a7f-3a12d7bdf3ae None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:35.643304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f95bd1-f2a6-41fd-9a7f-3a12d7bdf3ae None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:35.645710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 137/272] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:35.654187 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5c8f1-f93b-476e-b8e4-d3bb93962bff None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:35.654187 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5c8f1-f93b-476e-b8e4-d3bb93962bff None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:35.654187 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5c8f1-f93b-476e-b8e4-d3bb93962bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:35.671858 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-64b5c8f1-f93b-476e-b8e4-d3bb93962bff None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:35.673297 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-64b5c8f1-f93b-476e-b8e4-d3bb93962bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:35.681877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:35.748534 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 136/273] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:35.935048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d52b10-102b-4ead-97c6-5d3e2319ef95 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:35.935339 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d52b10-102b-4ead-97c6-5d3e2319ef95 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:35.935622 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d52b10-102b-4ead-97c6-5d3e2319ef95 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:35.936971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 138/274] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:35.942093 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cb675-2ca5-4db0-99d3-11ecb0f15892 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:35.942618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cb675-2ca5-4db0-99d3-11ecb0f15892 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:35.943110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cb675-2ca5-4db0-99d3-11ecb0f15892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:35.949890 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d52b10-102b-4ead-97c6-5d3e2319ef95 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:35.964937 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-390cb675-2ca5-4db0-99d3-11ecb0f15892 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:35.966456 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-390cb675-2ca5-4db0-99d3-11ecb0f15892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:36.053568 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 137/275] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:36.055543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cb675-2ca5-4db0-99d3-11ecb0f15892 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:36.110652 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d52b10-102b-4ead-97c6-5d3e2319ef95 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:36.142444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:36.155320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdac94f-cba2-42eb-bb8d-9be03dd4c3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:36.155956 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdac94f-cba2-42eb-bb8d-9be03dd4c3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:36.156243 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdac94f-cba2-42eb-bb8d-9be03dd4c3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:36.156523 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdac94f-cba2-42eb-bb8d-9be03dd4c3c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:36.169622 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdac94f-cba2-42eb-bb8d-9be03dd4c3c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:36.177677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cb675-2ca5-4db0-99d3-11ecb0f15892 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:36.178413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-abdac94f-cba2-42eb-bb8d-9be03dd4c3c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:36.178413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:36.178413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:36.178413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:36.178413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:36.178413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:36.178413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:36.178413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:36.178413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:36.178413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:36.178413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:36.178413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:36.178413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:36.178413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:36.178413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:36.178413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:36.179499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:36.179499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:36.179499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:36.179499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:36.179499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:36.179499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:36.179499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:36.179499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:36.179499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:36.179499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:36.179499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:36.179499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:36.179499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:36.179499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:36.179499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:36.179499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:36.180382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:36.180382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:36.180382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:36.180382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:36.180382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:36.180382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:36.180382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:36.180382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:36.180382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:36.180382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:36.180382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:36.180382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:36.180382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 139/276] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:06:36.188715 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdac94f-cba2-42eb-bb8d-9be03dd4c3c9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:36.220621 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4bb93-0a4a-4fbb-be3b-835680e34be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:36.221590 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4bb93-0a4a-4fbb-be3b-835680e34be7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:36.222065 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4bb93-0a4a-4fbb-be3b-835680e34be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:36.222556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4bb93-0a4a-4fbb-be3b-835680e34be7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:36.223953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4bb93-0a4a-4fbb-be3b-835680e34be7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:36.225606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4bb93-0a4a-4fbb-be3b-835680e34be7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:36.228130 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 138/277] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:06:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:36.238149 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4bb93-0a4a-4fbb-be3b-835680e34be7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:36.250931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:36.318176 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdac94f-cba2-42eb-bb8d-9be03dd4c3c9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:36.358344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd843a2-c575-462f-beaa-c3f4ba9a6d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:36.358995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd843a2-c575-462f-beaa-c3f4ba9a6d65 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:36.359278 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd843a2-c575-462f-beaa-c3f4ba9a6d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:36.359554 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd843a2-c575-462f-beaa-c3f4ba9a6d65 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:36.360283 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd843a2-c575-462f-beaa-c3f4ba9a6d65 None admin] RBAC: Adding query filter params (name=member) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:36.360590 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd843a2-c575-462f-beaa-c3f4ba9a6d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:36.361964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd843a2-c575-462f-beaa-c3f4ba9a6d65 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:36.376231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 140/278] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:36.376231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd843a2-c575-462f-beaa-c3f4ba9a6d65 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:36.386574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4bb93-0a4a-4fbb-be3b-835680e34be7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:36.430386 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404d535-0b04-4746-b56d-d65a376d86cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:36.431139 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404d535-0b04-4746-b56d-d65a376d86cd None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:36.431486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404d535-0b04-4746-b56d-d65a376d86cd None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:36.431847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404d535-0b04-4746-b56d-d65a376d86cd None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:36.432566 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404d535-0b04-4746-b56d-d65a376d86cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:36.434330 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404d535-0b04-4746-b56d-d65a376d86cd None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:36.448486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:36.467199 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 139/279] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 27 04:06:36 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:06:36.468356 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404d535-0b04-4746-b56d-d65a376d86cd None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:36.503832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd843a2-c575-462f-beaa-c3f4ba9a6d65 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:36.508289 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:36.555730 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aeb3b3-615f-48d7-b359-b3e9c0ad701b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:36.556766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aeb3b3-615f-48d7-b359-b3e9c0ad701b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:36.557233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aeb3b3-615f-48d7-b359-b3e9c0ad701b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:36.557720 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aeb3b3-615f-48d7-b359-b3e9c0ad701b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:36.571238 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aeb3b3-615f-48d7-b359-b3e9c0ad701b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:36.577495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-b7aeb3b3-615f-48d7-b359-b3e9c0ad701b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:06:36.577495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:36.577495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:36.577495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:36.577495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:36.577495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:36.577495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:36.577495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:36.577495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:36.577495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:36.577495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:36.577495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:36.577495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:36.577495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:36.577495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:36.577495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:36.578453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:36.578453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:36.578453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:36.578453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:36.578453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:36.578453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:36.578453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:36.578453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:36.578453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:36.578453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:36.578453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:36.578453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:36.578453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:36.578453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:36.578453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:36.578453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:36.579286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:36.579286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:36.579286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:36.579286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:36.579286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:36.579286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:36.579286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:36.579286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:36.579286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:36.579286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:36.579286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:06:36.579286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:36.581468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 141/280] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:36.587905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aeb3b3-615f-48d7-b359-b3e9c0ad701b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:36.596591 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404d535-0b04-4746-b56d-d65a376d86cd None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:36.644608 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41577c-5f9c-4886-a609-71b302ca8c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:36.645639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41577c-5f9c-4886-a609-71b302ca8c57 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:36.646137 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41577c-5f9c-4886-a609-71b302ca8c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:36.646608 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41577c-5f9c-4886-a609-71b302ca8c57 None admin] PATH_INFO: `/v3/users/aba90dad94354db0aeca6b2f72453e20` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:36.665072 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41577c-5f9c-4886-a609-71b302ca8c57 None admin] RBAC: Authorizing `identity:get_user(user_id=aba90dad94354db0aeca6b2f72453e20)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:36.666563 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41577c-5f9c-4886-a609-71b302ca8c57 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:36.668638 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 140/281] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:36 2022] GET /identity/v3/users/aba90dad94354db0aeca6b2f72453e20 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:36.674528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41577c-5f9c-4886-a609-71b302ca8c57 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:36.725718 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aeb3b3-615f-48d7-b359-b3e9c0ad701b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:36.743090 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:36.771081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8dd82-8392-4da8-a258-3a7985fd9065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:36.771995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8dd82-8392-4da8-a258-3a7985fd9065 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:36.772455 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8dd82-8392-4da8-a258-3a7985fd9065 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:36.773529 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8dd82-8392-4da8-a258-3a7985fd9065 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:36.774385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8dd82-8392-4da8-a258-3a7985fd9065 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:36.774912 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8dd82-8392-4da8-a258-3a7985fd9065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:36.776498 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8dd82-8392-4da8-a258-3a7985fd9065 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:36.786000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 142/282] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:36.792020 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8dd82-8392-4da8-a258-3a7985fd9065 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:36.799537 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41577c-5f9c-4886-a609-71b302ca8c57 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:36.830648 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:36.853500 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43e9a1-5e3e-4bde-8bda-07edeb217d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:36.854126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43e9a1-5e3e-4bde-8bda-07edeb217d1c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:36.854411 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43e9a1-5e3e-4bde-8bda-07edeb217d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:36.854689 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43e9a1-5e3e-4bde-8bda-07edeb217d1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:36.855465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43e9a1-5e3e-4bde-8bda-07edeb217d1c None admin] RBAC: Adding query filter params (role.id=71cc6516aeff47eea3961db1a3d57f21, user.id=aba90dad94354db0aeca6b2f72453e20, scope.system=all) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:36.855780 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43e9a1-5e3e-4bde-8bda-07edeb217d1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:36.857505 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43e9a1-5e3e-4bde-8bda-07edeb217d1c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:36.864786 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 141/283] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Sep 27 04:06:36 2022] GET /identity/v3/role_assignments?user.id=aba90dad94354db0aeca6b2f72453e20&scope.system=all&role.id=71cc6516aeff47eea3961db1a3d57f21 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:36.923828 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8dd82-8392-4da8-a258-3a7985fd9065 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:36.943502 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b23b3-078a-486f-b6c8-4f96c7baff63 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:36.943825 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b23b3-078a-486f-b6c8-4f96c7baff63 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:36.944057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b23b3-078a-486f-b6c8-4f96c7baff63 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:36.946067 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 142/284] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:06:36.952086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fef9e6-ea2c-496f-af47-11088e3764e5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:36.952406 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fef9e6-ea2c-496f-af47-11088e3764e5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:36.952661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fef9e6-ea2c-496f-af47-11088e3764e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:36.972905 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c8fef9e6-ea2c-496f-af47-11088e3764e5 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:36.973095 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a065e5c-3d17-4723-81d1-71776b7747ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:36.973554 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a065e5c-3d17-4723-81d1-71776b7747ec None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:36.973838 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a065e5c-3d17-4723-81d1-71776b7747ec None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:36.974118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a065e5c-3d17-4723-81d1-71776b7747ec None admin] PATH_INFO: `/v3/users/f36541fffeef45ffa536eeb75b2c9248` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:36.974219 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c8fef9e6-ea2c-496f-af47-11088e3764e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:36.975430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a065e5c-3d17-4723-81d1-71776b7747ec None admin] RBAC: Authorizing `identity:get_user(user_id=f36541fffeef45ffa536eeb75b2c9248)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:36.977091 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a065e5c-3d17-4723-81d1-71776b7747ec None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:36.979472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 143/285] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:36 2022] GET /identity/v3/users/f36541fffeef45ffa536eeb75b2c9248 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:36.985075 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a065e5c-3d17-4723-81d1-71776b7747ec None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:37.073239 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 143/286] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:06:37.101961 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:37.109370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a065e5c-3d17-4723-81d1-71776b7747ec None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:37.147308 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfb706-ff72-418d-b5df-fe038cccfc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:37.148099 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfb706-ff72-418d-b5df-fe038cccfc83 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:37.148307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfb706-ff72-418d-b5df-fe038cccfc83 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:37.148581 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfb706-ff72-418d-b5df-fe038cccfc83 None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:37.149754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfb706-ff72-418d-b5df-fe038cccfc83 None admin] RBAC: Authorizing `identity:get_project(project_id=a4a05ac2e47b41afb49b5304780a242e)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:37.151326 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfb706-ff72-418d-b5df-fe038cccfc83 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:37.153290 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 144/287] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:36 2022] GET /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:37.158659 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fef9e6-ea2c-496f-af47-11088e3764e5 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:37.214326 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:37.267597 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fef9e6-ea2c-496f-af47-11088e3764e5 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:37.301988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98840db3-6097-4124-a0b4-90608a171707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:37.302660 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98840db3-6097-4124-a0b4-90608a171707 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:37.302971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98840db3-6097-4124-a0b4-90608a171707 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:37.303250 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98840db3-6097-4124-a0b4-90608a171707 None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e/users/f36541fffeef45ffa536eeb75b2c9248/roles/d8b538ae7b664438823dd39746467d37` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:37.305833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98840db3-6097-4124-a0b4-90608a171707 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4a05ac2e47b41afb49b5304780a242e, user_id=f36541fffeef45ffa536eeb75b2c9248, role_id=d8b538ae7b664438823dd39746467d37)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:37.307317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98840db3-6097-4124-a0b4-90608a171707 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:37.332805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 144/288] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:06:37 2022] PUT /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e/users/f36541fffeef45ffa536eeb75b2c9248/roles/d8b538ae7b664438823dd39746467d37 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:06:37.388405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfb706-ff72-418d-b5df-fe038cccfc83 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:37.540674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfb706-ff72-418d-b5df-fe038cccfc83 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:37.584403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fd295-d953-42e6-96a5-3c209844cdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:37.585044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fd295-d953-42e6-96a5-3c209844cdd8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:37.585487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fd295-d953-42e6-96a5-3c209844cdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:37.586266 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fd295-d953-42e6-96a5-3c209844cdd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:37.599688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fd295-d953-42e6-96a5-3c209844cdd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:37.605385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-8a9fd295-d953-42e6-96a5-3c209844cdd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:37.605385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:37.605385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:37.605385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:37.605385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:37.605385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:37.605385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:37.605385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:37.605385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:37.605385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:37.605385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:37.605385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:37.605385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:37.605385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:37.605385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:37.605385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:37.606296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:37.606296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:37.606296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:37.606296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:37.606296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:37.606296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:37.606296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:37.606296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:37.606296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:37.606296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:37.606296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:37.606296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:37.606296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:37.606296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:37.606296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:37.606296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:37.607217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:37.607217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:37.607217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:37.607217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:37.607217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:37.607217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:37.607217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:37.607217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:37.607217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:37.607217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:37.607217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:37.607217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:37.608328 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 145/289] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:37.614304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98840db3-6097-4124-a0b4-90608a171707 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:37.740424 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98840db3-6097-4124-a0b4-90608a171707 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:37.752300 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:37.785421 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a68cf8-4f7e-4ca1-b746-1040a11a2de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:37.786056 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a68cf8-4f7e-4ca1-b746-1040a11a2de6 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:37.786338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a68cf8-4f7e-4ca1-b746-1040a11a2de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:37.786615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a68cf8-4f7e-4ca1-b746-1040a11a2de6 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:37.787334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a68cf8-4f7e-4ca1-b746-1040a11a2de6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:37.787641 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a68cf8-4f7e-4ca1-b746-1040a11a2de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:37.789091 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a68cf8-4f7e-4ca1-b746-1040a11a2de6 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:37.802357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 145/290] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:37.808500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fd295-d953-42e6-96a5-3c209844cdd8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:37.845148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:37.936446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fd295-d953-42e6-96a5-3c209844cdd8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:37.983754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675c118-5ed2-4893-b061-188de19321ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:37.984477 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675c118-5ed2-4893-b061-188de19321ed None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:37.984764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675c118-5ed2-4893-b061-188de19321ed None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:37.985045 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675c118-5ed2-4893-b061-188de19321ed None admin] PATH_INFO: `/v3/users/f21939f8cfa94802a5524b5bf3f63a2c` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:37.986280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675c118-5ed2-4893-b061-188de19321ed None admin] RBAC: Authorizing `identity:get_user(user_id=f21939f8cfa94802a5524b5bf3f63a2c)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:37.987858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675c118-5ed2-4893-b061-188de19321ed None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:37.989762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 146/291] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:37 2022] GET /identity/v3/users/f21939f8cfa94802a5524b5bf3f63a2c => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:37.996501 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a68cf8-4f7e-4ca1-b746-1040a11a2de6 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:38.148221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a68cf8-4f7e-4ca1-b746-1040a11a2de6 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:38.197268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2899f-842b-4974-8ff4-cd22ec148589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:38.197884 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2899f-842b-4974-8ff4-cd22ec148589 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:38.198167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2899f-842b-4974-8ff4-cd22ec148589 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:38.198440 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2899f-842b-4974-8ff4-cd22ec148589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:38.244347 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:38.280782 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2899f-842b-4974-8ff4-cd22ec148589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:38.282311 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2899f-842b-4974-8ff4-cd22ec148589 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:38.423004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 146/292] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:38.428976 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675c118-5ed2-4893-b061-188de19321ed None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:38.553932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:38.573236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675c118-5ed2-4893-b061-188de19321ed None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:38.623177 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce8ae9-8b29-47b4-ae4d-18f5994fc8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:38.623810 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce8ae9-8b29-47b4-ae4d-18f5994fc8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:38.624094 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce8ae9-8b29-47b4-ae4d-18f5994fc8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:38.624371 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce8ae9-8b29-47b4-ae4d-18f5994fc8c3 None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:38.625504 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce8ae9-8b29-47b4-ae4d-18f5994fc8c3 None admin] RBAC: Authorizing `identity:get_project(project_id=a4a05ac2e47b41afb49b5304780a242e)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:38.626996 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce8ae9-8b29-47b4-ae4d-18f5994fc8c3 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:38.628937 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 147/293] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:38 2022] GET /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:38.635396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2899f-842b-4974-8ff4-cd22ec148589 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:38.727633 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:38.764478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2899f-842b-4974-8ff4-cd22ec148589 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:38.797458 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcad4ba-4ba8-4d6d-ae7a-fb43c3905580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:38.798285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcad4ba-4ba8-4d6d-ae7a-fb43c3905580 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:38.798707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcad4ba-4ba8-4d6d-ae7a-fb43c3905580 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:38.799141 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcad4ba-4ba8-4d6d-ae7a-fb43c3905580 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:38.800021 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcad4ba-4ba8-4d6d-ae7a-fb43c3905580 None admin] RBAC: Adding query filter params (role.id=71cc6516aeff47eea3961db1a3d57f21, scope.project.id=a4a05ac2e47b41afb49b5304780a242e, user.id=f21939f8cfa94802a5524b5bf3f63a2c) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:38.800499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcad4ba-4ba8-4d6d-ae7a-fb43c3905580 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:38.802051 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcad4ba-4ba8-4d6d-ae7a-fb43c3905580 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:38.809039 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 147/294] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:06:38 2022] GET /identity/v3/role_assignments?user.id=f21939f8cfa94802a5524b5bf3f63a2c&scope.project.id=a4a05ac2e47b41afb49b5304780a242e&role.id=71cc6516aeff47eea3961db1a3d57f21 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:39.372525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64982d-ed88-45bc-9165-5adee648904d None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:39.372809 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64982d-ed88-45bc-9165-5adee648904d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:39.373275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64982d-ed88-45bc-9165-5adee648904d None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:39.375043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 148/295] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:39.380542 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89572b-6639-44c0-8952-a9a979dbdba4 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:39.380991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89572b-6639-44c0-8952-a9a979dbdba4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:39.381173 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89572b-6639-44c0-8952-a9a979dbdba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:39.412675 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-fd89572b-6639-44c0-8952-a9a979dbdba4 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:39.414230 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fd89572b-6639-44c0-8952-a9a979dbdba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:39.499856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 148/296] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:06:39.612450 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779630e-8c22-4813-a484-455f80158469 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:39.613426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779630e-8c22-4813-a484-455f80158469 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:39.613906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779630e-8c22-4813-a484-455f80158469 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:39.615717 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 149/297] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:39.621009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1a2c5-eef4-4580-8799-ff5480ad997e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:39.621545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1a2c5-eef4-4580-8799-ff5480ad997e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:39.622025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1a2c5-eef4-4580-8799-ff5480ad997e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:39.641295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1aa1a2c5-eef4-4580-8799-ff5480ad997e None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:39.642845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1aa1a2c5-eef4-4580-8799-ff5480ad997e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:39.665773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbbd79-3294-46bd-b6a7-d3f9e76fb9c6 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:39.666330 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbbd79-3294-46bd-b6a7-d3f9e76fb9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:39.666853 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbbd79-3294-46bd-b6a7-d3f9e76fb9c6 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:39.668454 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 150/298] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:06:39.673574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904edca6-eb31-42a0-ac43-1bf5204ecb08 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:39.673970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904edca6-eb31-42a0-ac43-1bf5204ecb08 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:39.674458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904edca6-eb31-42a0-ac43-1bf5204ecb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:39.693704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-904edca6-eb31-42a0-ac43-1bf5204ecb08 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:39.696191 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-904edca6-eb31-42a0-ac43-1bf5204ecb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:39.707489 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:39.717902 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 149/299] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:39.773605 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 151/300] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:06:39.803326 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1a2c5-eef4-4580-8799-ff5480ad997e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:39.915331 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1a2c5-eef4-4580-8799-ff5480ad997e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:39.924556 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25715a75-1aea-4c49-a4e9-476513e36d2f None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:39.925123 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25715a75-1aea-4c49-a4e9-476513e36d2f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:39.925604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25715a75-1aea-4c49-a4e9-476513e36d2f None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:39.927430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 152/301] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:39.933078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2b452-fcbd-4beb-8583-4e7516997c25 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:39.933613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2b452-fcbd-4beb-8583-4e7516997c25 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:39.934110 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2b452-fcbd-4beb-8583-4e7516997c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:39.951265 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523a789-1720-4b52-9de1-e0cf43ffd5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:39.951893 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523a789-1720-4b52-9de1-e0cf43ffd5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:39.952176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523a789-1720-4b52-9de1-e0cf43ffd5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:39.952448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523a789-1720-4b52-9de1-e0cf43ffd5b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:39.953256 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-48b2b452-fcbd-4beb-8583-4e7516997c25 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:39.954656 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-48b2b452-fcbd-4beb-8583-4e7516997c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:39.963544 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523a789-1720-4b52-9de1-e0cf43ffd5b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:39.968680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-0523a789-1720-4b52-9de1-e0cf43ffd5b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:06:39.968680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:39.968680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:39.968680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:39.968680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:39.968680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:39.968680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:39.968680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:39.968680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:39.968680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:39.968680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:39.968680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:39.968680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:39.968680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:39.968680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:39.968680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:39.969575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:39.969575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:39.969575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:39.969575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:39.969575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:39.969575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:39.969575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:39.969575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:39.969575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:39.969575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:39.969575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:39.969575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:39.969575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:39.969575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:39.969575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:39.969575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:39.970401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:39.970401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:39.970401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:39.970401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:39.970401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:39.970401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:39.970401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:39.970401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:39.970401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:39.970401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:39.970401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:06:39.970401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:06:39.970401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 150/302] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:39.978470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523a789-1720-4b52-9de1-e0cf43ffd5b1 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:40.039639 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 153/303] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:06:40.039639 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2b452-fcbd-4beb-8583-4e7516997c25 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:40.043200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:40.063170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:40.093426 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523a789-1720-4b52-9de1-e0cf43ffd5b1 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:40.130213 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc61cf-3afb-4297-a60d-61cce855ff96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:40.130994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc61cf-3afb-4297-a60d-61cce855ff96 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:40.131275 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc61cf-3afb-4297-a60d-61cce855ff96 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:40.131547 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc61cf-3afb-4297-a60d-61cce855ff96 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:40.132831 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc61cf-3afb-4297-a60d-61cce855ff96 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:40.133142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc61cf-3afb-4297-a60d-61cce855ff96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:40.134508 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc61cf-3afb-4297-a60d-61cce855ff96 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:40.142399 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 151/304] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:40.143230 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc61cf-3afb-4297-a60d-61cce855ff96 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:40.157781 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2b452-fcbd-4beb-8583-4e7516997c25 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:40.193672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ae888-19e8-4dad-bfae-1312ebd96907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:40.194226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ae888-19e8-4dad-bfae-1312ebd96907 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:40.194505 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ae888-19e8-4dad-bfae-1312ebd96907 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:40.195667 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ae888-19e8-4dad-bfae-1312ebd96907 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:40.208976 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ae888-19e8-4dad-bfae-1312ebd96907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:40.213886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-e80ae888-19e8-4dad-bfae-1312ebd96907 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:40.213886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:40.213886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:40.213886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:40.213886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:40.213886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:40.213886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:40.213886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:40.213886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:40.213886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:40.213886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:40.213886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:40.213886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:40.213886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:40.213886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:40.213886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:40.215010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:40.215010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:40.215010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:40.215010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:40.215010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:40.215010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:40.215010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:40.215010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:40.215010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:40.215010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:40.215010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:40.215010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:40.215010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:40.215010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:40.215010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:40.215010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:40.216366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:40.216366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:40.216366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:40.216366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:40.216366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:40.216366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:40.216366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:40.216366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:40.216366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:40.216366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:40.216366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:40.216366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:40.216366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 154/305] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:40.216366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ae888-19e8-4dad-bfae-1312ebd96907 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:40.260194 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc61cf-3afb-4297-a60d-61cce855ff96 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:40.277734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:40.297406 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32fb1a-ef3a-4106-a1d1-0cffe35952a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:40.298036 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32fb1a-ef3a-4106-a1d1-0cffe35952a4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:40.298503 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32fb1a-ef3a-4106-a1d1-0cffe35952a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:40.298820 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32fb1a-ef3a-4106-a1d1-0cffe35952a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:40.299901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:40.300014 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32fb1a-ef3a-4106-a1d1-0cffe35952a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:40.301618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32fb1a-ef3a-4106-a1d1-0cffe35952a4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:40.303292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 152/306] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:06:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:40.304498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32fb1a-ef3a-4106-a1d1-0cffe35952a4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:40.326823 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ae888-19e8-4dad-bfae-1312ebd96907 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:40.359741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192229fc-577e-4691-9e5c-b886ede748ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:40.360362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192229fc-577e-4691-9e5c-b886ede748ee None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:40.360645 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192229fc-577e-4691-9e5c-b886ede748ee None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:40.360920 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192229fc-577e-4691-9e5c-b886ede748ee None admin] PATH_INFO: `/v3/users/8a8ee57d27e9418da6f7ef4d676b916b` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:40.374179 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192229fc-577e-4691-9e5c-b886ede748ee None admin] RBAC: Authorizing `identity:get_user(user_id=8a8ee57d27e9418da6f7ef4d676b916b)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:40.375695 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192229fc-577e-4691-9e5c-b886ede748ee None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:40.377287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 155/307] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:40 2022] GET /identity/v3/users/8a8ee57d27e9418da6f7ef4d676b916b => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:40.378048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192229fc-577e-4691-9e5c-b886ede748ee None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:40.416471 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32fb1a-ef3a-4106-a1d1-0cffe35952a4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:40.450901 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bee6e-4abc-4f05-b8c0-c8ef2621f830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:40.451440 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bee6e-4abc-4f05-b8c0-c8ef2621f830 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:40.451722 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bee6e-4abc-4f05-b8c0-c8ef2621f830 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:40.451996 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bee6e-4abc-4f05-b8c0-c8ef2621f830 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:40.452672 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bee6e-4abc-4f05-b8c0-c8ef2621f830 None admin] RBAC: Adding query filter params (name=member) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:40.452977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bee6e-4abc-4f05-b8c0-c8ef2621f830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:40.454350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bee6e-4abc-4f05-b8c0-c8ef2621f830 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:40.462167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 153/308] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:40.462962 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bee6e-4abc-4f05-b8c0-c8ef2621f830 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:40.477112 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192229fc-577e-4691-9e5c-b886ede748ee None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:40.509342 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:40.510636 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cda19-975d-483e-8c8a-367838fe407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:40.511359 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cda19-975d-483e-8c8a-367838fe407a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:40.511678 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cda19-975d-483e-8c8a-367838fe407a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:40.512106 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cda19-975d-483e-8c8a-367838fe407a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:40.514625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:40.522811 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cda19-975d-483e-8c8a-367838fe407a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:40.527541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-d30cda19-975d-483e-8c8a-367838fe407a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:06:40.527541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:40.527541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:40.527541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:40.527541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:40.527541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:40.527541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:40.527541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:40.527541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:40.527541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:40.527541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:40.527541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:40.527541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:40.527541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:40.527541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:40.527541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:40.528472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:40.528472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:40.528472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:40.528472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:40.528472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:40.528472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:40.528472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:40.528472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:40.528472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:40.528472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:40.528472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:40.528472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:40.528472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:40.528472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:40.528472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:40.528472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:40.529268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:40.529268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:40.529268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:40.529268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:40.529268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:40.529268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:40.529268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:40.529268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:40.529268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:40.529268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:40.529268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:06:40.529268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:40.529268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 156/309] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:40.529932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cda19-975d-483e-8c8a-367838fe407a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:40.565650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bee6e-4abc-4f05-b8c0-c8ef2621f830 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:40.599064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c57f9-b316-4d03-8ec4-6a5e2857755a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:40.600406 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c57f9-b316-4d03-8ec4-6a5e2857755a None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:40.600688 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c57f9-b316-4d03-8ec4-6a5e2857755a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:40.601499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c57f9-b316-4d03-8ec4-6a5e2857755a None admin] PATH_INFO: `/v3/groups` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:40.602131 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c57f9-b316-4d03-8ec4-6a5e2857755a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:40.603844 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c57f9-b316-4d03-8ec4-6a5e2857755a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:40.619153 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 154/310] 10.222.0.48 () {60 vars in 1134 bytes} [Tue Sep 27 04:06:40 2022] POST /identity/v3/groups => generated 229 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:06:40.624066 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c57f9-b316-4d03-8ec4-6a5e2857755a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:40.630709 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cda19-975d-483e-8c8a-367838fe407a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:40.676970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ecd00-cf0c-426a-af7e-1c79782076aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:40.677603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ecd00-cf0c-426a-af7e-1c79782076aa None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:40.678017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ecd00-cf0c-426a-af7e-1c79782076aa None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:40.678297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ecd00-cf0c-426a-af7e-1c79782076aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:40.679197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ecd00-cf0c-426a-af7e-1c79782076aa None admin] RBAC: Adding query filter params (role.id=d8b538ae7b664438823dd39746467d37, user.id=8a8ee57d27e9418da6f7ef4d676b916b, scope.system=all) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:40.680026 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ecd00-cf0c-426a-af7e-1c79782076aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:40.681556 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ecd00-cf0c-426a-af7e-1c79782076aa None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:40.699034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 157/311] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Sep 27 04:06:40 2022] GET /identity/v3/role_assignments?user.id=8a8ee57d27e9418da6f7ef4d676b916b&scope.system=all&role.id=d8b538ae7b664438823dd39746467d37 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:40.699034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ecd00-cf0c-426a-af7e-1c79782076aa None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:40.763811 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:40.777363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c57f9-b316-4d03-8ec4-6a5e2857755a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:40.795136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:40.817948 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ecd00-cf0c-426a-af7e-1c79782076aa None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:40.832967 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c450b58-9d6a-4cc6-ac61-47201dffb7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:40.833799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c450b58-9d6a-4cc6-ac61-47201dffb7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:40.834134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c450b58-9d6a-4cc6-ac61-47201dffb7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:40.834362 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c450b58-9d6a-4cc6-ac61-47201dffb7a0 None admin] PATH_INFO: `/v3/users/aba90dad94354db0aeca6b2f72453e20` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:40.836343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c450b58-9d6a-4cc6-ac61-47201dffb7a0 None admin] RBAC: Authorizing `identity:get_user(user_id=aba90dad94354db0aeca6b2f72453e20)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:40.838627 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c450b58-9d6a-4cc6-ac61-47201dffb7a0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:40.841609 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 155/312] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:40 2022] GET /identity/v3/users/aba90dad94354db0aeca6b2f72453e20 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:40.848616 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c450b58-9d6a-4cc6-ac61-47201dffb7a0 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:40.861227 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9ebc8-913a-4f54-a6fa-4982ea3df5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:40.864161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9ebc8-913a-4f54-a6fa-4982ea3df5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:40.865093 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9ebc8-913a-4f54-a6fa-4982ea3df5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:40.865093 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9ebc8-913a-4f54-a6fa-4982ea3df5c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:40.865405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9ebc8-913a-4f54-a6fa-4982ea3df5c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:40.865711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9ebc8-913a-4f54-a6fa-4982ea3df5c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:40.867216 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9ebc8-913a-4f54-a6fa-4982ea3df5c5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:40.877224 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 158/313] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:40.882919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9ebc8-913a-4f54-a6fa-4982ea3df5c5 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:40.967425 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c450b58-9d6a-4cc6-ac61-47201dffb7a0 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:41.002441 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbb63a-3330-485d-9a4d-fb1ae938b0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:41.003298 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbb63a-3330-485d-9a4d-fb1ae938b0c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:41.003685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbb63a-3330-485d-9a4d-fb1ae938b0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:41.004067 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbb63a-3330-485d-9a4d-fb1ae938b0c5 None admin] PATH_INFO: `/v3/system/users/aba90dad94354db0aeca6b2f72453e20/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:41.005658 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbb63a-3330-485d-9a4d-fb1ae938b0c5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aba90dad94354db0aeca6b2f72453e20, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:41.007235 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbb63a-3330-485d-9a4d-fb1ae938b0c5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:41.010985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9ebc8-913a-4f54-a6fa-4982ea3df5c5 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:41.018378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 156/314] 10.222.0.48 () {58 vars in 1334 bytes} [Tue Sep 27 04:06:40 2022] PUT /identity/v3/system/users/aba90dad94354db0aeca6b2f72453e20/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:06:41.048191 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:41.063293 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a83ee4-698e-4439-bad1-9f12e6f7ff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:41.064040 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a83ee4-698e-4439-bad1-9f12e6f7ff97 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:41.064333 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a83ee4-698e-4439-bad1-9f12e6f7ff97 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:41.064614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a83ee4-698e-4439-bad1-9f12e6f7ff97 None admin] PATH_INFO: `/v3/users/f36541fffeef45ffa536eeb75b2c9248` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:41.065953 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a83ee4-698e-4439-bad1-9f12e6f7ff97 None admin] RBAC: Authorizing `identity:get_user(user_id=f36541fffeef45ffa536eeb75b2c9248)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:41.067586 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a83ee4-698e-4439-bad1-9f12e6f7ff97 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:41.069803 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 159/315] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:40 2022] GET /identity/v3/users/f36541fffeef45ffa536eeb75b2c9248 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:41.075132 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbb63a-3330-485d-9a4d-fb1ae938b0c5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:41.121802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:41.190774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbb63a-3330-485d-9a4d-fb1ae938b0c5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:41.232844 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3bff6-7553-4566-98e2-954c0ed6e4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:41.233470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3bff6-7553-4566-98e2-954c0ed6e4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:41.233761 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3bff6-7553-4566-98e2-954c0ed6e4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:41.234041 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3bff6-7553-4566-98e2-954c0ed6e4d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:41.306450 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3bff6-7553-4566-98e2-954c0ed6e4d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:41.307876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3bff6-7553-4566-98e2-954c0ed6e4d9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:41.346967 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:41.414511 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 157/316] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:41.426773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a83ee4-698e-4439-bad1-9f12e6f7ff97 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:41.528964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a83ee4-698e-4439-bad1-9f12e6f7ff97 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:41.565504 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c47c86-774c-4632-bf61-b3cb0a46c61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:41.566068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c47c86-774c-4632-bf61-b3cb0a46c61d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:41.566354 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c47c86-774c-4632-bf61-b3cb0a46c61d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:41.566658 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c47c86-774c-4632-bf61-b3cb0a46c61d None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:41.567894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c47c86-774c-4632-bf61-b3cb0a46c61d None admin] RBAC: Authorizing `identity:get_project(project_id=a4a05ac2e47b41afb49b5304780a242e)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:41.569387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c47c86-774c-4632-bf61-b3cb0a46c61d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:41.571735 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 160/317] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:41 2022] GET /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:41.577876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3bff6-7553-4566-98e2-954c0ed6e4d9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:41.687608 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3bff6-7553-4566-98e2-954c0ed6e4d9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:41.722514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f33a2b-4db3-4560-a6ac-f46e01064c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:41.723157 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f33a2b-4db3-4560-a6ac-f46e01064c85 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:41.723446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f33a2b-4db3-4560-a6ac-f46e01064c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:41.723725 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f33a2b-4db3-4560-a6ac-f46e01064c85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:41.724467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f33a2b-4db3-4560-a6ac-f46e01064c85 None admin] RBAC: Adding query filter params (role.id=d8b538ae7b664438823dd39746467d37, scope.project.id=a4a05ac2e47b41afb49b5304780a242e, user.id=f36541fffeef45ffa536eeb75b2c9248) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:41.724782 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f33a2b-4db3-4560-a6ac-f46e01064c85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:41.727161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f33a2b-4db3-4560-a6ac-f46e01064c85 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:41.733640 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 158/318] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:06:41 2022] GET /identity/v3/role_assignments?user.id=f36541fffeef45ffa536eeb75b2c9248&scope.project.id=a4a05ac2e47b41afb49b5304780a242e&role.id=d8b538ae7b664438823dd39746467d37 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:42.849905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7a5e-6df2-4f38-845d-ddf9fb4fe874 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:42.850417 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7a5e-6df2-4f38-845d-ddf9fb4fe874 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:42.850492 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7a5e-6df2-4f38-845d-ddf9fb4fe874 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:42.852050 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 161/319] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:42.857608 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc7333-f38e-4891-834a-bbe7d02b7842 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:42.858050 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc7333-f38e-4891-834a-bbe7d02b7842 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:42.858218 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc7333-f38e-4891-834a-bbe7d02b7842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:42.864594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:42.877418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-acfc7333-f38e-4891-834a-bbe7d02b7842 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:42.878593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-acfc7333-f38e-4891-834a-bbe7d02b7842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:42.906990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d672f62-6a93-4d20-b975-fb5fc848b2c9 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:42.907278 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d672f62-6a93-4d20-b975-fb5fc848b2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:42.907491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d672f62-6a93-4d20-b975-fb5fc848b2c9 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:42.908835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 162/320] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:06:42.914203 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b736c-f8f6-43ae-b9a3-fe04e0b12f0e None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:42.914484 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b736c-f8f6-43ae-b9a3-fe04e0b12f0e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:42.914790 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b736c-f8f6-43ae-b9a3-fe04e0b12f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:42.933160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c21b736c-f8f6-43ae-b9a3-fe04e0b12f0e None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:42.934349 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c21b736c-f8f6-43ae-b9a3-fe04e0b12f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:42.950410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 159/321] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:42.988963 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:43.004001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 163/322] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:06:43.220145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc7333-f38e-4891-834a-bbe7d02b7842 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:43.273865 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b736c-f8f6-43ae-b9a3-fe04e0b12f0e None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:43.326639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc7333-f38e-4891-834a-bbe7d02b7842 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:43.357574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:43.363027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75590d9-10ca-4c71-b3d1-0982bd0b0249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:43.363653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75590d9-10ca-4c71-b3d1-0982bd0b0249 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:43.363930 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75590d9-10ca-4c71-b3d1-0982bd0b0249 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:43.364200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75590d9-10ca-4c71-b3d1-0982bd0b0249 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:43.365338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75590d9-10ca-4c71-b3d1-0982bd0b0249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:43.367417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75590d9-10ca-4c71-b3d1-0982bd0b0249 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:43.369103 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 160/323] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:06:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:43.370171 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a5edb-0aef-4585-a274-50b0b6c2a4bd None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:43.370454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a5edb-0aef-4585-a274-50b0b6c2a4bd None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:43.370745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a5edb-0aef-4585-a274-50b0b6c2a4bd None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:43.374999 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 161/324] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:43.375809 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a5edb-0aef-4585-a274-50b0b6c2a4bd None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:43.380447 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b736c-f8f6-43ae-b9a3-fe04e0b12f0e None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:43.415040 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed320361-acaa-4075-96f0-df4cf052c67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:43.415673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed320361-acaa-4075-96f0-df4cf052c67a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:43.415958 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed320361-acaa-4075-96f0-df4cf052c67a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:43.416235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed320361-acaa-4075-96f0-df4cf052c67a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:43.426054 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed320361-acaa-4075-96f0-df4cf052c67a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:43.431541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-ed320361-acaa-4075-96f0-df4cf052c67a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:06:43.431541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:43.431541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:43.431541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:43.431541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:43.431541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:43.431541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:43.431541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:43.431541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:43.431541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:43.431541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:43.431541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:43.431541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:43.431541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:43.431541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:43.431541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:43.432413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:43.432413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:43.432413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:43.432413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:43.432413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:43.432413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:43.432413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:43.432413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:43.432413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:43.432413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:43.432413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:43.432413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:43.432413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:43.432413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:43.432413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:43.432413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:43.433231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:43.433231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:43.433231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:43.433231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:43.433231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:43.433231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:43.433231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:43.433231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:43.433231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:43.433231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:43.433231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:06:43.433231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:43.433231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 164/325] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:06:43.435906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1ad80-1414-4046-93e5-4e53f348f3c0 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:43.436192 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1ad80-1414-4046-93e5-4e53f348f3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:43.436580 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1ad80-1414-4046-93e5-4e53f348f3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:43.454772 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-36f1ad80-1414-4046-93e5-4e53f348f3c0 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:43.455962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-36f1ad80-1414-4046-93e5-4e53f348f3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:43.475149 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a5edb-0aef-4585-a274-50b0b6c2a4bd None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:43.500278 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:43.509150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fd0c4-5fbe-4dab-8ff9-6fb8c7ffe57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:43.509751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fd0c4-5fbe-4dab-8ff9-6fb8c7ffe57a None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:43.510033 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fd0c4-5fbe-4dab-8ff9-6fb8c7ffe57a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:43.510306 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fd0c4-5fbe-4dab-8ff9-6fb8c7ffe57a None admin] PATH_INFO: `/v3/groups` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:43.510961 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fd0c4-5fbe-4dab-8ff9-6fb8c7ffe57a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:43.512395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fd0c4-5fbe-4dab-8ff9-6fb8c7ffe57a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:43.523232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 165/326] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:43.524059 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1ad80-1414-4046-93e5-4e53f348f3c0 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:43.527856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 162/327] 10.222.0.48 () {60 vars in 1134 bytes} [Tue Sep 27 04:06:43 2022] POST /identity/v3/groups => generated 226 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:06:43.637269 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1ad80-1414-4046-93e5-4e53f348f3c0 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:43.673530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d29d0-b925-4ef7-bce9-58f6d1ef96a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:43.674153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d29d0-b925-4ef7-bce9-58f6d1ef96a8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:43.674433 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d29d0-b925-4ef7-bce9-58f6d1ef96a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:43.674706 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d29d0-b925-4ef7-bce9-58f6d1ef96a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:43.675417 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d29d0-b925-4ef7-bce9-58f6d1ef96a8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:43.675724 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d29d0-b925-4ef7-bce9-58f6d1ef96a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:43.677140 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d29d0-b925-4ef7-bce9-58f6d1ef96a8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:43.691546 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 166/328] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:43.692920 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fd0c4-5fbe-4dab-8ff9-6fb8c7ffe57a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:43.755713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:43.801280 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fd0c4-5fbe-4dab-8ff9-6fb8c7ffe57a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:43.807304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d29d0-b925-4ef7-bce9-58f6d1ef96a8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:43.842311 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f995d2-574f-475f-952a-acedce21f8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:43.843277 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f995d2-574f-475f-952a-acedce21f8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:43.843550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f995d2-574f-475f-952a-acedce21f8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:43.843840 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f995d2-574f-475f-952a-acedce21f8a8 None admin] PATH_INFO: `/v3/users/8a8ee57d27e9418da6f7ef4d676b916b` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:43.844947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f995d2-574f-475f-952a-acedce21f8a8 None admin] RBAC: Authorizing `identity:get_user(user_id=8a8ee57d27e9418da6f7ef4d676b916b)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:43.846510 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f995d2-574f-475f-952a-acedce21f8a8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:43.848293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 163/329] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:43 2022] GET /identity/v3/users/8a8ee57d27e9418da6f7ef4d676b916b => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:43.854429 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f995d2-574f-475f-952a-acedce21f8a8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:43.861315 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:43.932599 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d29d0-b925-4ef7-bce9-58f6d1ef96a8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:43.979662 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f995d2-574f-475f-952a-acedce21f8a8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:43.995463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7d599-ccd9-4114-9eeb-7b3dd59665b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:43.996465 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7d599-ccd9-4114-9eeb-7b3dd59665b4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:43.996816 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7d599-ccd9-4114-9eeb-7b3dd59665b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:43.997173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7d599-ccd9-4114-9eeb-7b3dd59665b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:44.018570 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7d599-ccd9-4114-9eeb-7b3dd59665b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:44.023525 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:44.024760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-07b7d599-ccd9-4114-9eeb-7b3dd59665b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:44.024760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:44.024760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:44.024760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:44.024760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:44.024760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:44.024760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:44.024760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:44.024760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:44.024760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:44.024760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:44.024760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:44.024760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:44.024760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:44.024760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:44.024760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:44.025650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:44.025650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:44.025650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:44.025650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:44.025650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:44.025650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:44.025650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:44.025650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:44.025650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:44.025650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:44.025650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:44.025650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:44.025650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:44.025650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:44.025650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:44.025650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:44.026874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:44.026874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:44.026874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:44.026874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:44.026874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:44.026874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:44.026874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:44.026874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:44.026874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:44.026874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:44.026874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:44.026874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:44.026874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 167/330] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:44.032357 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7d599-ccd9-4114-9eeb-7b3dd59665b4 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:44.036036 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d02671-9124-42a9-a00c-77151e29b682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:44.037317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d02671-9124-42a9-a00c-77151e29b682 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:44.037317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d02671-9124-42a9-a00c-77151e29b682 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:44.037317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d02671-9124-42a9-a00c-77151e29b682 None admin] PATH_INFO: `/v3/system/users/8a8ee57d27e9418da6f7ef4d676b916b/roles/d8b538ae7b664438823dd39746467d37` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:44.039314 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d02671-9124-42a9-a00c-77151e29b682 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8a8ee57d27e9418da6f7ef4d676b916b, role_id=d8b538ae7b664438823dd39746467d37)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:44.040727 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d02671-9124-42a9-a00c-77151e29b682 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:44.049769 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 164/331] 10.222.0.48 () {58 vars in 1334 bytes} [Tue Sep 27 04:06:43 2022] PUT /identity/v3/system/users/8a8ee57d27e9418da6f7ef4d676b916b/roles/d8b538ae7b664438823dd39746467d37 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:06:44.172150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:44.176225 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7d599-ccd9-4114-9eeb-7b3dd59665b4 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:44.220593 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a104f-0210-40b7-b7bd-4c4c501e8dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:44.221219 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a104f-0210-40b7-b7bd-4c4c501e8dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:44.221502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a104f-0210-40b7-b7bd-4c4c501e8dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:44.221778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a104f-0210-40b7-b7bd-4c4c501e8dc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:44.222487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a104f-0210-40b7-b7bd-4c4c501e8dc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:44.222805 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a104f-0210-40b7-b7bd-4c4c501e8dc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:44.224264 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a104f-0210-40b7-b7bd-4c4c501e8dc8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:44.235314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 168/332] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:44.244631 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d02671-9124-42a9-a00c-77151e29b682 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:44.371137 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d02671-9124-42a9-a00c-77151e29b682 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:44.415271 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53867f4b-5c42-451c-bf67-b9d96044bf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:44.415920 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53867f4b-5c42-451c-bf67-b9d96044bf22 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:44.416205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53867f4b-5c42-451c-bf67-b9d96044bf22 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:44.416483 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53867f4b-5c42-451c-bf67-b9d96044bf22 None admin] PATH_INFO: `/v3/users/aba90dad94354db0aeca6b2f72453e20` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:44.418518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53867f4b-5c42-451c-bf67-b9d96044bf22 None admin] RBAC: Authorizing `identity:get_user(user_id=aba90dad94354db0aeca6b2f72453e20)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:44.420040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53867f4b-5c42-451c-bf67-b9d96044bf22 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:44.421919 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 165/333] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:44 2022] GET /identity/v3/users/aba90dad94354db0aeca6b2f72453e20 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:44.427698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a104f-0210-40b7-b7bd-4c4c501e8dc8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:44.536857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a104f-0210-40b7-b7bd-4c4c501e8dc8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:44.580301 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c3c5a-51fd-4879-a894-923597eeb3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:44.580933 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c3c5a-51fd-4879-a894-923597eeb3bd None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:44.581215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c3c5a-51fd-4879-a894-923597eeb3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:44.581493 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c3c5a-51fd-4879-a894-923597eeb3bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:44.582242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c3c5a-51fd-4879-a894-923597eeb3bd None admin] RBAC: Adding query filter params (role.id=71cc6516aeff47eea3961db1a3d57f21, user.id=aba90dad94354db0aeca6b2f72453e20, scope.system=all) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:44.582638 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c3c5a-51fd-4879-a894-923597eeb3bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:44.584228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c3c5a-51fd-4879-a894-923597eeb3bd None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:44.606974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 169/334] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Sep 27 04:06:44 2022] GET /identity/v3/role_assignments?user.id=aba90dad94354db0aeca6b2f72453e20&scope.system=all&role.id=71cc6516aeff47eea3961db1a3d57f21 => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:46.325131 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7b458-2565-43ef-a9c0-75eb7050047c None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:46.325653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7b458-2565-43ef-a9c0-75eb7050047c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:46.325653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7b458-2565-43ef-a9c0-75eb7050047c None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:46.328295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 166/335] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:46.333790 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980632b-e340-4b8a-9e75-caa9a2849124 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:46.334911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980632b-e340-4b8a-9e75-caa9a2849124 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:46.335667 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980632b-e340-4b8a-9e75-caa9a2849124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:46.360573 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e980632b-e340-4b8a-9e75-caa9a2849124 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:46.362077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e980632b-e340-4b8a-9e75-caa9a2849124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:46.378414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:46.384247 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa2a6a-47de-4e93-b9ee-b39ce020ac0f None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:46.384785 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa2a6a-47de-4e93-b9ee-b39ce020ac0f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:46.385268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa2a6a-47de-4e93-b9ee-b39ce020ac0f None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:46.391097 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 167/336] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:46.407210 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d85864-0227-4ee1-a43d-d829e7814387 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:46.407990 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d85864-0227-4ee1-a43d-d829e7814387 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:46.408741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d85864-0227-4ee1-a43d-d829e7814387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:46.455914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d6d85864-0227-4ee1-a43d-d829e7814387 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:46.457541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d6d85864-0227-4ee1-a43d-d829e7814387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:46.468631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 170/337] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:06:46.563957 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:46.580690 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 168/338] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:06:46.699845 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a246b71-e57c-49b2-82c9-5373c214dc06 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:46.700354 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a246b71-e57c-49b2-82c9-5373c214dc06 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:46.700886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a246b71-e57c-49b2-82c9-5373c214dc06 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:46.702667 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 171/339] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:46.716267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca5cd7-9f68-4592-a3f6-35973e9301a9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:46.716583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca5cd7-9f68-4592-a3f6-35973e9301a9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:46.716830 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca5cd7-9f68-4592-a3f6-35973e9301a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:46.743772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1cca5cd7-9f68-4592-a3f6-35973e9301a9 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:46.744989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1cca5cd7-9f68-4592-a3f6-35973e9301a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:46.825050 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 169/340] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:46.940996 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a246b71-e57c-49b2-82c9-5373c214dc06 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:47.071274 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a246b71-e57c-49b2-82c9-5373c214dc06 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:47.118244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388502b-a933-445a-bb41-0fc0aa779912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:47.119264 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388502b-a933-445a-bb41-0fc0aa779912 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:47.119784 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388502b-a933-445a-bb41-0fc0aa779912 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:47.120451 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388502b-a933-445a-bb41-0fc0aa779912 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:47.135219 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388502b-a933-445a-bb41-0fc0aa779912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:47.141161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-7388502b-a933-445a-bb41-0fc0aa779912 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:47.141161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:47.141161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:47.141161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:47.141161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:47.141161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:47.141161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:47.141161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:47.141161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:47.141161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:47.141161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:47.141161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:47.141161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:47.141161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:47.141161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:47.141161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:47.142377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:47.142377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:47.142377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:47.142377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:47.142377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:47.142377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:47.142377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:47.142377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:47.142377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:47.142377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:47.142377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:47.142377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:47.142377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:47.142377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:47.142377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:47.142377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:47.143215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:47.143215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:47.143215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:47.143215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:47.143215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:47.143215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:47.143215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:47.143215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:47.143215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:47.143215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:47.143215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:47.143215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:47.145360 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 172/341] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:06:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:47.153756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388502b-a933-445a-bb41-0fc0aa779912 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:47.153916 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca5cd7-9f68-4592-a3f6-35973e9301a9 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:47.171095 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:47.267305 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388502b-a933-445a-bb41-0fc0aa779912 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:47.320365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409845ce-6484-4b2d-ac39-7af2f33a0886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:47.321025 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409845ce-6484-4b2d-ac39-7af2f33a0886 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:47.321308 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409845ce-6484-4b2d-ac39-7af2f33a0886 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:47.321583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409845ce-6484-4b2d-ac39-7af2f33a0886 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:47.355362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409845ce-6484-4b2d-ac39-7af2f33a0886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:47.360244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-409845ce-6484-4b2d-ac39-7af2f33a0886 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:47.360244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:47.360244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:47.360244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:47.360244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:47.360244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:47.360244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:47.360244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:47.360244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:47.360244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:47.360244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:47.360244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:47.360244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:47.360244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:47.360244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:47.360244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:47.361109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:47.361109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:47.361109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:47.361109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:47.361109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:47.361109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:47.361109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:47.361109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:47.361109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:47.361109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:47.361109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:47.361109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:47.361109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:47.361109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:47.361109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:47.361109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:47.361884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:47.361884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:47.361884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:47.361884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:47.361884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:47.361884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:47.361884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:47.361884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:47.361884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:47.361884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:47.361884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:47.361884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:47.361884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 173/342] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:47.367342 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409845ce-6484-4b2d-ac39-7af2f33a0886 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:47.371950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca5cd7-9f68-4592-a3f6-35973e9301a9 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:47.435076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:47.438705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fd25d-f655-4c22-992d-a5a22dd36f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:47.439325 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fd25d-f655-4c22-992d-a5a22dd36f67 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:47.439637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fd25d-f655-4c22-992d-a5a22dd36f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:47.439914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fd25d-f655-4c22-992d-a5a22dd36f67 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:47.440602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fd25d-f655-4c22-992d-a5a22dd36f67 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:47.441001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fd25d-f655-4c22-992d-a5a22dd36f67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:47.442415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fd25d-f655-4c22-992d-a5a22dd36f67 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:47.455135 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 170/343] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:06:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:47.457425 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bd97e-d66d-468f-962e-cfa6e7c15dab None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:47.457708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bd97e-d66d-468f-962e-cfa6e7c15dab None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:47.457983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bd97e-d66d-468f-962e-cfa6e7c15dab None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:47.459219 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 171/344] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:47.467215 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bd97e-d66d-468f-962e-cfa6e7c15dab None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:47.517695 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:47.556420 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409845ce-6484-4b2d-ac39-7af2f33a0886 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:47.579264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bd97e-d66d-468f-962e-cfa6e7c15dab None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:47.599731 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3fd50-0a0f-483d-8670-ac29c0108a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:47.600448 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3fd50-0a0f-483d-8670-ac29c0108a75 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:47.601281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3fd50-0a0f-483d-8670-ac29c0108a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:47.601559 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3fd50-0a0f-483d-8670-ac29c0108a75 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:47.602232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3fd50-0a0f-483d-8670-ac29c0108a75 None admin] RBAC: Adding query filter params (name=member) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:47.602589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3fd50-0a0f-483d-8670-ac29c0108a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:47.604374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3fd50-0a0f-483d-8670-ac29c0108a75 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:47.614406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 174/345] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:47.616217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8c96c-e8a8-4803-bae2-bae401997aec None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:47.617051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8c96c-e8a8-4803-bae2-bae401997aec None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:47.617345 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8c96c-e8a8-4803-bae2-bae401997aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:47.620724 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ff43a-1c65-411b-9757-2f4ee9b339b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:47.621735 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ff43a-1c65-411b-9757-2f4ee9b339b4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:47.622187 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ff43a-1c65-411b-9757-2f4ee9b339b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:47.622789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ff43a-1c65-411b-9757-2f4ee9b339b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:47.634976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ff43a-1c65-411b-9757-2f4ee9b339b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:47.636775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-96e8c96c-e8a8-4803-bae2-bae401997aec None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:47.638153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-96e8c96c-e8a8-4803-bae2-bae401997aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:47.642339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-eb4ff43a-1c65-411b-9757-2f4ee9b339b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:06:47.642339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:47.642339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:47.642339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:47.642339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:47.642339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:47.642339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:47.642339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:47.642339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:47.642339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:47.642339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:47.642339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:47.642339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:47.642339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:47.642339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:47.642339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:47.643478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:47.643478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:47.643478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:47.643478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:47.643478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:47.643478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:47.643478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:47.643478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:47.643478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:47.643478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:47.643478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:47.643478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:47.643478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:47.643478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:47.643478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:47.643478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:47.644397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:47.644397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:47.644397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:47.644397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:47.644397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:47.644397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:47.644397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:47.644397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:47.644397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:47.644397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:47.644397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:06:47.644397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:06:47.644397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 172/346] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:47.644397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ff43a-1c65-411b-9757-2f4ee9b339b4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:47.695151 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:47.719911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 175/347] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:47.721144 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8c96c-e8a8-4803-bae2-bae401997aec None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:47.755689 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ff43a-1c65-411b-9757-2f4ee9b339b4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:47.791157 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:47.792114 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1da98a-e0a2-4d45-8b36-a849ce216a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:47.792814 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1da98a-e0a2-4d45-8b36-a849ce216a08 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:47.793192 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1da98a-e0a2-4d45-8b36-a849ce216a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:47.793456 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1da98a-e0a2-4d45-8b36-a849ce216a08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:47.836797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8c96c-e8a8-4803-bae2-bae401997aec None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:47.865809 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1da98a-e0a2-4d45-8b36-a849ce216a08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:47.867912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1da98a-e0a2-4d45-8b36-a849ce216a08 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:47.878404 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bd23c-255f-413b-bb71-9ab1ff8635c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:47.879481 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bd23c-255f-413b-bb71-9ab1ff8635c6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:47.879960 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bd23c-255f-413b-bb71-9ab1ff8635c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:47.880427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bd23c-255f-413b-bb71-9ab1ff8635c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:47.910170 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:47.962461 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bd23c-255f-413b-bb71-9ab1ff8635c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:47.964440 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bd23c-255f-413b-bb71-9ab1ff8635c6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:47.970082 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 173/348] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:47.970974 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1da98a-e0a2-4d45-8b36-a849ce216a08 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:48.041430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:48.075539 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1da98a-e0a2-4d45-8b36-a849ce216a08 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:48.095210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 176/349] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:48.096447 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bd23c-255f-413b-bb71-9ab1ff8635c6 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:48.112755 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f87dd-ce7f-404e-97b8-01ac050ff732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:48.113375 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f87dd-ce7f-404e-97b8-01ac050ff732 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:48.113656 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f87dd-ce7f-404e-97b8-01ac050ff732 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:48.113936 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f87dd-ce7f-404e-97b8-01ac050ff732 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:48.114610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f87dd-ce7f-404e-97b8-01ac050ff732 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:48.114987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f87dd-ce7f-404e-97b8-01ac050ff732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:48.117064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f87dd-ce7f-404e-97b8-01ac050ff732 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:48.125533 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 174/350] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:48.126358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f87dd-ce7f-404e-97b8-01ac050ff732 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:48.129818 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:48.216674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bd23c-255f-413b-bb71-9ab1ff8635c6 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:48.229250 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f87dd-ce7f-404e-97b8-01ac050ff732 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:48.257257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ed974-0b1e-49d1-be1f-56e492153312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:48.258470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ed974-0b1e-49d1-be1f-56e492153312 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:48.259202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ed974-0b1e-49d1-be1f-56e492153312 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:48.259877 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ed974-0b1e-49d1-be1f-56e492153312 None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:48.261292 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ed974-0b1e-49d1-be1f-56e492153312 None admin] RBAC: Authorizing `identity:get_project(project_id=26f3d9baa4614c7ab91952d7e5132734)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:48.263600 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ed974-0b1e-49d1-be1f-56e492153312 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:48.265767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 177/351] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:48 2022] GET /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:48.268221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deceb50b-3f7a-4528-b840-38438acc4bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:48.268221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceb50b-3f7a-4528-b840-38438acc4bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:48.268221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceb50b-3f7a-4528-b840-38438acc4bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:48.268221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceb50b-3f7a-4528-b840-38438acc4bf4 None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:48.269258 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deceb50b-3f7a-4528-b840-38438acc4bf4 None admin] RBAC: Authorizing `identity:get_project(project_id=26f3d9baa4614c7ab91952d7e5132734)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:48.269824 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ed974-0b1e-49d1-be1f-56e492153312 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:48.270688 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deceb50b-3f7a-4528-b840-38438acc4bf4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:48.272338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 175/352] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:48 2022] GET /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:48.273623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deceb50b-3f7a-4528-b840-38438acc4bf4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:48.305179 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:48.354651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:48.390953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deceb50b-3f7a-4528-b840-38438acc4bf4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:48.395167 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ed974-0b1e-49d1-be1f-56e492153312 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:48.438767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b91a4-7fde-4042-b757-0e2a3729a143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:48.438970 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a540e1-72a9-413e-a08a-0800bdc16997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:48.439418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a540e1-72a9-413e-a08a-0800bdc16997 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:48.439704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a540e1-72a9-413e-a08a-0800bdc16997 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:48.439982 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a540e1-72a9-413e-a08a-0800bdc16997 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:48.440574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b91a4-7fde-4042-b757-0e2a3729a143 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:48.441164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b91a4-7fde-4042-b757-0e2a3729a143 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:48.441629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b91a4-7fde-4042-b757-0e2a3729a143 None admin] PATH_INFO: `/v3/users/8a8ee57d27e9418da6f7ef4d676b916b` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:48.443131 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b91a4-7fde-4042-b757-0e2a3729a143 None admin] RBAC: Authorizing `identity:get_user(user_id=8a8ee57d27e9418da6f7ef4d676b916b)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:48.444837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b91a4-7fde-4042-b757-0e2a3729a143 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:48.447936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 178/353] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:06:48 2022] GET /identity/v3/users/8a8ee57d27e9418da6f7ef4d676b916b => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:48.449010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b91a4-7fde-4042-b757-0e2a3729a143 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:48.453126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a540e1-72a9-413e-a08a-0800bdc16997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:48.458488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-90a540e1-72a9-413e-a08a-0800bdc16997 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:48.458488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:48.458488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:48.458488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:48.458488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:48.458488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:48.458488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:48.458488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:48.458488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:48.458488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:48.458488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:48.458488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:48.458488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:48.458488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:48.458488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:48.458488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:48.459407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:48.459407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:48.459407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:48.459407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:48.459407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:48.459407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:48.459407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:48.459407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:48.459407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:48.459407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:48.459407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:48.459407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:48.459407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:48.459407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:48.459407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:48.459407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:48.461410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:48.461410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:48.461410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:48.461410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:48.461410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:48.461410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:48.461410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:48.461410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:48.461410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:48.461410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:48.461410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:48.461410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:06:48.461410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 176/354] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:48.461410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a540e1-72a9-413e-a08a-0800bdc16997 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:48.564905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:48.569214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b91a4-7fde-4042-b757-0e2a3729a143 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:48.569403 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a540e1-72a9-413e-a08a-0800bdc16997 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:48.611210 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:48.617775 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e2897-1165-49cf-81d7-107701c86a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:48.617929 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17a882-c1a6-43c5-bdfe-336a6c7156b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:48.618418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e2897-1165-49cf-81d7-107701c86a8d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:48.618537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17a882-c1a6-43c5-bdfe-336a6c7156b6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:48.618705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e2897-1165-49cf-81d7-107701c86a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:48.618821 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17a882-c1a6-43c5-bdfe-336a6c7156b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:48.619011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e2897-1165-49cf-81d7-107701c86a8d None admin] PATH_INFO: `/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:48.619103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17a882-c1a6-43c5-bdfe-336a6c7156b6 None admin] PATH_INFO: `/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:48.626796 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17a882-c1a6-43c5-bdfe-336a6c7156b6 None admin] RBAC: Authorizing `identity:get_group(group_id=3fa9c9178fef4d79aebc3c1ceffdfead)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:48.627590 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e2897-1165-49cf-81d7-107701c86a8d None admin] RBAC: Authorizing `identity:get_group(group_id=3fa9c9178fef4d79aebc3c1ceffdfead)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:48.628296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17a882-c1a6-43c5-bdfe-336a6c7156b6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:48.629477 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e2897-1165-49cf-81d7-107701c86a8d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:48.630101 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 179/355] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 27 04:06:48 2022] GET /identity/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:48.634818 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17a882-c1a6-43c5-bdfe-336a6c7156b6 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:48.634944 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 177/356] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 27 04:06:48 2022] GET /identity/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:48.634944 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e2897-1165-49cf-81d7-107701c86a8d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:48.766082 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e2897-1165-49cf-81d7-107701c86a8d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:48.770438 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17a882-c1a6-43c5-bdfe-336a6c7156b6 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:48.806852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294d09c-d79e-4838-8916-44b8a17c56ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:48.807479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294d09c-d79e-4838-8916-44b8a17c56ee None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:48.807766 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294d09c-d79e-4838-8916-44b8a17c56ee None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:48.808045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294d09c-d79e-4838-8916-44b8a17c56ee None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:48.808728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294d09c-d79e-4838-8916-44b8a17c56ee None admin] RBAC: Adding query filter params (name=member) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:48.809038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294d09c-d79e-4838-8916-44b8a17c56ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:48.810457 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294d09c-d79e-4838-8916-44b8a17c56ee None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:48.816381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130b57b-7359-4536-a8f3-9e75764c9aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:48.816928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130b57b-7359-4536-a8f3-9e75764c9aec None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:48.817211 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130b57b-7359-4536-a8f3-9e75764c9aec None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:48.817548 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130b57b-7359-4536-a8f3-9e75764c9aec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:48.818291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130b57b-7359-4536-a8f3-9e75764c9aec None admin] RBAC: Adding query filter params (role.id=d8b538ae7b664438823dd39746467d37, user.id=8a8ee57d27e9418da6f7ef4d676b916b, scope.system=all) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:48.819107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130b57b-7359-4536-a8f3-9e75764c9aec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:48.821096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130b57b-7359-4536-a8f3-9e75764c9aec None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:48.823388 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 178/357] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:48.824642 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4982b0e-150b-4371-a337-a4b9c0a0f7b0 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:48.824931 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4982b0e-150b-4371-a337-a4b9c0a0f7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:48.825207 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4982b0e-150b-4371-a337-a4b9c0a0f7b0 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:48.826576 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 179/358] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:48.828145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4982b0e-150b-4371-a337-a4b9c0a0f7b0 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:48.841226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 180/359] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Sep 27 04:06:48 2022] GET /identity/v3/role_assignments?user.id=8a8ee57d27e9418da6f7ef4d676b916b&scope.system=all&role.id=d8b538ae7b664438823dd39746467d37 => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:48.842505 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130b57b-7359-4536-a8f3-9e75764c9aec None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:48.874835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:48.922051 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:48.976507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4982b0e-150b-4371-a337-a4b9c0a0f7b0 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:48.985810 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130b57b-7359-4536-a8f3-9e75764c9aec None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:49.019404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47163f5e-166f-4dc7-9a6d-70369b293c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:49.020033 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47163f5e-166f-4dc7-9a6d-70369b293c8b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:49.020315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47163f5e-166f-4dc7-9a6d-70369b293c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:49.020589 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47163f5e-166f-4dc7-9a6d-70369b293c8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:49.021364 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47163f5e-166f-4dc7-9a6d-70369b293c8b None admin] RBAC: Adding query filter params (group.id=3fa9c9178fef4d79aebc3c1ceffdfead, role.id=9e2965c7d68d423a965894a8eb16903f, scope.project.id=26f3d9baa4614c7ab91952d7e5132734) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:49.021680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47163f5e-166f-4dc7-9a6d-70369b293c8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:49.023883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47163f5e-166f-4dc7-9a6d-70369b293c8b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:49.030243 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 180/360] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 27 04:06:48 2022] GET /identity/v3/role_assignments?group.id=3fa9c9178fef4d79aebc3c1ceffdfead&scope.project.id=26f3d9baa4614c7ab91952d7e5132734&role.id=9e2965c7d68d423a965894a8eb16903f => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:49.031138 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47163f5e-166f-4dc7-9a6d-70369b293c8b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:49.032113 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4366415-5be3-4476-98f5-ba94c4e5af0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:49.032995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4366415-5be3-4476-98f5-ba94c4e5af0e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:49.033506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4366415-5be3-4476-98f5-ba94c4e5af0e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:49.034143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4366415-5be3-4476-98f5-ba94c4e5af0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:49.035241 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4366415-5be3-4476-98f5-ba94c4e5af0e None admin] RBAC: Adding query filter params (group.id=3fa9c9178fef4d79aebc3c1ceffdfead, role.id=71cc6516aeff47eea3961db1a3d57f21, scope.project.id=26f3d9baa4614c7ab91952d7e5132734) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:49.035781 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4366415-5be3-4476-98f5-ba94c4e5af0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:49.037496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4366415-5be3-4476-98f5-ba94c4e5af0e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:49.045582 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 181/361] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 27 04:06:48 2022] GET /identity/v3/role_assignments?group.id=3fa9c9178fef4d79aebc3c1ceffdfead&scope.project.id=26f3d9baa4614c7ab91952d7e5132734&role.id=71cc6516aeff47eea3961db1a3d57f21 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:49.047376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2059b2c-d49b-49b9-aa17-948dfb660c42 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:49.047941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2059b2c-d49b-49b9-aa17-948dfb660c42 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:49.048414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2059b2c-d49b-49b9-aa17-948dfb660c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:49.069839 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e2059b2c-d49b-49b9-aa17-948dfb660c42 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:49.071550 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e2059b2c-d49b-49b9-aa17-948dfb660c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:49.152634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 182/362] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:49.187182 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52f08f-dd67-42d3-a76c-659bc0d3e86a None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:49.188366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52f08f-dd67-42d3-a76c-659bc0d3e86a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:49.188876 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52f08f-dd67-42d3-a76c-659bc0d3e86a None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:49.192397 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 183/363] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:06:49.197103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5225a77-1219-4ea4-8b96-723d0ec19c5f None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:49.197734 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5225a77-1219-4ea4-8b96-723d0ec19c5f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:49.198155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5225a77-1219-4ea4-8b96-723d0ec19c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:49.213345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47163f5e-166f-4dc7-9a6d-70369b293c8b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:49.227246 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c5225a77-1219-4ea4-8b96-723d0ec19c5f None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:49.229029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c5225a77-1219-4ea4-8b96-723d0ec19c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:49.251634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:49.256800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:49.280180 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f7013-1cb6-49df-a5e9-f7c56902c154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:49.282171 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f7013-1cb6-49df-a5e9-f7c56902c154 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:49.283893 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f7013-1cb6-49df-a5e9-f7c56902c154 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:49.284294 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f7013-1cb6-49df-a5e9-f7c56902c154 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:49.362107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 184/364] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:49.404232 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f7013-1cb6-49df-a5e9-f7c56902c154 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:49.405732 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f7013-1cb6-49df-a5e9-f7c56902c154 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:49.500324 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5225a77-1219-4ea4-8b96-723d0ec19c5f None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:49.515911 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 181/365] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:49.526236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f7013-1cb6-49df-a5e9-f7c56902c154 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:49.555100 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:49.632860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f7013-1cb6-49df-a5e9-f7c56902c154 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:49.668979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa02f07-0c0b-4587-b99c-78cd648e0637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:49.671478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa02f07-0c0b-4587-b99c-78cd648e0637 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:49.671767 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa02f07-0c0b-4587-b99c-78cd648e0637 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:49.672051 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa02f07-0c0b-4587-b99c-78cd648e0637 None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:49.673267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa02f07-0c0b-4587-b99c-78cd648e0637 None admin] RBAC: Authorizing `identity:get_project(project_id=a4a05ac2e47b41afb49b5304780a242e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:49.674692 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa02f07-0c0b-4587-b99c-78cd648e0637 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:49.677389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 182/366] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:49 2022] GET /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:49.677512 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa02f07-0c0b-4587-b99c-78cd648e0637 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:49.715969 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5225a77-1219-4ea4-8b96-723d0ec19c5f None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:49.760093 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43807e5-0c13-4099-ac65-a20784b390ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:49.760727 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43807e5-0c13-4099-ac65-a20784b390ef None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:49.761006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43807e5-0c13-4099-ac65-a20784b390ef None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:49.761280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43807e5-0c13-4099-ac65-a20784b390ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:49.774136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43807e5-0c13-4099-ac65-a20784b390ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:49.778203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:49.782194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-b43807e5-0c13-4099-ac65-a20784b390ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:49.782194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:49.782194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:49.782194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:49.782194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:49.782194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:49.782194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:49.782194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:49.782194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:49.782194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:49.782194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:49.782194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:49.782194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:49.782194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:49.782194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:49.782194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:49.783214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:49.783214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:49.783214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:49.783214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:49.783214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:49.783214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:49.783214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:49.783214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:49.783214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:49.783214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:49.783214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:49.783214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:49.783214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:49.783214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:49.783214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:49.783214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:49.784017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:49.784017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:49.784017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:49.784017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:49.784017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:49.784017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:49.784017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:49.784017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:49.784017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:49.784017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:49.784017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:49.784017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:49.784017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 185/367] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:06:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:49.784685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43807e5-0c13-4099-ac65-a20784b390ef None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:49.789058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:49.793264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa02f07-0c0b-4587-b99c-78cd648e0637 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:49.835541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054eeef-0550-4584-989e-1347fac78832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:49.836586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054eeef-0550-4584-989e-1347fac78832 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:49.837083 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054eeef-0550-4584-989e-1347fac78832 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:49.837548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054eeef-0550-4584-989e-1347fac78832 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:49.849953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054eeef-0550-4584-989e-1347fac78832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:49.856802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-5054eeef-0550-4584-989e-1347fac78832 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:49.856802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:49.856802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:49.856802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:49.856802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:49.856802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:49.856802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:49.856802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:49.856802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:49.856802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:49.856802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:49.856802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:49.856802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:49.856802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:49.856802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:49.856802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:49.857772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:49.857772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:49.857772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:49.857772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:49.857772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:49.857772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:49.857772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:49.857772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:49.857772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:49.857772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:49.857772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:49.857772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:49.857772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:49.857772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:49.857772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:49.857772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:49.858989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:49.858989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:49.858989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:49.858989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:49.858989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:49.858989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:49.858989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:49.858989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:49.858989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:49.858989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:49.858989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:49.858989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:06:49.858989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 183/368] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:06:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:49.859656 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054eeef-0550-4584-989e-1347fac78832 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:49.934842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43807e5-0c13-4099-ac65-a20784b390ef None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:49.979820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7408acc-e810-4d0c-b336-ba7d667f05bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:49.981020 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7408acc-e810-4d0c-b336-ba7d667f05bb None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:49.981518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7408acc-e810-4d0c-b336-ba7d667f05bb None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:49.981986 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7408acc-e810-4d0c-b336-ba7d667f05bb None admin] PATH_INFO: `/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:49.983305 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7408acc-e810-4d0c-b336-ba7d667f05bb None admin] RBAC: Authorizing `identity:get_group(group_id=3fa9c9178fef4d79aebc3c1ceffdfead)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:49.983893 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054eeef-0550-4584-989e-1347fac78832 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:49.985257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7408acc-e810-4d0c-b336-ba7d667f05bb None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:49.987190 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 186/369] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 27 04:06:49 2022] GET /identity/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:49.988202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7408acc-e810-4d0c-b336-ba7d667f05bb None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:50.019461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2752fe2-d1f0-4890-858d-4335ae53e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:50.020031 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2752fe2-d1f0-4890-858d-4335ae53e349 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:50.020309 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2752fe2-d1f0-4890-858d-4335ae53e349 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:50.020581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2752fe2-d1f0-4890-858d-4335ae53e349 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:50.021247 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2752fe2-d1f0-4890-858d-4335ae53e349 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:50.021611 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2752fe2-d1f0-4890-858d-4335ae53e349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:50.023131 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2752fe2-d1f0-4890-858d-4335ae53e349 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:50.031476 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 184/370] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:06:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:50.032312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2752fe2-d1f0-4890-858d-4335ae53e349 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:50.048255 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:50.072257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:50.107944 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7408acc-e810-4d0c-b336-ba7d667f05bb None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:50.140290 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2752fe2-d1f0-4890-858d-4335ae53e349 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:50.147033 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30121da7-dd1e-4cad-9d2a-1020c3e9152e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:50.148508 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30121da7-dd1e-4cad-9d2a-1020c3e9152e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:50.148990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30121da7-dd1e-4cad-9d2a-1020c3e9152e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:50.149456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30121da7-dd1e-4cad-9d2a-1020c3e9152e None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:50.150478 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30121da7-dd1e-4cad-9d2a-1020c3e9152e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:50.151015 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30121da7-dd1e-4cad-9d2a-1020c3e9152e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:50.152752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30121da7-dd1e-4cad-9d2a-1020c3e9152e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:50.162432 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 187/371] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:50.163678 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30121da7-dd1e-4cad-9d2a-1020c3e9152e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:50.186222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20caf8e4-25ae-4e58-b785-2aedc8dbf894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:50.186770 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caf8e4-25ae-4e58-b785-2aedc8dbf894 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:50.187052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caf8e4-25ae-4e58-b785-2aedc8dbf894 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:50.187324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caf8e4-25ae-4e58-b785-2aedc8dbf894 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:50.188056 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20caf8e4-25ae-4e58-b785-2aedc8dbf894 None admin] RBAC: Adding query filter params (group.id=3fa9c9178fef4d79aebc3c1ceffdfead, role.id=71cc6516aeff47eea3961db1a3d57f21, scope.project.id=a4a05ac2e47b41afb49b5304780a242e) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:50.188366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20caf8e4-25ae-4e58-b785-2aedc8dbf894 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:50.189791 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20caf8e4-25ae-4e58-b785-2aedc8dbf894 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:50.195933 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 185/372] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 27 04:06:50 2022] GET /identity/v3/role_assignments?group.id=3fa9c9178fef4d79aebc3c1ceffdfead&scope.project.id=a4a05ac2e47b41afb49b5304780a242e&role.id=71cc6516aeff47eea3961db1a3d57f21 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:50.196728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20caf8e4-25ae-4e58-b785-2aedc8dbf894 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:50.284273 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30121da7-dd1e-4cad-9d2a-1020c3e9152e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:50.284927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:50.313274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20caf8e4-25ae-4e58-b785-2aedc8dbf894 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:50.328278 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e65a0e-be28-4237-9fd9-7ce4b74330c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:50.329366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e65a0e-be28-4237-9fd9-7ce4b74330c8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:50.329900 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e65a0e-be28-4237-9fd9-7ce4b74330c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:50.330370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e65a0e-be28-4237-9fd9-7ce4b74330c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:50.333716 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:50.353474 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccdc49-aef2-4105-87ba-a318132fd480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:50.354092 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccdc49-aef2-4105-87ba-a318132fd480 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:50.354364 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccdc49-aef2-4105-87ba-a318132fd480 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:50.354637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccdc49-aef2-4105-87ba-a318132fd480 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:50.418366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e65a0e-be28-4237-9fd9-7ce4b74330c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:50.420373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e65a0e-be28-4237-9fd9-7ce4b74330c8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:50.427977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccdc49-aef2-4105-87ba-a318132fd480 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:50.430111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccdc49-aef2-4105-87ba-a318132fd480 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:50.514626 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:50.541125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 186/373] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:50.542698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 188/374] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:50.546702 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccdc49-aef2-4105-87ba-a318132fd480 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:50.548014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e65a0e-be28-4237-9fd9-7ce4b74330c8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:50.605980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:50.650416 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccdc49-aef2-4105-87ba-a318132fd480 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:50.684892 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9b2c0-ce1c-4846-a82f-fa797eac939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:50.685525 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9b2c0-ce1c-4846-a82f-fa797eac939e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:50.685803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9b2c0-ce1c-4846-a82f-fa797eac939e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:50.686075 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9b2c0-ce1c-4846-a82f-fa797eac939e None admin] PATH_INFO: `/v3/projects/97e2274f8eaa462ba6cf2944e7e36afb` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:50.687290 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9b2c0-ce1c-4846-a82f-fa797eac939e None admin] RBAC: Authorizing `identity:get_project(project_id=97e2274f8eaa462ba6cf2944e7e36afb)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:50.688716 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9b2c0-ce1c-4846-a82f-fa797eac939e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:50.690624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 187/375] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:50 2022] GET /identity/v3/projects/97e2274f8eaa462ba6cf2944e7e36afb => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:50.695925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9b2c0-ce1c-4846-a82f-fa797eac939e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:50.750217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:50.797035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e65a0e-be28-4237-9fd9-7ce4b74330c8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:50.801400 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9b2c0-ce1c-4846-a82f-fa797eac939e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:50.838671 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba50e75-1133-434e-82e4-7cd2ba89e3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:50.839330 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba50e75-1133-434e-82e4-7cd2ba89e3ba None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:50.839608 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba50e75-1133-434e-82e4-7cd2ba89e3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:50.839877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba50e75-1133-434e-82e4-7cd2ba89e3ba None admin] PATH_INFO: `/v3/groups/e5b34c26e96f4098b9c9dd2c0bda7920` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:50.845185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba50e75-1133-434e-82e4-7cd2ba89e3ba None admin] RBAC: Authorizing `identity:get_group(group_id=e5b34c26e96f4098b9c9dd2c0bda7920)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:50.847046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba50e75-1133-434e-82e4-7cd2ba89e3ba None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:50.848999 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 188/376] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 27 04:06:50 2022] GET /identity/v3/groups/e5b34c26e96f4098b9c9dd2c0bda7920 => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:50.856413 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba50e75-1133-434e-82e4-7cd2ba89e3ba None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:50.895979 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2cfae-5e25-41b3-90cc-e466ab55edbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:50.896619 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2cfae-5e25-41b3-90cc-e466ab55edbc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:50.896907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2cfae-5e25-41b3-90cc-e466ab55edbc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:50.897231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2cfae-5e25-41b3-90cc-e466ab55edbc None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:50.903425 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2cfae-5e25-41b3-90cc-e466ab55edbc None admin] RBAC: Authorizing `identity:get_project(project_id=a4a05ac2e47b41afb49b5304780a242e)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:50.904888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2cfae-5e25-41b3-90cc-e466ab55edbc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:50.906913 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 189/377] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:50 2022] GET /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e => generated 302 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:50.912285 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2cfae-5e25-41b3-90cc-e466ab55edbc None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:51.007591 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba50e75-1133-434e-82e4-7cd2ba89e3ba None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:51.025917 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:51.073655 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9f638-4f06-4dff-ad1c-2419fa08be40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:51.076157 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9f638-4f06-4dff-ad1c-2419fa08be40 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:51.076442 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9f638-4f06-4dff-ad1c-2419fa08be40 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:51.076716 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9f638-4f06-4dff-ad1c-2419fa08be40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:51.077448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9f638-4f06-4dff-ad1c-2419fa08be40 None admin] RBAC: Adding query filter params (group.id=e5b34c26e96f4098b9c9dd2c0bda7920, role.id=2613cf4a98d44744a094c7782b19b4b5, scope.project.id=97e2274f8eaa462ba6cf2944e7e36afb) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:51.077757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9f638-4f06-4dff-ad1c-2419fa08be40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:51.079227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9f638-4f06-4dff-ad1c-2419fa08be40 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:51.093382 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 189/378] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 27 04:06:50 2022] GET /identity/v3/role_assignments?group.id=e5b34c26e96f4098b9c9dd2c0bda7920&scope.project.id=97e2274f8eaa462ba6cf2944e7e36afb&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:51.106953 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2cfae-5e25-41b3-90cc-e466ab55edbc None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:51.108467 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:51.156892 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53315c8f-5cf1-4410-97ab-25387cb4df17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:51.157122 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53315c8f-5cf1-4410-97ab-25387cb4df17 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:51.157352 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53315c8f-5cf1-4410-97ab-25387cb4df17 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:51.157586 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53315c8f-5cf1-4410-97ab-25387cb4df17 None admin] PATH_INFO: `/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:51.158703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53315c8f-5cf1-4410-97ab-25387cb4df17 None admin] RBAC: Authorizing `identity:get_group(group_id=3fa9c9178fef4d79aebc3c1ceffdfead)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:51.160171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53315c8f-5cf1-4410-97ab-25387cb4df17 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:51.162084 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 190/379] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 27 04:06:50 2022] GET /identity/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:51.168511 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9f638-4f06-4dff-ad1c-2419fa08be40 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:51.291402 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9f638-4f06-4dff-ad1c-2419fa08be40 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:51.336208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194bd73-5d26-4344-a6be-fa301e9bf8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:51.336759 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194bd73-5d26-4344-a6be-fa301e9bf8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:51.337086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194bd73-5d26-4344-a6be-fa301e9bf8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:51.337358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194bd73-5d26-4344-a6be-fa301e9bf8c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:51.338117 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194bd73-5d26-4344-a6be-fa301e9bf8c7 None admin] RBAC: Adding query filter params (group.id=3fa9c9178fef4d79aebc3c1ceffdfead, role.id=9e2965c7d68d423a965894a8eb16903f, scope.project.id=a4a05ac2e47b41afb49b5304780a242e) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:51.338428 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194bd73-5d26-4344-a6be-fa301e9bf8c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:51.339934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194bd73-5d26-4344-a6be-fa301e9bf8c7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:51.346586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 190/380] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 27 04:06:51 2022] GET /identity/v3/role_assignments?group.id=3fa9c9178fef4d79aebc3c1ceffdfead&scope.project.id=a4a05ac2e47b41afb49b5304780a242e&role.id=9e2965c7d68d423a965894a8eb16903f => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:52.061038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a61000-f327-43a8-b284-8275ad6c95e5 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:52.061571 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a61000-f327-43a8-b284-8275ad6c95e5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:52.061571 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a61000-f327-43a8-b284-8275ad6c95e5 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:52.063183 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 191/381] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:52.068482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85507e43-bde1-472d-b205-6c7c2eaa586e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:52.068975 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85507e43-bde1-472d-b205-6c7c2eaa586e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:52.069058 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85507e43-bde1-472d-b205-6c7c2eaa586e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:52.099662 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-85507e43-bde1-472d-b205-6c7c2eaa586e None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:52.101454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-85507e43-bde1-472d-b205-6c7c2eaa586e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:52.133175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:52.180371 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 191/382] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:52.222239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0690615-1a06-4072-ac24-959e2ec20b83 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:52.222562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0690615-1a06-4072-ac24-959e2ec20b83 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:52.222840 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0690615-1a06-4072-ac24-959e2ec20b83 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:52.224424 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 192/383] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:52.230038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583a2c5-619d-4dac-91fb-304d26ad6bdb None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:52.230326 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583a2c5-619d-4dac-91fb-304d26ad6bdb None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:52.230602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583a2c5-619d-4dac-91fb-304d26ad6bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:52.249715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d583a2c5-619d-4dac-91fb-304d26ad6bdb None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:52.250938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d583a2c5-619d-4dac-91fb-304d26ad6bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:52.322684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 192/384] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:52.601008 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0690615-1a06-4072-ac24-959e2ec20b83 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:52.717422 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0690615-1a06-4072-ac24-959e2ec20b83 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:52.743990 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583a2c5-619d-4dac-91fb-304d26ad6bdb None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:52.760608 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3dc96-dd2c-43c1-826e-af1cea51ddc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:52.761232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3dc96-dd2c-43c1-826e-af1cea51ddc9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:52.761513 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3dc96-dd2c-43c1-826e-af1cea51ddc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:52.761787 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3dc96-dd2c-43c1-826e-af1cea51ddc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:52.775175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3dc96-dd2c-43c1-826e-af1cea51ddc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:52.780741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-ade3dc96-dd2c-43c1-826e-af1cea51ddc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:52.780741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:52.780741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:52.780741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:52.780741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:52.780741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:52.780741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:52.780741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:52.780741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:52.780741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:52.780741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:52.780741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:52.780741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:52.780741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:52.780741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:52.780741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:52.781677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:52.781677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:52.781677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:52.781677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:52.781677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:52.781677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:52.781677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:52.781677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:52.781677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:52.781677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:52.781677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:52.781677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:52.781677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:52.781677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:52.781677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:52.781677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:52.782538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:52.782538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:52.782538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:52.782538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:52.782538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:52.782538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:52.782538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:52.782538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:52.782538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:52.782538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:52.782538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:52.782538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:52.782538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 193/385] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:06:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:52.788731 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3dc96-dd2c-43c1-826e-af1cea51ddc9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:52.823338 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:52.907302 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3dc96-dd2c-43c1-826e-af1cea51ddc9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:52.968791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44775fd8-0be0-4c5f-992a-6d6a6444bba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:52.969417 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44775fd8-0be0-4c5f-992a-6d6a6444bba5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:52.969705 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44775fd8-0be0-4c5f-992a-6d6a6444bba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:52.972561 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44775fd8-0be0-4c5f-992a-6d6a6444bba5 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:52.972561 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44775fd8-0be0-4c5f-992a-6d6a6444bba5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:52.972561 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44775fd8-0be0-4c5f-992a-6d6a6444bba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:52.972561 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44775fd8-0be0-4c5f-992a-6d6a6444bba5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:52.976487 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:52.981012 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583a2c5-619d-4dac-91fb-304d26ad6bdb None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:52.988807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 194/386] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:06:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:52.995202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44775fd8-0be0-4c5f-992a-6d6a6444bba5 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:53.031411 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce50a9e-4353-4273-94de-dc787cff71ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:53.032055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce50a9e-4353-4273-94de-dc787cff71ef None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:53.032336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce50a9e-4353-4273-94de-dc787cff71ef None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:53.032612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce50a9e-4353-4273-94de-dc787cff71ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:53.044802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce50a9e-4353-4273-94de-dc787cff71ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:53.050203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-fce50a9e-4353-4273-94de-dc787cff71ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:53.050203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:53.050203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:53.050203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:53.050203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:53.050203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:53.050203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:53.050203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:53.050203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:53.050203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:53.050203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:53.050203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:53.050203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:53.050203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:53.050203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:53.050203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:53.051134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:53.051134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:53.051134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:53.051134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:53.051134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:53.051134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:53.051134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:53.051134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:53.051134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:53.051134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:53.051134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:53.051134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:53.051134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:53.051134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:53.051134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:53.051134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:53.051934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:53.051934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:53.051934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:53.051934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:53.051934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:53.051934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:53.051934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:53.051934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:53.051934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:53.051934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:53.051934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:53.051934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:06:53.051934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 193/387] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:53.053069 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc95ebb-e782-48fe-995d-bb5cb38c151c None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:53.053176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc95ebb-e782-48fe-995d-bb5cb38c151c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:53.053372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc95ebb-e782-48fe-995d-bb5cb38c151c None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:53.055168 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 194/388] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:53.059348 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc95ebb-e782-48fe-995d-bb5cb38c151c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:53.119207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:53.128295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44775fd8-0be0-4c5f-992a-6d6a6444bba5 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:53.164856 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50225bc6-d4c6-4cd3-bd74-1cad9ca97f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:53.165504 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50225bc6-d4c6-4cd3-bd74-1cad9ca97f35 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:53.165791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50225bc6-d4c6-4cd3-bd74-1cad9ca97f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:53.166074 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50225bc6-d4c6-4cd3-bd74-1cad9ca97f35 None admin] PATH_INFO: `/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:53.167257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50225bc6-d4c6-4cd3-bd74-1cad9ca97f35 None admin] RBAC: Authorizing `identity:get_group(group_id=3fa9c9178fef4d79aebc3c1ceffdfead)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:53.168707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50225bc6-d4c6-4cd3-bd74-1cad9ca97f35 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:53.170291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 195/389] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 27 04:06:52 2022] GET /identity/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:53.171515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682ad75-1c69-4878-8d8d-ef959987ff17 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:53.172748 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682ad75-1c69-4878-8d8d-ef959987ff17 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:53.172748 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682ad75-1c69-4878-8d8d-ef959987ff17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:53.191741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-6682ad75-1c69-4878-8d8d-ef959987ff17 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:53.192104 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6682ad75-1c69-4878-8d8d-ef959987ff17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:53.197089 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc95ebb-e782-48fe-995d-bb5cb38c151c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:53.248552 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a7c4a-f0c7-44f4-99e1-ea1e1b311241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:53.249694 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a7c4a-f0c7-44f4-99e1-ea1e1b311241 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:53.250178 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a7c4a-f0c7-44f4-99e1-ea1e1b311241 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:53.250685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a7c4a-f0c7-44f4-99e1-ea1e1b311241 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:53.251704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a7c4a-f0c7-44f4-99e1-ea1e1b311241 None admin] RBAC: Adding query filter params (name=member) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:53.252428 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a7c4a-f0c7-44f4-99e1-ea1e1b311241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:53.255494 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a7c4a-f0c7-44f4-99e1-ea1e1b311241 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:53.266336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 195/390] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:53.267506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a7c4a-f0c7-44f4-99e1-ea1e1b311241 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:53.275863 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 196/391] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:53.276786 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682ad75-1c69-4878-8d8d-ef959987ff17 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:53.328115 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:53.382950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a7c4a-f0c7-44f4-99e1-ea1e1b311241 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:53.426357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f69b9-80ff-4915-b8f4-91d918a7b876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:53.427414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f69b9-80ff-4915-b8f4-91d918a7b876 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:53.428084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f69b9-80ff-4915-b8f4-91d918a7b876 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:53.430014 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f69b9-80ff-4915-b8f4-91d918a7b876 None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:53.431561 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f69b9-80ff-4915-b8f4-91d918a7b876 None admin] RBAC: Authorizing `identity:get_project(project_id=26f3d9baa4614c7ab91952d7e5132734)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:53.432418 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:53.434203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f69b9-80ff-4915-b8f4-91d918a7b876 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:53.436279 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 196/392] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:53 2022] GET /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:53.446740 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682ad75-1c69-4878-8d8d-ef959987ff17 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:53.450959 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f69b9-80ff-4915-b8f4-91d918a7b876 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:53.494376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37dfe7-39c1-48d8-b8b2-fb7879347127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:53.495218 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37dfe7-39c1-48d8-b8b2-fb7879347127 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:53.495506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37dfe7-39c1-48d8-b8b2-fb7879347127 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:53.495825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37dfe7-39c1-48d8-b8b2-fb7879347127 None admin] PATH_INFO: `/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:53.496942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37dfe7-39c1-48d8-b8b2-fb7879347127 None admin] RBAC: Authorizing `identity:get_group(group_id=3fa9c9178fef4d79aebc3c1ceffdfead)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:53.498647 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37dfe7-39c1-48d8-b8b2-fb7879347127 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:53.501002 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 197/393] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 27 04:06:53 2022] GET /identity/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:53.506843 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37dfe7-39c1-48d8-b8b2-fb7879347127 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:53.627454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:53.654062 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f69b9-80ff-4915-b8f4-91d918a7b876 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:53.671328 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37dfe7-39c1-48d8-b8b2-fb7879347127 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:53.693722 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d28dc0-885b-4d65-a4cc-6e6380bd8b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:53.694350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d28dc0-885b-4d65-a4cc-6e6380bd8b5d None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:53.694637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d28dc0-885b-4d65-a4cc-6e6380bd8b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:53.694948 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d28dc0-885b-4d65-a4cc-6e6380bd8b5d None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734/groups/3fa9c9178fef4d79aebc3c1ceffdfead/roles/9e2965c7d68d423a965894a8eb16903f` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:53.698419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d28dc0-885b-4d65-a4cc-6e6380bd8b5d None admin] RBAC: Authorizing `identity:create_grant(project_id=26f3d9baa4614c7ab91952d7e5132734, group_id=3fa9c9178fef4d79aebc3c1ceffdfead, role_id=9e2965c7d68d423a965894a8eb16903f)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:53.701186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d28dc0-885b-4d65-a4cc-6e6380bd8b5d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:53.719635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 197/394] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Sep 27 04:06:53 2022] PUT /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734/groups/3fa9c9178fef4d79aebc3c1ceffdfead/roles/9e2965c7d68d423a965894a8eb16903f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:06:53.720230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c3a82-75dc-43e5-952d-28dd3c46a38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:53.720496 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d28dc0-885b-4d65-a4cc-6e6380bd8b5d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:53.723398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c3a82-75dc-43e5-952d-28dd3c46a38b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:53.724032 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c3a82-75dc-43e5-952d-28dd3c46a38b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:53.724512 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c3a82-75dc-43e5-952d-28dd3c46a38b None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:53.726596 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c3a82-75dc-43e5-952d-28dd3c46a38b None admin] RBAC: Authorizing `identity:get_project(project_id=26f3d9baa4614c7ab91952d7e5132734)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:53.728713 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c3a82-75dc-43e5-952d-28dd3c46a38b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:53.730769 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 198/395] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:53 2022] GET /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:53.737067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c3a82-75dc-43e5-952d-28dd3c46a38b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:53.774235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:53.863293 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c3a82-75dc-43e5-952d-28dd3c46a38b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:53.864867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d28dc0-885b-4d65-a4cc-6e6380bd8b5d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:53.911286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06152bb0-4ad6-4cb9-b20f-0333470a896f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:53.911286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06152bb0-4ad6-4cb9-b20f-0333470a896f None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:53.911286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06152bb0-4ad6-4cb9-b20f-0333470a896f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:53.911653 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06152bb0-4ad6-4cb9-b20f-0333470a896f None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734/groups/3fa9c9178fef4d79aebc3c1ceffdfead/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:53.912394 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca8131-65ba-43d0-8a54-bc87dfd22189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:53.913418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca8131-65ba-43d0-8a54-bc87dfd22189 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:53.913610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06152bb0-4ad6-4cb9-b20f-0333470a896f None admin] RBAC: Authorizing `identity:create_grant(project_id=26f3d9baa4614c7ab91952d7e5132734, group_id=3fa9c9178fef4d79aebc3c1ceffdfead, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:53.914077 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca8131-65ba-43d0-8a54-bc87dfd22189 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:53.914562 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca8131-65ba-43d0-8a54-bc87dfd22189 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:53.915124 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06152bb0-4ad6-4cb9-b20f-0333470a896f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:53.931298 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca8131-65ba-43d0-8a54-bc87dfd22189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:53.935929 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 199/396] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Sep 27 04:06:53 2022] PUT /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734/groups/3fa9c9178fef4d79aebc3c1ceffdfead/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:06:53.938363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-9cca8131-65ba-43d0-8a54-bc87dfd22189 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:53.938363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:53.938363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:53.938363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:53.938363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:53.938363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:53.938363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:53.938363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:53.938363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:53.938363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:53.938363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:53.938363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:53.938363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:53.938363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:53.938363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:53.938363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:53.939663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:53.939663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:53.939663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:53.939663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:53.939663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:53.939663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:53.939663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:53.939663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:53.939663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:53.939663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:53.939663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:53.939663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:53.939663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:53.939663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:53.939663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:53.939663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:53.940488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:53.940488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:53.940488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:53.940488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:53.940488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:53.940488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:53.940488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:53.940488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:53.940488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:53.940488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:53.940488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:53.940488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:06:53.944114 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 198/397] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:53.950625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06152bb0-4ad6-4cb9-b20f-0333470a896f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:54.051112 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:54.068400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06152bb0-4ad6-4cb9-b20f-0333470a896f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:54.114572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ac1be-6129-4536-9490-e03d23150fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:54.115254 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ac1be-6129-4536-9490-e03d23150fdd None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:54.115542 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ac1be-6129-4536-9490-e03d23150fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:54.115825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ac1be-6129-4536-9490-e03d23150fdd None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:54.116651 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ac1be-6129-4536-9490-e03d23150fdd None admin] RBAC: Adding query filter params (name=member) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:54.116964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ac1be-6129-4536-9490-e03d23150fdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:54.118418 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ac1be-6129-4536-9490-e03d23150fdd None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:54.128762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 200/398] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:54.135110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca8131-65ba-43d0-8a54-bc87dfd22189 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:54.151678 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:54.222948 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c04da1-6d2f-4cf8-a57e-cc14bb8802d8 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:54.223243 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c04da1-6d2f-4cf8-a57e-cc14bb8802d8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:54.223444 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c04da1-6d2f-4cf8-a57e-cc14bb8802d8 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:54.225105 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 201/399] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:54.231042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f473e-e72e-4b5b-b38e-f5fa88706c2a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:54.231337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f473e-e72e-4b5b-b38e-f5fa88706c2a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:54.231601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f473e-e72e-4b5b-b38e-f5fa88706c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:54.264785 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-cf4f473e-e72e-4b5b-b38e-f5fa88706c2a None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:54.265949 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cf4f473e-e72e-4b5b-b38e-f5fa88706c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:54.271513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca8131-65ba-43d0-8a54-bc87dfd22189 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:54.315506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe5043-bbd1-4385-83a6-43d84cf4e269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:54.316149 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe5043-bbd1-4385-83a6-43d84cf4e269 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:54.316434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe5043-bbd1-4385-83a6-43d84cf4e269 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:54.316715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe5043-bbd1-4385-83a6-43d84cf4e269 None admin] PATH_INFO: `/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:54.317845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe5043-bbd1-4385-83a6-43d84cf4e269 None admin] RBAC: Authorizing `identity:get_group(group_id=3fa9c9178fef4d79aebc3c1ceffdfead)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:54.319891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe5043-bbd1-4385-83a6-43d84cf4e269 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:54.321780 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 199/400] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 27 04:06:54 2022] GET /identity/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:54.323036 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072f030-bd80-4426-a46a-7de10719fd15 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:54.323323 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072f030-bd80-4426-a46a-7de10719fd15 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:54.323604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072f030-bd80-4426-a46a-7de10719fd15 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:54.325059 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 200/401] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:54.330880 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072f030-bd80-4426-a46a-7de10719fd15 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:54.363382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 202/402] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:06:54.365241 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b86266-aa79-4cf7-a58b-7e58e4e9365c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:54.365966 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b86266-aa79-4cf7-a58b-7e58e4e9365c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:54.367407 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b86266-aa79-4cf7-a58b-7e58e4e9365c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:54.393607 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-92b86266-aa79-4cf7-a58b-7e58e4e9365c None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:54.397219 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-92b86266-aa79-4cf7-a58b-7e58e4e9365c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:54.431501 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:54.462066 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072f030-bd80-4426-a46a-7de10719fd15 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:54.501409 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb0458-8c88-4c5e-a42d-7561c692dedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:54.502377 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb0458-8c88-4c5e-a42d-7561c692dedc None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:54.502903 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb0458-8c88-4c5e-a42d-7561c692dedc None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:54.503373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb0458-8c88-4c5e-a42d-7561c692dedc None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:54.504773 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb0458-8c88-4c5e-a42d-7561c692dedc None admin] RBAC: Authorizing `identity:get_project(project_id=a4a05ac2e47b41afb49b5304780a242e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:54.506583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb0458-8c88-4c5e-a42d-7561c692dedc None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:54.509356 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 201/403] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:54 2022] GET /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:54.515595 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb0458-8c88-4c5e-a42d-7561c692dedc None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:54.547979 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 203/404] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:54.624568 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb0458-8c88-4c5e-a42d-7561c692dedc None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:54.660090 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37754e13-1319-4fc3-accf-3af49ab5007a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:54.661071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37754e13-1319-4fc3-accf-3af49ab5007a None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:54.661544 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37754e13-1319-4fc3-accf-3af49ab5007a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:54.661999 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37754e13-1319-4fc3-accf-3af49ab5007a None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e/groups/3fa9c9178fef4d79aebc3c1ceffdfead/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:54.664716 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37754e13-1319-4fc3-accf-3af49ab5007a None admin] RBAC: Authorizing `identity:create_grant(project_id=a4a05ac2e47b41afb49b5304780a242e, group_id=3fa9c9178fef4d79aebc3c1ceffdfead, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:54.666468 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37754e13-1319-4fc3-accf-3af49ab5007a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:54.686763 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 202/405] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Sep 27 04:06:54 2022] PUT /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e/groups/3fa9c9178fef4d79aebc3c1ceffdfead/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:06:54.703916 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b86266-aa79-4cf7-a58b-7e58e4e9365c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:54.715251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:54.826707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b86266-aa79-4cf7-a58b-7e58e4e9365c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:54.878922 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71def17-4b45-4e83-8132-82bc93fcc80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:54.879575 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71def17-4b45-4e83-8132-82bc93fcc80c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:54.879858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71def17-4b45-4e83-8132-82bc93fcc80c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:54.880127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71def17-4b45-4e83-8132-82bc93fcc80c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:54.901993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71def17-4b45-4e83-8132-82bc93fcc80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:54.906895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-b71def17-4b45-4e83-8132-82bc93fcc80c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:54.906895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:54.906895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:54.906895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:54.906895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:54.906895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:54.906895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:54.906895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:54.906895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:54.906895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:54.906895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:54.906895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:54.906895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:54.906895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:54.906895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:54.906895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:54.907827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:54.907827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:54.907827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:54.907827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:54.907827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:54.907827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:54.907827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:54.907827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:54.907827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:54.907827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:54.907827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:54.907827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:54.907827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:54.907827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:54.907827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:54.907827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:54.908672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:54.908672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:54.908672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:54.908672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:54.908672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:54.908672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:54.908672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:54.908672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:54.908672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:54.908672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:54.908672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:54.908672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:54.908672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 204/406] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:06:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:54.914787 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37754e13-1319-4fc3-accf-3af49ab5007a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:54.917959 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:54.989583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71def17-4b45-4e83-8132-82bc93fcc80c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:55.048334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37754e13-1319-4fc3-accf-3af49ab5007a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:55.065722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:55.108823 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182c62b-f3cf-4b8e-b913-12c1724b1ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:55.109355 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182c62b-f3cf-4b8e-b913-12c1724b1ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:55.109634 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182c62b-f3cf-4b8e-b913-12c1724b1ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:55.109901 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182c62b-f3cf-4b8e-b913-12c1724b1ad5 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:55.110576 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182c62b-f3cf-4b8e-b913-12c1724b1ad5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:55.110902 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182c62b-f3cf-4b8e-b913-12c1724b1ad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:55.112269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182c62b-f3cf-4b8e-b913-12c1724b1ad5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:55.116814 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71def17-4b45-4e83-8132-82bc93fcc80c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:55.130919 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 203/407] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:55.139796 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182c62b-f3cf-4b8e-b913-12c1724b1ad5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:55.182773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22963829-b650-4652-b764-225f2721b225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:55.183537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22963829-b650-4652-b764-225f2721b225 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:55.183817 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22963829-b650-4652-b764-225f2721b225 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:55.184121 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22963829-b650-4652-b764-225f2721b225 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:55.195378 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22963829-b650-4652-b764-225f2721b225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:55.200377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-22963829-b650-4652-b764-225f2721b225 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:55.200377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:55.200377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:55.200377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:55.200377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:55.200377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:55.200377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:55.200377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:55.200377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:55.200377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:55.200377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:55.200377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:55.200377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:55.200377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:55.200377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:55.200377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:55.201275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:55.201275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:55.201275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:55.201275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:55.201275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:55.201275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:55.201275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:55.201275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:55.201275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:55.201275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:55.201275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:55.201275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:55.201275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:55.201275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:55.201275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:55.201275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:55.202069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:55.202069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:55.202069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:55.202069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:55.202069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:55.202069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:55.202069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:55.202069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:55.202069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:55.202069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:55.202069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:55.202069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:55.206359 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 205/408] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:06:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:55.207649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22963829-b650-4652-b764-225f2721b225 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:55.276644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:55.328797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182c62b-f3cf-4b8e-b913-12c1724b1ad5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:55.377916 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22963829-b650-4652-b764-225f2721b225 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:55.395894 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14d792-302c-498b-a6b9-f9ac1550f8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:55.396850 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14d792-302c-498b-a6b9-f9ac1550f8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:55.399816 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14d792-302c-498b-a6b9-f9ac1550f8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:55.400313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14d792-302c-498b-a6b9-f9ac1550f8a7 None admin] PATH_INFO: `/v3/groups/e5b34c26e96f4098b9c9dd2c0bda7920` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:55.407436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14d792-302c-498b-a6b9-f9ac1550f8a7 None admin] RBAC: Authorizing `identity:get_group(group_id=e5b34c26e96f4098b9c9dd2c0bda7920)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:55.409152 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14d792-302c-498b-a6b9-f9ac1550f8a7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:55.411519 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 204/409] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 27 04:06:55 2022] GET /identity/v3/groups/e5b34c26e96f4098b9c9dd2c0bda7920 => generated 229 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:55.417268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14d792-302c-498b-a6b9-f9ac1550f8a7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:55.418504 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:55.430381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f94a01-cbc9-4bbc-8c46-fa2a212a42bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:55.431027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f94a01-cbc9-4bbc-8c46-fa2a212a42bd None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:55.431366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f94a01-cbc9-4bbc-8c46-fa2a212a42bd None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:55.432042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f94a01-cbc9-4bbc-8c46-fa2a212a42bd None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:55.432355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f94a01-cbc9-4bbc-8c46-fa2a212a42bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:55.432659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f94a01-cbc9-4bbc-8c46-fa2a212a42bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:55.434047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f94a01-cbc9-4bbc-8c46-fa2a212a42bd None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:55.444834 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 206/410] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:06:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:55.456078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f94a01-cbc9-4bbc-8c46-fa2a212a42bd None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:55.531704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14d792-302c-498b-a6b9-f9ac1550f8a7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:55.563658 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:55.570610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfed28-da54-4674-9092-16188c1b8c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:55.571604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfed28-da54-4674-9092-16188c1b8c3e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:55.573332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfed28-da54-4674-9092-16188c1b8c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:55.573828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfed28-da54-4674-9092-16188c1b8c3e None admin] PATH_INFO: `/v3/projects/97e2274f8eaa462ba6cf2944e7e36afb` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:55.575811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfed28-da54-4674-9092-16188c1b8c3e None admin] RBAC: Authorizing `identity:get_project(project_id=97e2274f8eaa462ba6cf2944e7e36afb)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:55.577661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfed28-da54-4674-9092-16188c1b8c3e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:55.582117 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 205/411] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:55 2022] GET /identity/v3/projects/97e2274f8eaa462ba6cf2944e7e36afb => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:55.587853 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfed28-da54-4674-9092-16188c1b8c3e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:55.677885 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f94a01-cbc9-4bbc-8c46-fa2a212a42bd None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:55.747035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca8681-5014-479a-b293-5dfb17e91600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:55.747665 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca8681-5014-479a-b293-5dfb17e91600 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:55.747942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca8681-5014-479a-b293-5dfb17e91600 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:55.748211 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca8681-5014-479a-b293-5dfb17e91600 None admin] PATH_INFO: `/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:55.749498 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca8681-5014-479a-b293-5dfb17e91600 None admin] RBAC: Authorizing `identity:get_group(group_id=3fa9c9178fef4d79aebc3c1ceffdfead)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:55.751764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca8681-5014-479a-b293-5dfb17e91600 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:55.754064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 207/412] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 27 04:06:55 2022] GET /identity/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead => generated 226 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:55.756279 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfed28-da54-4674-9092-16188c1b8c3e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:55.759494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca8681-5014-479a-b293-5dfb17e91600 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:55.824506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e332f2-53d2-461e-8534-f189a78a8a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:55.825173 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e332f2-53d2-461e-8534-f189a78a8a1d None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:55.825451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e332f2-53d2-461e-8534-f189a78a8a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:55.825726 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e332f2-53d2-461e-8534-f189a78a8a1d None admin] PATH_INFO: `/v3/projects/97e2274f8eaa462ba6cf2944e7e36afb/groups/e5b34c26e96f4098b9c9dd2c0bda7920/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:55.832278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e332f2-53d2-461e-8534-f189a78a8a1d None admin] RBAC: Authorizing `identity:create_grant(project_id=97e2274f8eaa462ba6cf2944e7e36afb, group_id=e5b34c26e96f4098b9c9dd2c0bda7920, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:55.833729 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e332f2-53d2-461e-8534-f189a78a8a1d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:55.857975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:55.862336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 206/413] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Sep 27 04:06:55 2022] PUT /identity/v3/projects/97e2274f8eaa462ba6cf2944e7e36afb/groups/e5b34c26e96f4098b9c9dd2c0bda7920/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:06:55.922149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca8681-5014-479a-b293-5dfb17e91600 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:55.971863 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accbc41-f6a2-40e0-9578-2a68c6cdd2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:55.972419 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accbc41-f6a2-40e0-9578-2a68c6cdd2de None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:55.972701 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accbc41-f6a2-40e0-9578-2a68c6cdd2de None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:55.973032 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accbc41-f6a2-40e0-9578-2a68c6cdd2de None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:55.974176 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accbc41-f6a2-40e0-9578-2a68c6cdd2de None admin] RBAC: Authorizing `identity:get_project(project_id=a4a05ac2e47b41afb49b5304780a242e)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:55.976307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accbc41-f6a2-40e0-9578-2a68c6cdd2de None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:55.978596 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 208/414] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:55 2022] GET /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:55.987850 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e332f2-53d2-461e-8534-f189a78a8a1d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:56.086605 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:56.143628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e332f2-53d2-461e-8534-f189a78a8a1d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:56.192847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563f8d6-6553-47f1-ae61-69ffedeedae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:56.193772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563f8d6-6553-47f1-ae61-69ffedeedae7 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:56.194740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563f8d6-6553-47f1-ae61-69ffedeedae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:56.195167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563f8d6-6553-47f1-ae61-69ffedeedae7 None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e/groups/3fa9c9178fef4d79aebc3c1ceffdfead/roles/9e2965c7d68d423a965894a8eb16903f` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:56.197514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563f8d6-6553-47f1-ae61-69ffedeedae7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4a05ac2e47b41afb49b5304780a242e, group_id=3fa9c9178fef4d79aebc3c1ceffdfead, role_id=9e2965c7d68d423a965894a8eb16903f)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:56.199168 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563f8d6-6553-47f1-ae61-69ffedeedae7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:56.226368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 207/415] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Sep 27 04:06:55 2022] PUT /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e/groups/3fa9c9178fef4d79aebc3c1ceffdfead/roles/9e2965c7d68d423a965894a8eb16903f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:06:56.476519 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc1b25-1b0f-4d72-b337-62f9f26f4f8f None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:56.476993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc1b25-1b0f-4d72-b337-62f9f26f4f8f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:56.476993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc1b25-1b0f-4d72-b337-62f9f26f4f8f None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:56.478848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 209/416] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:56.484087 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d24193-6f49-46c5-ae98-f221618ffc88 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:56.484541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d24193-6f49-46c5-ae98-f221618ffc88 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:56.484838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d24193-6f49-46c5-ae98-f221618ffc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:56.505417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-33d24193-6f49-46c5-ae98-f221618ffc88 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:56.506669 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-33d24193-6f49-46c5-ae98-f221618ffc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:56.583251 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 208/417] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:56.621412 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8b754-2a3e-4585-ac17-c8aa4529798f None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:56.621764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8b754-2a3e-4585-ac17-c8aa4529798f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:56.621975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8b754-2a3e-4585-ac17-c8aa4529798f None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:56.623621 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 210/418] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:56.629038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61084ce7-9a94-4b60-9037-28d433b7e597 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:56.629554 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61084ce7-9a94-4b60-9037-28d433b7e597 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:56.630031 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61084ce7-9a94-4b60-9037-28d433b7e597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:56.659677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-61084ce7-9a94-4b60-9037-28d433b7e597 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:56.661193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-61084ce7-9a94-4b60-9037-28d433b7e597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:56.714368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:56.747205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 209/419] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:56.881108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8b754-2a3e-4585-ac17-c8aa4529798f None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:57.010015 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8b754-2a3e-4585-ac17-c8aa4529798f None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:57.038926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:57.049100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a5a1a-751d-4b29-a1ac-132a67b5f32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:57.049733 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a5a1a-751d-4b29-a1ac-132a67b5f32e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:57.050017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a5a1a-751d-4b29-a1ac-132a67b5f32e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:57.050297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a5a1a-751d-4b29-a1ac-132a67b5f32e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:57.061579 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a5a1a-751d-4b29-a1ac-132a67b5f32e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:57.067064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-a99a5a1a-751d-4b29-a1ac-132a67b5f32e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:57.067064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:57.067064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:57.067064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:57.067064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:57.067064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:57.067064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:57.067064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:57.067064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:57.067064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:57.067064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:57.067064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:57.067064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:57.067064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:57.067064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:57.067064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:57.067942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:57.067942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:57.067942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:57.067942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:57.067942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:57.067942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:57.067942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:57.067942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:57.067942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:57.067942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:57.067942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:57.067942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:57.067942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:57.067942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:57.067942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:57.067942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:57.068798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:57.068798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:57.068798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:57.068798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:57.068798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:57.068798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:57.068798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:57.068798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:57.068798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:57.068798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:57.068798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:57.068798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:57.068798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 211/420] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:06:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:57.074425 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61084ce7-9a94-4b60-9037-28d433b7e597 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:57.155699 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a5a1a-751d-4b29-a1ac-132a67b5f32e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:57.183512 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61084ce7-9a94-4b60-9037-28d433b7e597 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:57.231699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d2c88-f487-4167-bf96-61e0f77585cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:57.232577 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d2c88-f487-4167-bf96-61e0f77585cf None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:57.233114 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d2c88-f487-4167-bf96-61e0f77585cf None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:57.233567 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d2c88-f487-4167-bf96-61e0f77585cf None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:57.234397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d2c88-f487-4167-bf96-61e0f77585cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:57.234897 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d2c88-f487-4167-bf96-61e0f77585cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:57.236644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d2c88-f487-4167-bf96-61e0f77585cf None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:57.245658 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 210/421] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:06:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:57.251582 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d2c88-f487-4167-bf96-61e0f77585cf None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:57.315542 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:57.347833 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a5a1a-751d-4b29-a1ac-132a67b5f32e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:57.412871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d037ff-4794-4d25-8a0c-1751d5e7eabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:57.414013 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d037ff-4794-4d25-8a0c-1751d5e7eabf None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:57.414296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d037ff-4794-4d25-8a0c-1751d5e7eabf None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:57.414571 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d037ff-4794-4d25-8a0c-1751d5e7eabf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:57.426249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d2c88-f487-4167-bf96-61e0f77585cf None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:57.440484 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d037ff-4794-4d25-8a0c-1751d5e7eabf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:57.447486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-74d037ff-4794-4d25-8a0c-1751d5e7eabf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:57.447486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:57.447486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:57.447486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:57.447486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:57.447486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:57.447486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:57.447486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:57.447486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:57.447486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:57.447486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:57.447486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:57.447486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:57.447486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:57.447486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:57.447486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:57.448421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:57.448421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:57.448421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:57.448421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:57.448421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:57.448421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:57.448421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:57.448421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:57.448421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:57.448421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:57.448421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:57.448421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:57.448421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:57.448421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:57.448421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:57.448421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:57.449214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:57.449214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:57.449214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:57.449214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:57.449214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:57.449214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:57.449214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:57.449214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:57.449214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:57.449214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:57.449214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:57.449214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:57.449214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 212/422] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:06:57.460561 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d037ff-4794-4d25-8a0c-1751d5e7eabf None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:57.484869 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cca1eb-ac71-4075-a631-4528089abfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:57.485586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cca1eb-ac71-4075-a631-4528089abfaa None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:57.486089 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cca1eb-ac71-4075-a631-4528089abfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:57.486499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cca1eb-ac71-4075-a631-4528089abfaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:57.548776 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:57.605365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cca1eb-ac71-4075-a631-4528089abfaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:57.606773 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cca1eb-ac71-4075-a631-4528089abfaa None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:57.627277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d037ff-4794-4d25-8a0c-1751d5e7eabf None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:57.661498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:57.665743 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce55992-6bc8-4eae-a14b-df57f8ecb218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:57.666906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce55992-6bc8-4eae-a14b-df57f8ecb218 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:57.667290 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce55992-6bc8-4eae-a14b-df57f8ecb218 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:57.667666 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce55992-6bc8-4eae-a14b-df57f8ecb218 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:57.668455 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce55992-6bc8-4eae-a14b-df57f8ecb218 None admin] RBAC: Adding query filter params (name=member) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:57.668933 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce55992-6bc8-4eae-a14b-df57f8ecb218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:57.670522 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce55992-6bc8-4eae-a14b-df57f8ecb218 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:57.684610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 213/423] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:57.686012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227fae1-548b-4722-ad39-2fd510cf6b74 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:57.686402 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227fae1-548b-4722-ad39-2fd510cf6b74 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:57.686905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227fae1-548b-4722-ad39-2fd510cf6b74 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:57.688624 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 214/424] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:57.689465 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227fae1-548b-4722-ad39-2fd510cf6b74 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:57.730810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 211/425] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:57.732247 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a06cf-759b-426e-8570-c739f47a0116 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:57.732536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a06cf-759b-426e-8570-c739f47a0116 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:57.732812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a06cf-759b-426e-8570-c739f47a0116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:57.753601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-958a06cf-759b-426e-8570-c739f47a0116 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:57.754530 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-958a06cf-759b-426e-8570-c739f47a0116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:57.823130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227fae1-548b-4722-ad39-2fd510cf6b74 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:57.833964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:57.840419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 212/426] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:06:57.841707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a06cf-759b-426e-8570-c739f47a0116 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:57.876136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361e658-355b-48b4-9bb7-a9f85c0b4f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:57.877153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361e658-355b-48b4-9bb7-a9f85c0b4f53 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:57.877717 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361e658-355b-48b4-9bb7-a9f85c0b4f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:57.878194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361e658-355b-48b4-9bb7-a9f85c0b4f53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:57.919003 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:57.952978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a06cf-759b-426e-8570-c739f47a0116 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:57.962750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361e658-355b-48b4-9bb7-a9f85c0b4f53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:57.964516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361e658-355b-48b4-9bb7-a9f85c0b4f53 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:57.992056 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5368e7-c823-41d5-b800-20a6ec3b157f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:57.992820 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5368e7-c823-41d5-b800-20a6ec3b157f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:57.993106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5368e7-c823-41d5-b800-20a6ec3b157f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:57.993379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5368e7-c823-41d5-b800-20a6ec3b157f None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:57.994523 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5368e7-c823-41d5-b800-20a6ec3b157f None admin] RBAC: Authorizing `identity:get_project(project_id=26f3d9baa4614c7ab91952d7e5132734)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:57.996179 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5368e7-c823-41d5-b800-20a6ec3b157f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:57.997898 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 213/427] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:57 2022] GET /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:58.007635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5368e7-c823-41d5-b800-20a6ec3b157f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:58.161605 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 215/428] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:58.168698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361e658-355b-48b4-9bb7-a9f85c0b4f53 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:58.176379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5368e7-c823-41d5-b800-20a6ec3b157f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:58.183307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:58.216030 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7c090-fe8d-4fcb-b44e-bfe09735319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:58.216667 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7c090-fe8d-4fcb-b44e-bfe09735319a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:58.216946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7c090-fe8d-4fcb-b44e-bfe09735319a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:58.217727 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7c090-fe8d-4fcb-b44e-bfe09735319a None admin] PATH_INFO: `/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:58.218867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7c090-fe8d-4fcb-b44e-bfe09735319a None admin] RBAC: Authorizing `identity:get_group(group_id=3fa9c9178fef4d79aebc3c1ceffdfead)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:58.220761 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7c090-fe8d-4fcb-b44e-bfe09735319a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:58.223403 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 214/429] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 27 04:06:58 2022] GET /identity/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:58.224354 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7c090-fe8d-4fcb-b44e-bfe09735319a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:58.238090 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:58.281331 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361e658-355b-48b4-9bb7-a9f85c0b4f53 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:58.323631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c703ee4-d655-46ec-909b-b75311c1fbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:58.324262 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c703ee4-d655-46ec-909b-b75311c1fbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:58.324540 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c703ee4-d655-46ec-909b-b75311c1fbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:58.324810 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c703ee4-d655-46ec-909b-b75311c1fbd3 None admin] PATH_INFO: `/v3/projects/26f3d9baa4614c7ab91952d7e5132734` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:58.325947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c703ee4-d655-46ec-909b-b75311c1fbd3 None admin] RBAC: Authorizing `identity:get_project(project_id=26f3d9baa4614c7ab91952d7e5132734)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:58.328067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c703ee4-d655-46ec-909b-b75311c1fbd3 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:58.330850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 216/430] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:58 2022] GET /identity/v3/projects/26f3d9baa4614c7ab91952d7e5132734 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:58.331711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c703ee4-d655-46ec-909b-b75311c1fbd3 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:58.346506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7c090-fe8d-4fcb-b44e-bfe09735319a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:58.387885 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66b4ba-0186-446c-8496-f84d7d168bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:58.388740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66b4ba-0186-446c-8496-f84d7d168bee None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:58.389125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66b4ba-0186-446c-8496-f84d7d168bee None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:58.389504 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66b4ba-0186-446c-8496-f84d7d168bee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:58.402926 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66b4ba-0186-446c-8496-f84d7d168bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:58.410027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-fd66b4ba-0186-446c-8496-f84d7d168bee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:58.410027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:58.410027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:58.410027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:58.410027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:58.410027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:58.410027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:58.410027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:58.410027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:58.410027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:58.410027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:58.410027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:58.410027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:58.410027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:58.410027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:58.410027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:58.410987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:58.410987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:58.410987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:58.410987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:58.410987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:58.410987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:58.410987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:58.410987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:58.410987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:58.410987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:58.410987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:58.410987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:58.410987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:58.410987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:58.410987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:58.410987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:58.411824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:58.411824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:58.411824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:58.411824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:58.411824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:58.411824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:58.411824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:58.411824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:58.411824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:58.411824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:58.411824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:06:58.411824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:06:58.411824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 215/431] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:58.412513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66b4ba-0186-446c-8496-f84d7d168bee None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:58.437246 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:58.463758 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c703ee4-d655-46ec-909b-b75311c1fbd3 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:58.485419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:58.500746 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6d7bd-ce07-43de-a494-70695b9279a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:58.501569 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6d7bd-ce07-43de-a494-70695b9279a5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:58.502068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6d7bd-ce07-43de-a494-70695b9279a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:58.502495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6d7bd-ce07-43de-a494-70695b9279a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:58.503398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6d7bd-ce07-43de-a494-70695b9279a5 None admin] RBAC: Adding query filter params (group.id=3fa9c9178fef4d79aebc3c1ceffdfead, role.id=9e2965c7d68d423a965894a8eb16903f, scope.project.id=26f3d9baa4614c7ab91952d7e5132734) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:58.503850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6d7bd-ce07-43de-a494-70695b9279a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:58.505427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6d7bd-ce07-43de-a494-70695b9279a5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:58.511719 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 217/432] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 27 04:06:58 2022] GET /identity/v3/role_assignments?group.id=3fa9c9178fef4d79aebc3c1ceffdfead&scope.project.id=26f3d9baa4614c7ab91952d7e5132734&role.id=9e2965c7d68d423a965894a8eb16903f => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:58.512988 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6d7bd-ce07-43de-a494-70695b9279a5 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:58.522950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66b4ba-0186-446c-8496-f84d7d168bee None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:58.561100 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01db00c-1c27-4c25-9880-9e87ae03f6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:58.561668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01db00c-1c27-4c25-9880-9e87ae03f6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:58.561990 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01db00c-1c27-4c25-9880-9e87ae03f6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:58.562272 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01db00c-1c27-4c25-9880-9e87ae03f6d5 None admin] PATH_INFO: `/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:58.563619 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01db00c-1c27-4c25-9880-9e87ae03f6d5 None admin] RBAC: Authorizing `identity:get_group(group_id=3fa9c9178fef4d79aebc3c1ceffdfead)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:58.565416 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01db00c-1c27-4c25-9880-9e87ae03f6d5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:58.567526 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 216/433] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 27 04:06:58 2022] GET /identity/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:58.573404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01db00c-1c27-4c25-9880-9e87ae03f6d5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:58.626662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6d7bd-ce07-43de-a494-70695b9279a5 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:58.666655 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def98280-4acd-4774-9ad5-09171b66194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:58.667488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def98280-4acd-4774-9ad5-09171b66194c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:58.667886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def98280-4acd-4774-9ad5-09171b66194c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:58.668259 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def98280-4acd-4774-9ad5-09171b66194c None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:58.669073 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def98280-4acd-4774-9ad5-09171b66194c None admin] RBAC: Adding query filter params (name=member) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:58.669485 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def98280-4acd-4774-9ad5-09171b66194c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:58.671085 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def98280-4acd-4774-9ad5-09171b66194c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:58.686156 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 218/434] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:06:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:58.688075 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def98280-4acd-4774-9ad5-09171b66194c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:58.690390 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01db00c-1c27-4c25-9880-9e87ae03f6d5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:58.691331 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:58.743374 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42ad41-7e88-4cd0-ba2c-c3de22841838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:58.744538 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42ad41-7e88-4cd0-ba2c-c3de22841838 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:58.744538 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42ad41-7e88-4cd0-ba2c-c3de22841838 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:58.744736 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42ad41-7e88-4cd0-ba2c-c3de22841838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:58.745566 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42ad41-7e88-4cd0-ba2c-c3de22841838 None admin] RBAC: Adding query filter params (group.id=3fa9c9178fef4d79aebc3c1ceffdfead, role.id=71cc6516aeff47eea3961db1a3d57f21, scope.project.id=26f3d9baa4614c7ab91952d7e5132734) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:58.745897 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42ad41-7e88-4cd0-ba2c-c3de22841838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:58.748042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42ad41-7e88-4cd0-ba2c-c3de22841838 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:58.751472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:58.755177 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 217/435] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 27 04:06:58 2022] GET /identity/v3/role_assignments?group.id=3fa9c9178fef4d79aebc3c1ceffdfead&scope.project.id=26f3d9baa4614c7ab91952d7e5132734&role.id=71cc6516aeff47eea3961db1a3d57f21 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:06:58.828607 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def98280-4acd-4774-9ad5-09171b66194c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:58.843574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b628f44-01ed-4126-951f-e0d4a5839704 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:58.844211 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b628f44-01ed-4126-951f-e0d4a5839704 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:58.844728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b628f44-01ed-4126-951f-e0d4a5839704 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:58.846745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 218/436] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:06:58.854261 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41de23f-49c7-4c7b-9dbb-30c85a58a73d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:58.854881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41de23f-49c7-4c7b-9dbb-30c85a58a73d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:58.855343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41de23f-49c7-4c7b-9dbb-30c85a58a73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:58.871861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ced501-3d63-48db-b95d-71376606e8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:58.872501 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ced501-3d63-48db-b95d-71376606e8ab None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:58.872785 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ced501-3d63-48db-b95d-71376606e8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:58.873060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ced501-3d63-48db-b95d-71376606e8ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:58.881513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c41de23f-49c7-4c7b-9dbb-30c85a58a73d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:58.883354 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c41de23f-49c7-4c7b-9dbb-30c85a58a73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:58.964165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ced501-3d63-48db-b95d-71376606e8ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:58.965571 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ced501-3d63-48db-b95d-71376606e8ab None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:58.970752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 219/437] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:06:58.970896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:58.970988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b9032-3337-44b4-972f-2f1731f9111a None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:58.970988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b9032-3337-44b4-972f-2f1731f9111a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:58.970988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b9032-3337-44b4-972f-2f1731f9111a None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:58.970988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 220/438] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:06:58.975358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc67bd-69cc-4db4-8c76-18b5da008b73 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:58.976184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc67bd-69cc-4db4-8c76-18b5da008b73 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:58.976456 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc67bd-69cc-4db4-8c76-18b5da008b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:58.995177 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-67cc67bd-69cc-4db4-8c76-18b5da008b73 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:06:58.996343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-67cc67bd-69cc-4db4-8c76-18b5da008b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:06:59.082903 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 221/439] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:06:59.093103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 219/440] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:06:59.098331 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc67bd-69cc-4db4-8c76-18b5da008b73 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:59.160845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:59.203702 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc67bd-69cc-4db4-8c76-18b5da008b73 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:59.241277 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70137b-b350-4128-9e3c-16021b57fe3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:59.242192 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70137b-b350-4128-9e3c-16021b57fe3a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:59.242475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70137b-b350-4128-9e3c-16021b57fe3a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:59.242770 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70137b-b350-4128-9e3c-16021b57fe3a None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:59.243906 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70137b-b350-4128-9e3c-16021b57fe3a None admin] RBAC: Authorizing `identity:get_project(project_id=a4a05ac2e47b41afb49b5304780a242e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:59.245343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70137b-b350-4128-9e3c-16021b57fe3a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:59.247291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 222/441] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:06:59 2022] GET /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:59.252734 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ced501-3d63-48db-b95d-71376606e8ab None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:59.255966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70137b-b350-4128-9e3c-16021b57fe3a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:59.376356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ced501-3d63-48db-b95d-71376606e8ab None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:59.378024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:59.379498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70137b-b350-4128-9e3c-16021b57fe3a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:59.417823 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:59.418818 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32b97c-4e3c-45fe-b87b-4bc0ee972a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:59.419106 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32b97c-4e3c-45fe-b87b-4bc0ee972a85 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:59.419432 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32b97c-4e3c-45fe-b87b-4bc0ee972a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:59.419776 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32b97c-4e3c-45fe-b87b-4bc0ee972a85 None admin] PATH_INFO: `/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:59.423099 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32b97c-4e3c-45fe-b87b-4bc0ee972a85 None admin] RBAC: Authorizing `identity:get_group(group_id=3fa9c9178fef4d79aebc3c1ceffdfead)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:59.423746 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32b97c-4e3c-45fe-b87b-4bc0ee972a85 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:59.426021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 220/442] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 27 04:06:59 2022] GET /identity/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:59.428232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32b97c-4e3c-45fe-b87b-4bc0ee972a85 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:59.428346 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4b994-b326-4784-b771-f220137780ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:59.428514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4b994-b326-4784-b771-f220137780ed None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:59.429277 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4b994-b326-4784-b771-f220137780ed None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:59.429533 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4b994-b326-4784-b771-f220137780ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:59.441105 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4b994-b326-4784-b771-f220137780ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:59.446524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-7da4b994-b326-4784-b771-f220137780ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:59.446524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:59.446524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:59.446524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:59.446524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:59.446524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:59.446524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:59.446524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:59.446524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:59.446524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:59.446524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:59.446524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:59.446524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:59.446524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:59.446524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:59.446524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:59.447528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:59.447528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:59.447528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:59.447528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:59.447528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:59.447528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:59.447528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:59.447528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:59.447528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:59.447528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:59.447528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:59.447528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:59.447528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:59.447528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:59.447528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:59.447528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:59.448340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:59.448340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:59.448340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:59.448340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:59.448340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:59.448340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:59.448340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:59.448340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:59.448340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:59.448340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:59.448340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:06:59.448340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:06:59.449777 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 223/443] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:06:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:59.450586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4b994-b326-4784-b771-f220137780ed None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:59.542215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32b97c-4e3c-45fe-b87b-4bc0ee972a85 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:59.565566 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4b994-b326-4784-b771-f220137780ed None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:59.574188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82944db-aa91-419a-9899-ea5de2cb09ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:59.574862 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82944db-aa91-419a-9899-ea5de2cb09ae None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:59.575132 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82944db-aa91-419a-9899-ea5de2cb09ae None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:59.575415 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82944db-aa91-419a-9899-ea5de2cb09ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:59.585729 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82944db-aa91-419a-9899-ea5de2cb09ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:06:59.591000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-d82944db-aa91-419a-9899-ea5de2cb09ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:59.591000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:06:59.591000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:06:59.591000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:06:59.591000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:06:59.591000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:06:59.591000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:06:59.591000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:06:59.591000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:06:59.591000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:06:59.591000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:06:59.591000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:06:59.591000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:06:59.591000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:06:59.591000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:06:59.591000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:06:59.591882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:06:59.591882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:06:59.591882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:06:59.591882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:06:59.591882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:06:59.591882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:06:59.591882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:06:59.591882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:06:59.591882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:06:59.591882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:06:59.591882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:06:59.591882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:06:59.591882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:06:59.591882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:06:59.591882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:06:59.591882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:06:59.592673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:06:59.592673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:06:59.592673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:06:59.592673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:06:59.592673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:06:59.592673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:06:59.592673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:06:59.592673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:06:59.592673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:06:59.592673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:06:59.592673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:06:59.592673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:06:59.592673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 221/444] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:06:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:06:59.593342 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82944db-aa91-419a-9899-ea5de2cb09ae None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:59.601416 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859cbc2-bc3d-4a7a-ab2e-9ef7b32ee5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:59.602132 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859cbc2-bc3d-4a7a-ab2e-9ef7b32ee5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:59.602406 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859cbc2-bc3d-4a7a-ab2e-9ef7b32ee5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:59.602674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859cbc2-bc3d-4a7a-ab2e-9ef7b32ee5d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:59.603699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859cbc2-bc3d-4a7a-ab2e-9ef7b32ee5d9 None admin] RBAC: Adding query filter params (group.id=3fa9c9178fef4d79aebc3c1ceffdfead, role.id=71cc6516aeff47eea3961db1a3d57f21, scope.project.id=a4a05ac2e47b41afb49b5304780a242e) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:59.604011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859cbc2-bc3d-4a7a-ab2e-9ef7b32ee5d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:59.605431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859cbc2-bc3d-4a7a-ab2e-9ef7b32ee5d9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:59.611221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 224/445] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 27 04:06:59 2022] GET /identity/v3/role_assignments?group.id=3fa9c9178fef4d79aebc3c1ceffdfead&scope.project.id=a4a05ac2e47b41afb49b5304780a242e&role.id=71cc6516aeff47eea3961db1a3d57f21 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:59.612001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859cbc2-bc3d-4a7a-ab2e-9ef7b32ee5d9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:59.624482 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:59.692085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:59.711825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82944db-aa91-419a-9899-ea5de2cb09ae None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:59.750269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859cbc2-bc3d-4a7a-ab2e-9ef7b32ee5d9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:59.752132 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1f631-a13a-4dd9-b049-1261eac2170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:59.752767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1f631-a13a-4dd9-b049-1261eac2170d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:59.753040 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1f631-a13a-4dd9-b049-1261eac2170d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:59.753310 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1f631-a13a-4dd9-b049-1261eac2170d None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:59.754008 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1f631-a13a-4dd9-b049-1261eac2170d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:59.754314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1f631-a13a-4dd9-b049-1261eac2170d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:59.755753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1f631-a13a-4dd9-b049-1261eac2170d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:59.765208 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 222/446] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:06:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:59.771493 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1f631-a13a-4dd9-b049-1261eac2170d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:59.793634 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7ecc5-c0f4-4da6-bd8e-87594856fca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:59.794178 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7ecc5-c0f4-4da6-bd8e-87594856fca9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:59.794461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7ecc5-c0f4-4da6-bd8e-87594856fca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:59.794756 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7ecc5-c0f4-4da6-bd8e-87594856fca9 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:59.795436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7ecc5-c0f4-4da6-bd8e-87594856fca9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:06:59.795746 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7ecc5-c0f4-4da6-bd8e-87594856fca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:06:59.797129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7ecc5-c0f4-4da6-bd8e-87594856fca9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:06:59.807830 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 225/447] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:06:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:06:59.814547 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7ecc5-c0f4-4da6-bd8e-87594856fca9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:06:59.887437 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:59.897703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1f631-a13a-4dd9-b049-1261eac2170d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:59.932175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7ecc5-c0f4-4da6-bd8e-87594856fca9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:06:59.940344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7790eb1-6126-40f2-a718-5fbcfafd437b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:59.940962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7790eb1-6126-40f2-a718-5fbcfafd437b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:59.941247 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7790eb1-6126-40f2-a718-5fbcfafd437b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:59.941524 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7790eb1-6126-40f2-a718-5fbcfafd437b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:06:59.947110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:06:59.972645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9939e-48e9-4d94-a1aa-47fb384cc6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:06:59.973252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9939e-48e9-4d94-a1aa-47fb384cc6ea None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:06:59.973530 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9939e-48e9-4d94-a1aa-47fb384cc6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:06:59.973834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9939e-48e9-4d94-a1aa-47fb384cc6ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:00.020940 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7790eb1-6126-40f2-a718-5fbcfafd437b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:00.022455 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7790eb1-6126-40f2-a718-5fbcfafd437b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:00.063928 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9939e-48e9-4d94-a1aa-47fb384cc6ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:00.065462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9939e-48e9-4d94-a1aa-47fb384cc6ea None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:00.109690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:00.119844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 223/448] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:07:00.125411 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7790eb1-6126-40f2-a718-5fbcfafd437b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:00.161648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 226/449] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:06:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 04:07:00.167571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9939e-48e9-4d94-a1aa-47fb384cc6ea None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:00.181448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:00.221376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7790eb1-6126-40f2-a718-5fbcfafd437b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:00.254727 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dfdb4-63b5-4c64-b462-da52dccf9e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:00.255370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dfdb4-63b5-4c64-b462-da52dccf9e52 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:00.255659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dfdb4-63b5-4c64-b462-da52dccf9e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:00.255936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dfdb4-63b5-4c64-b462-da52dccf9e52 None admin] PATH_INFO: `/v3/projects/97e2274f8eaa462ba6cf2944e7e36afb` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:00.257051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dfdb4-63b5-4c64-b462-da52dccf9e52 None admin] RBAC: Authorizing `identity:get_project(project_id=97e2274f8eaa462ba6cf2944e7e36afb)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:00.258496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dfdb4-63b5-4c64-b462-da52dccf9e52 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:00.260125 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 224/450] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:07:00 2022] GET /identity/v3/projects/97e2274f8eaa462ba6cf2944e7e36afb => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:07:00.265366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dfdb4-63b5-4c64-b462-da52dccf9e52 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:00.267380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9939e-48e9-4d94-a1aa-47fb384cc6ea None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:00.300907 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c4055-3244-40df-9411-0b9e5ef30582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:00.301537 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c4055-3244-40df-9411-0b9e5ef30582 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:00.301821 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c4055-3244-40df-9411-0b9e5ef30582 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:00.302099 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c4055-3244-40df-9411-0b9e5ef30582 None admin] PATH_INFO: `/v3/projects/a4a05ac2e47b41afb49b5304780a242e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:00.303252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c4055-3244-40df-9411-0b9e5ef30582 None admin] RBAC: Authorizing `identity:get_project(project_id=a4a05ac2e47b41afb49b5304780a242e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:00.304941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c4055-3244-40df-9411-0b9e5ef30582 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:00.312323 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 227/451] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:07:00 2022] GET /identity/v3/projects/a4a05ac2e47b41afb49b5304780a242e => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:07:00.313157 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c4055-3244-40df-9411-0b9e5ef30582 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:00.322932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:00.367314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dfdb4-63b5-4c64-b462-da52dccf9e52 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:00.398532 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:00.402529 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698db5c-c964-4ee9-a649-e120cceca8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:00.403256 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698db5c-c964-4ee9-a649-e120cceca8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:00.403566 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698db5c-c964-4ee9-a649-e120cceca8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:00.403896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698db5c-c964-4ee9-a649-e120cceca8c5 None admin] PATH_INFO: `/v3/groups/e5b34c26e96f4098b9c9dd2c0bda7920` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:00.405052 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698db5c-c964-4ee9-a649-e120cceca8c5 None admin] RBAC: Authorizing `identity:get_group(group_id=e5b34c26e96f4098b9c9dd2c0bda7920)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:00.406500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698db5c-c964-4ee9-a649-e120cceca8c5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:00.408109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 225/452] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 27 04:07:00 2022] GET /identity/v3/groups/e5b34c26e96f4098b9c9dd2c0bda7920 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:07:00.414233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698db5c-c964-4ee9-a649-e120cceca8c5 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:00.418088 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c4055-3244-40df-9411-0b9e5ef30582 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:00.450814 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e9943-e90d-4784-a886-8a45d8355cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:00.451441 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e9943-e90d-4784-a886-8a45d8355cea None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:00.451726 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e9943-e90d-4784-a886-8a45d8355cea None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:00.451998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e9943-e90d-4784-a886-8a45d8355cea None admin] PATH_INFO: `/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:00.453108 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e9943-e90d-4784-a886-8a45d8355cea None admin] RBAC: Authorizing `identity:get_group(group_id=3fa9c9178fef4d79aebc3c1ceffdfead)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:00.454549 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e9943-e90d-4784-a886-8a45d8355cea None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:00.456125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 228/453] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 27 04:07:00 2022] GET /identity/v3/groups/3fa9c9178fef4d79aebc3c1ceffdfead => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:07:00.462354 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e9943-e90d-4784-a886-8a45d8355cea None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:00.511179 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698db5c-c964-4ee9-a649-e120cceca8c5 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:00.536522 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:00.546323 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f190b73-aecb-4317-84f9-234b7ecfe247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:00.546958 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f190b73-aecb-4317-84f9-234b7ecfe247 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:00.547244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f190b73-aecb-4317-84f9-234b7ecfe247 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:00.547522 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f190b73-aecb-4317-84f9-234b7ecfe247 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:00.548259 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f190b73-aecb-4317-84f9-234b7ecfe247 None admin] RBAC: Adding query filter params (group.id=e5b34c26e96f4098b9c9dd2c0bda7920, role.id=2613cf4a98d44744a094c7782b19b4b5, scope.project.id=97e2274f8eaa462ba6cf2944e7e36afb) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:00.548570 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f190b73-aecb-4317-84f9-234b7ecfe247 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:00.549997 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f190b73-aecb-4317-84f9-234b7ecfe247 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:00.555829 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 226/454] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 27 04:07:00 2022] GET /identity/v3/role_assignments?group.id=e5b34c26e96f4098b9c9dd2c0bda7920&scope.project.id=97e2274f8eaa462ba6cf2944e7e36afb&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:00.559524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e9943-e90d-4784-a886-8a45d8355cea None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:00.595174 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e03629-2729-40f2-87f3-0ddb10afcea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:00.595806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e03629-2729-40f2-87f3-0ddb10afcea9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:00.595961 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e03629-2729-40f2-87f3-0ddb10afcea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:00.596234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e03629-2729-40f2-87f3-0ddb10afcea9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:00.596977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e03629-2729-40f2-87f3-0ddb10afcea9 None admin] RBAC: Adding query filter params (group.id=3fa9c9178fef4d79aebc3c1ceffdfead, role.id=9e2965c7d68d423a965894a8eb16903f, scope.project.id=a4a05ac2e47b41afb49b5304780a242e) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:00.597288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e03629-2729-40f2-87f3-0ddb10afcea9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:00.598775 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e03629-2729-40f2-87f3-0ddb10afcea9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:00.606044 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 229/455] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 27 04:07:00 2022] GET /identity/v3/role_assignments?group.id=3fa9c9178fef4d79aebc3c1ceffdfead&scope.project.id=a4a05ac2e47b41afb49b5304780a242e&role.id=9e2965c7d68d423a965894a8eb16903f => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:07:03.498694 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecf066-978e-461e-a4c8-4aa6cbd5542c None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:03.499224 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecf066-978e-461e-a4c8-4aa6cbd5542c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:03.499335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecf066-978e-461e-a4c8-4aa6cbd5542c None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:03.500985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 227/456] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:03.506017 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147832d5-342c-4490-9a41-4f0debcd20b5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:03.506467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147832d5-342c-4490-9a41-4f0debcd20b5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:03.507147 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147832d5-342c-4490-9a41-4f0debcd20b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:03.524174 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724163e5-6418-48c2-bd17-014281594f24 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:03.524508 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724163e5-6418-48c2-bd17-014281594f24 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:03.524738 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724163e5-6418-48c2-bd17-014281594f24 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:03.526340 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 228/457] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:03.532262 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06bf52-c5af-4cee-a3d4-5ef1c8c0c1e7 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:03.532796 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06bf52-c5af-4cee-a3d4-5ef1c8c0c1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:03.533289 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06bf52-c5af-4cee-a3d4-5ef1c8c0c1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:03.539097 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-147832d5-342c-4490-9a41-4f0debcd20b5 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:03.540485 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-147832d5-342c-4490-9a41-4f0debcd20b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:03.563071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:03.566376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-ae06bf52-c5af-4cee-a3d4-5ef1c8c0c1e7 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:03.569589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ae06bf52-c5af-4cee-a3d4-5ef1c8c0c1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:03.655135 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 230/458] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:03.699973 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 229/459] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:07:03.924116 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211477e-5e2c-4d79-bb34-d64cbeb79e96 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:03.924804 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211477e-5e2c-4d79-bb34-d64cbeb79e96 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:03.925413 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211477e-5e2c-4d79-bb34-d64cbeb79e96 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:03.927390 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 231/460] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:03.933405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fd228-0381-45de-97fc-5bcaa7af9615 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:03.934012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fd228-0381-45de-97fc-5bcaa7af9615 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:03.934481 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fd228-0381-45de-97fc-5bcaa7af9615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:03.960144 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-0f1fd228-0381-45de-97fc-5bcaa7af9615 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:03.961685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0f1fd228-0381-45de-97fc-5bcaa7af9615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:04.003777 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211477e-5e2c-4d79-bb34-d64cbeb79e96 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:04.053047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 230/461] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:04.054774 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31902cae-94df-4a91-ba47-b628a18e255d None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:04.055069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31902cae-94df-4a91-ba47-b628a18e255d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:04.055483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31902cae-94df-4a91-ba47-b628a18e255d None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:04.057324 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 231/462] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:04.062569 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999b1bc-62b3-45ac-bf7b-cb497b59bf1c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:04.062896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999b1bc-62b3-45ac-bf7b-cb497b59bf1c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:04.063182 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999b1bc-62b3-45ac-bf7b-cb497b59bf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:04.093484 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5999b1bc-62b3-45ac-bf7b-cb497b59bf1c None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:04.095008 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5999b1bc-62b3-45ac-bf7b-cb497b59bf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:04.143506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211477e-5e2c-4d79-bb34-d64cbeb79e96 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:04.157394 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:04.182699 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 232/463] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:04.183932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999b1bc-62b3-45ac-bf7b-cb497b59bf1c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:04.197086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc4567-0427-41ad-ada6-4c79914d33b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:04.198021 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc4567-0427-41ad-ada6-4c79914d33b7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:04.198306 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc4567-0427-41ad-ada6-4c79914d33b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:04.198582 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc4567-0427-41ad-ada6-4c79914d33b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:04.211784 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc4567-0427-41ad-ada6-4c79914d33b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:04.213606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc4567-0427-41ad-ada6-4c79914d33b7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:04.216965 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:04.235291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-cbcc4567-0427-41ad-ada6-4c79914d33b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:04.235291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:04.235291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:04.235291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:04.235291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:04.235291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:04.235291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:04.235291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:04.235291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:04.235291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:04.235291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:04.235291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:04.235291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:04.235291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:04.235291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:04.235291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:04.236244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:04.236244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:04.236244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:04.236244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:04.236244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:04.236244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:04.236244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:04.236244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:04.236244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:04.236244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:04.236244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:04.236244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:04.236244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:04.236244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:04.236244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:04.236244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:04.236244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:04.237091 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:04.237091 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:04.237091 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:04.237091 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 232/464] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:04.242876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc4567-0427-41ad-ada6-4c79914d33b7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:04.294760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999b1bc-62b3-45ac-bf7b-cb497b59bf1c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:04.333292 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4436aa6-5541-4f39-a9ba-99d5da3a9b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:04.334262 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4436aa6-5541-4f39-a9ba-99d5da3a9b4f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:04.335320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4436aa6-5541-4f39-a9ba-99d5da3a9b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:04.335807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4436aa6-5541-4f39-a9ba-99d5da3a9b4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:04.346414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4436aa6-5541-4f39-a9ba-99d5da3a9b4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:04.348171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4436aa6-5541-4f39-a9ba-99d5da3a9b4f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:04.365080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-a4436aa6-5541-4f39-a9ba-99d5da3a9b4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:04.365080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:04.365080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:04.365080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:04.365080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:04.365080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:04.365080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:04.365080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:04.365080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:04.365080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:04.365080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:04.365080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:04.365080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:04.365080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:04.365080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:04.365080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:04.366006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:04.366006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:04.366006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:04.366006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:04.366006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:04.366006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:04.366006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:04.366006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:04.366006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:04.366006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:04.366006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:04.366006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:04.366006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:04.366006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:04.366006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:04.366006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:04.366006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:04.366880 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:04.366880 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:04.366880 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:04.367040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc4567-0427-41ad-ada6-4c79914d33b7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:04.368996 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 233/465] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:04.374955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4436aa6-5541-4f39-a9ba-99d5da3a9b4f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:04.417118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c678b-09b1-4a48-86aa-7e65b6a059dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:04.420249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c678b-09b1-4a48-86aa-7e65b6a059dc None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:04.420774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c678b-09b1-4a48-86aa-7e65b6a059dc None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:04.421250 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c678b-09b1-4a48-86aa-7e65b6a059dc None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:04.424174 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c678b-09b1-4a48-86aa-7e65b6a059dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:04.424704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c678b-09b1-4a48-86aa-7e65b6a059dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:04.426928 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c678b-09b1-4a48-86aa-7e65b6a059dc None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:04.433237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:04.450857 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 233/466] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:04.457200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c678b-09b1-4a48-86aa-7e65b6a059dc None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:04.521464 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:04.531079 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4436aa6-5541-4f39-a9ba-99d5da3a9b4f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:04.572784 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a53cf-325c-4d91-bc95-2725e02fde91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:04.573760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a53cf-325c-4d91-bc95-2725e02fde91 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:04.574247 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a53cf-325c-4d91-bc95-2725e02fde91 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:04.574761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a53cf-325c-4d91-bc95-2725e02fde91 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:04.575614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a53cf-325c-4d91-bc95-2725e02fde91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:04.576153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a53cf-325c-4d91-bc95-2725e02fde91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:04.577103 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c678b-09b1-4a48-86aa-7e65b6a059dc None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:04.577844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a53cf-325c-4d91-bc95-2725e02fde91 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:04.596791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 234/467] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:04.598041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a53cf-325c-4d91-bc95-2725e02fde91 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:04.619971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01a9b2-1fa8-48b8-a45c-537830d61fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:04.620571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01a9b2-1fa8-48b8-a45c-537830d61fd8 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:04.620859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01a9b2-1fa8-48b8-a45c-537830d61fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:04.621137 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01a9b2-1fa8-48b8-a45c-537830d61fd8 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:04.621806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01a9b2-1fa8-48b8-a45c-537830d61fd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:04.623281 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01a9b2-1fa8-48b8-a45c-537830d61fd8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:04.645338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 234/468] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 27 04:07:04 2022] POST /identity/v3/users => generated 246 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:07:04.652035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01a9b2-1fa8-48b8-a45c-537830d61fd8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:04.709423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:04.719812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a53cf-325c-4d91-bc95-2725e02fde91 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:04.763003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b954d74-ba8e-4f9b-ace0-8af5c1edff10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:04.764006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b954d74-ba8e-4f9b-ace0-8af5c1edff10 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:04.764473 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b954d74-ba8e-4f9b-ace0-8af5c1edff10 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:04.764958 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b954d74-ba8e-4f9b-ace0-8af5c1edff10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:04.777585 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b954d74-ba8e-4f9b-ace0-8af5c1edff10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:04.779931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b954d74-ba8e-4f9b-ace0-8af5c1edff10 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:04.798078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-5b954d74-ba8e-4f9b-ace0-8af5c1edff10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:04.798078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:04.798078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:04.798078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:04.798078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:04.798078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:04.798078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:04.798078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:04.798078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:04.798078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:04.798078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:04.798078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:04.798078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:04.798078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:04.798078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:04.798078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:04.799327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:04.799327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:04.799327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:04.799327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:04.799327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:04.799327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:04.799327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:04.799327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:04.799327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:04.799327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:04.799327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:04.799327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:04.799327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:04.799327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:04.799327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:04.799327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:04.799327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:04.800237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:04.800237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:04.800237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:04.800413 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01a9b2-1fa8-48b8-a45c-537830d61fd8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:04.807190 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 235/469] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:04.808503 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b954d74-ba8e-4f9b-ace0-8af5c1edff10 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:04.814037 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:04.847528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b43c3-18ea-48b5-a915-88289e9b4bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:04.848953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b43c3-18ea-48b5-a915-88289e9b4bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:04.848953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b43c3-18ea-48b5-a915-88289e9b4bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:04.848953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b43c3-18ea-48b5-a915-88289e9b4bf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:04.863078 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b43c3-18ea-48b5-a915-88289e9b4bf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:04.865321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b43c3-18ea-48b5-a915-88289e9b4bf5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:04.883623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-440b43c3-18ea-48b5-a915-88289e9b4bf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:04.883623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:04.883623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:04.883623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:04.883623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:04.883623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:04.883623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:04.883623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:04.883623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:04.883623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:04.883623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:04.883623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:04.883623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:04.883623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:04.883623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:04.883623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:04.884573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:04.884573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:04.884573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:04.884573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:04.884573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:04.884573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:04.884573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:04.884573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:04.884573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:04.884573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:04.884573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:04.884573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:04.884573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:04.884573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:04.884573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:04.884573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:04.884573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:04.885433 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:04.885433 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:04.885433 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:04.887794 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 235/470] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:04.889191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b43c3-18ea-48b5-a915-88289e9b4bf5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:04.939000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b954d74-ba8e-4f9b-ace0-8af5c1edff10 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:04.986056 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6114c7b-7919-4e69-a328-12a894989e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:04.987789 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6114c7b-7919-4e69-a328-12a894989e98 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:04.988319 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6114c7b-7919-4e69-a328-12a894989e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:04.989062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6114c7b-7919-4e69-a328-12a894989e98 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:04.990202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6114c7b-7919-4e69-a328-12a894989e98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:04.992797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6114c7b-7919-4e69-a328-12a894989e98 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:05.007703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b43c3-18ea-48b5-a915-88289e9b4bf5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:05.024489 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 236/471] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 27 04:07:04 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:07:05.025857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6114c7b-7919-4e69-a328-12a894989e98 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:05.029223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:05.048105 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226bcb7-af62-4508-aa72-b0252211b730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:05.048833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226bcb7-af62-4508-aa72-b0252211b730 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:05.049195 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226bcb7-af62-4508-aa72-b0252211b730 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:05.049550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226bcb7-af62-4508-aa72-b0252211b730 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:05.050310 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226bcb7-af62-4508-aa72-b0252211b730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:05.050695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226bcb7-af62-4508-aa72-b0252211b730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:05.052355 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226bcb7-af62-4508-aa72-b0252211b730 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:05.071222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 236/472] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:05.071222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53634bf6-dc8c-4123-9fc6-d72e1fe021b5 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:05.071222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53634bf6-dc8c-4123-9fc6-d72e1fe021b5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:05.071222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53634bf6-dc8c-4123-9fc6-d72e1fe021b5 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:05.074778 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 237/473] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:05.075742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53634bf6-dc8c-4123-9fc6-d72e1fe021b5 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:05.104700 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:05.165255 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6114c7b-7919-4e69-a328-12a894989e98 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:05.204430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c7fd0-b10c-4822-9151-538bd0eebb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:05.205160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c7fd0-b10c-4822-9151-538bd0eebb8b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:05.205520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c7fd0-b10c-4822-9151-538bd0eebb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:05.206014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c7fd0-b10c-4822-9151-538bd0eebb8b None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:05.206602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c7fd0-b10c-4822-9151-538bd0eebb8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:05.207091 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c7fd0-b10c-4822-9151-538bd0eebb8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:05.208575 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c7fd0-b10c-4822-9151-538bd0eebb8b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:05.218697 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53634bf6-dc8c-4123-9fc6-d72e1fe021b5 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:05.221937 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 237/474] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:05.223406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5985f-9d22-40e7-a8a7-1057b6c6e551 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:05.223760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5985f-9d22-40e7-a8a7-1057b6c6e551 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:05.224098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5985f-9d22-40e7-a8a7-1057b6c6e551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:05.247834 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-feb5985f-9d22-40e7-a8a7-1057b6c6e551 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:05.249068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-feb5985f-9d22-40e7-a8a7-1057b6c6e551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:05.261009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238e281-1116-474a-8711-0fc4c04bb80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:05.262462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238e281-1116-474a-8711-0fc4c04bb80f None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:05.262462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238e281-1116-474a-8711-0fc4c04bb80f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:05.262462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238e281-1116-474a-8711-0fc4c04bb80f None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:05.263260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238e281-1116-474a-8711-0fc4c04bb80f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:05.264720 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238e281-1116-474a-8711-0fc4c04bb80f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:05.298504 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 238/475] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 27 04:07:05 2022] POST /identity/v3/users => generated 248 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:07:05.300943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238e281-1116-474a-8711-0fc4c04bb80f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:05.324938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:05.339255 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 238/476] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:05.441914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:05.471837 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238e281-1116-474a-8711-0fc4c04bb80f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:05.517274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3bfa8-bf63-4ba3-a9ea-b4dada5e8a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:05.517814 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3bfa8-bf63-4ba3-a9ea-b4dada5e8a7d None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:05.518097 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3bfa8-bf63-4ba3-a9ea-b4dada5e8a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:05.518369 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3bfa8-bf63-4ba3-a9ea-b4dada5e8a7d None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:05.519075 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3bfa8-bf63-4ba3-a9ea-b4dada5e8a7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:05.520515 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3bfa8-bf63-4ba3-a9ea-b4dada5e8a7d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:05.545117 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 239/477] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 27 04:07:05 2022] POST /identity/v3/users => generated 249 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:07:05.670471 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5985f-9d22-40e7-a8a7-1057b6c6e551 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:05.800360 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5985f-9d22-40e7-a8a7-1057b6c6e551 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:05.839454 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b611f89-9c39-4e8a-9df5-81f1cf31d0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:05.840075 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b611f89-9c39-4e8a-9df5-81f1cf31d0aa None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:05.840360 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b611f89-9c39-4e8a-9df5-81f1cf31d0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:05.840637 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b611f89-9c39-4e8a-9df5-81f1cf31d0aa None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:05.841334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b611f89-9c39-4e8a-9df5-81f1cf31d0aa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:05.842730 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b611f89-9c39-4e8a-9df5-81f1cf31d0aa None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:05.852468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.sql.core [None req-5b611f89-9c39-4e8a-9df5-81f1cf31d0aa None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 27 04:07:05.852468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 27 04:07:05.852468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [parameters: {'id': 'db4da968c7264c2d830f127543d5285b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 27 04:07:05.852468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81375) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 27 04:07:05.870261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-5b611f89-9c39-4e8a-9df5-81f1cf31d0aa None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 27 04:07:05.870261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:05.870261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 04:07:05.870261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 04:07:05.870261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 04:07:05.870261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 04:07:05.870261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 04:07:05.870261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 04:07:05.870261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 04:07:05.870261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application conn.query(q) Sep 27 04:07:05.870261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 04:07:05.870261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 04:07:05.870261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 04:07:05.870261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result.read() Sep 27 04:07:05.870261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 04:07:05.871221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 04:07:05.871221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 04:07:05.871221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 04:07:05.871221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 04:07:05.871221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 04:07:05.871221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 04:07:05.871221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 04:07:05.871221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 27 04:07:05.871221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:05.871221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 27 04:07:05.871221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:05.871221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:05.871221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 27 04:07:05.871221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 27 04:07:05.871221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 27 04:07:05.871221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return ref.to_dict() Sep 27 04:07:05.871221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 04:07:05.871221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application next(self.gen) Sep 27 04:07:05.872153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 27 04:07:05.872153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application yield resource Sep 27 04:07:05.872153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 04:07:05.872153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application next(self.gen) Sep 27 04:07:05.872153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 27 04:07:05.872153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.session.rollback() Sep 27 04:07:05.872153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 04:07:05.872153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.force_reraise() Sep 27 04:07:05.872153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 04:07:05.872153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise self.value Sep 27 04:07:05.872153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 27 04:07:05.872153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 27 04:07:05.872153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 27 04:07:05.872153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application session.commit() Sep 27 04:07:05.872153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 27 04:07:05.872153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 27 04:07:05.872153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 27 04:07:05.872993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._prepare_impl() Sep 27 04:07:05.872993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 27 04:07:05.872993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.session.flush() Sep 27 04:07:05.872993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 27 04:07:05.872993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._flush(objects) Sep 27 04:07:05.872993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 27 04:07:05.872993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 27 04:07:05.872993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 27 04:07:05.872993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application compat.raise_( Sep 27 04:07:05.872993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 04:07:05.872993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception Sep 27 04:07:05.872993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 27 04:07:05.872993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application flush_context.execute() Sep 27 04:07:05.872993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 27 04:07:05.872993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rec.execute(self) Sep 27 04:07:05.872993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 27 04:07:05.872993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 27 04:07:05.873887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 27 04:07:05.873887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 27 04:07:05.873887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 27 04:07:05.873887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 27 04:07:05.873887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 27 04:07:05.873887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 27 04:07:05.873887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 27 04:07:05.873887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 27 04:07:05.873887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 27 04:07:05.873887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 27 04:07:05.873887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 27 04:07:05.873887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 27 04:07:05.873887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 27 04:07:05.873887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 27 04:07:05.873887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 04:07:05.873887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception Sep 27 04:07:05.874732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 04:07:05.874732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 04:07:05.874732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 04:07:05.874732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 04:07:05.874732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 04:07:05.874732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 04:07:05.874732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 04:07:05.874732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application conn.query(q) Sep 27 04:07:05.874732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 04:07:05.874732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 04:07:05.874732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 04:07:05.874732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result.read() Sep 27 04:07:05.874732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 04:07:05.874732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 04:07:05.874732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 04:07:05.874732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 04:07:05.875595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 04:07:05.875595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 04:07:05.875595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 04:07:05.875595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 04:07:05.875595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 27 04:07:05.875595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 27 04:07:05.875595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [parameters: {'id': 'db4da968c7264c2d830f127543d5285b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 27 04:07:05.875595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 27 04:07:05.875595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:05.875595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:07:05.875595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:05.875595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:05.875595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:05.875595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:05.875595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:05.875595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:05.876377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:05.876377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:05.876377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:05.876377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:05.876377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:05.876377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:05.876377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 27 04:07:05.876377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 27 04:07:05.876377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:05.876377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:05.876377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 27 04:07:05.876377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 27 04:07:05.876377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 27 04:07:05.876377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 27 04:07:05.876377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 27 04:07:05.876377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:05.877204 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 239/478] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Sep 27 04:07:05 2022] POST /identity/v3/roles => generated 144 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:05.885475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3bfa8-bf63-4ba3-a9ea-b4dada5e8a7d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:06.012325 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3bfa8-bf63-4ba3-a9ea-b4dada5e8a7d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:06.054497 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb450e-d357-43fe-810d-f1a9379ce028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:06.055081 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb450e-d357-43fe-810d-f1a9379ce028 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:06.055358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb450e-d357-43fe-810d-f1a9379ce028 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:06.055628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb450e-d357-43fe-810d-f1a9379ce028 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:06.058618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:06.069821 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb450e-d357-43fe-810d-f1a9379ce028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:06.074867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-b7cb450e-d357-43fe-810d-f1a9379ce028 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:07:06.074867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:06.074867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:06.074867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:06.074867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:06.074867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:06.074867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:06.074867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:06.074867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:06.074867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:06.074867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:06.074867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:06.074867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:06.074867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:06.074867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:06.074867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:06.075765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:06.075765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:06.075765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:06.075765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:06.075765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:06.075765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:06.075765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:06.075765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:06.075765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:06.075765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:06.075765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:06.075765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:06.075765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:06.075765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:06.075765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:06.075765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:06.076571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:06.076571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:06.076571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:06.076571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:06.076571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:06.076571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:06.076571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:06.076571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:06.076571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:06.076571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:06.076571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:07:06.076571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:06.079616 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 240/479] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:07:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:06.085949 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b611f89-9c39-4e8a-9df5-81f1cf31d0aa None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:06.180321 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:06.245721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b611f89-9c39-4e8a-9df5-81f1cf31d0aa None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:06.299428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c6ea8-b948-48f9-850d-35013aa66b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:06.300053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c6ea8-b948-48f9-850d-35013aa66b5c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:06.300338 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c6ea8-b948-48f9-850d-35013aa66b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:06.300616 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c6ea8-b948-48f9-850d-35013aa66b5c None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:06.301303 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c6ea8-b948-48f9-850d-35013aa66b5c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:06.301620 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c6ea8-b948-48f9-850d-35013aa66b5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:06.303013 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c6ea8-b948-48f9-850d-35013aa66b5c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:06.315802 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 240/480] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:07.188709 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5118de-f4f2-4b22-8871-21b13ec128b3 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:07.189761 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5118de-f4f2-4b22-8871-21b13ec128b3 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:07.190247 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5118de-f4f2-4b22-8871-21b13ec128b3 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:07.192134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 241/481] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:07.208402 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883ad55-cec8-4ae0-9603-f4a35ae839da None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:07.209973 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883ad55-cec8-4ae0-9603-f4a35ae839da None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:07.210463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883ad55-cec8-4ae0-9603-f4a35ae839da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:07.239971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c883ad55-cec8-4ae0-9603-f4a35ae839da None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:07.241558 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c883ad55-cec8-4ae0-9603-f4a35ae839da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:07.328465 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 241/482] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:07.721360 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61adada-2de8-4c05-84f8-e69d9eef2925 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:07.721760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61adada-2de8-4c05-84f8-e69d9eef2925 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:07.721955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61adada-2de8-4c05-84f8-e69d9eef2925 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:07.724098 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 242/483] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:07.730389 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafaa0e-5b0b-4f9f-9896-83ba7a383248 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:07.730682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafaa0e-5b0b-4f9f-9896-83ba7a383248 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:07.730985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafaa0e-5b0b-4f9f-9896-83ba7a383248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:07.755717 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-6cafaa0e-5b0b-4f9f-9896-83ba7a383248 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:07.756520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61adada-2de8-4c05-84f8-e69d9eef2925 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:07.756996 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6cafaa0e-5b0b-4f9f-9896-83ba7a383248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:07.813238 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:07.853749 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 242/484] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:07.936793 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61adada-2de8-4c05-84f8-e69d9eef2925 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:07.982304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab3717-57b5-474f-96d1-dec27e54a4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:07.982880 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab3717-57b5-474f-96d1-dec27e54a4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:07.983164 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab3717-57b5-474f-96d1-dec27e54a4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:07.983437 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab3717-57b5-474f-96d1-dec27e54a4f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:07.999692 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab3717-57b5-474f-96d1-dec27e54a4f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:08.004651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-3bab3717-57b5-474f-96d1-dec27e54a4f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:08.004651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:08.004651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:08.004651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:08.004651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:08.004651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:08.004651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:08.004651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:08.004651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:08.004651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:08.004651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:08.004651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:08.004651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:08.004651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:08.004651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:08.004651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:08.005527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:08.005527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:08.005527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:08.005527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:08.005527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:08.005527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:08.005527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:08.005527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:08.005527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:08.005527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:08.005527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:08.005527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:08.005527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:08.005527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:08.005527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:08.005527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:08.006415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:08.006415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:08.006415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:08.006415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:08.006415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:08.006415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:08.006415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:08.006415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:08.006415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:08.006415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:08.006415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:08.006415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:08.006415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 243/485] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:08.012350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafaa0e-5b0b-4f9f-9896-83ba7a383248 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:08.148459 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafaa0e-5b0b-4f9f-9896-83ba7a383248 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:08.169072 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3a1d0-fb4c-4fcd-9f5f-c6724613aa01 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:08.169372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3a1d0-fb4c-4fcd-9f5f-c6724613aa01 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:08.169627 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3a1d0-fb4c-4fcd-9f5f-c6724613aa01 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:08.170966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 244/486] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:08.175990 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cf6c5-d7da-4e01-a1a4-9478a3505e74 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:08.176329 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cf6c5-d7da-4e01-a1a4-9478a3505e74 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:08.176616 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cf6c5-d7da-4e01-a1a4-9478a3505e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:08.202555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10faf2-b335-4d7e-a976-676e72e5e4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:08.204280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10faf2-b335-4d7e-a976-676e72e5e4fa None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:08.204982 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10faf2-b335-4d7e-a976-676e72e5e4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:08.205596 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10faf2-b335-4d7e-a976-676e72e5e4fa None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:08.209437 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10faf2-b335-4d7e-a976-676e72e5e4fa None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:08.210323 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10faf2-b335-4d7e-a976-676e72e5e4fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:08.211990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10faf2-b335-4d7e-a976-676e72e5e4fa None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:08.213184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e06cf6c5-d7da-4e01-a1a4-9478a3505e74 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:08.216016 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e06cf6c5-d7da-4e01-a1a4-9478a3505e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:08.226494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 243/487] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:07:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:08.232619 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10faf2-b335-4d7e-a976-676e72e5e4fa None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:08.290169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:08.294833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:08.325632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 245/488] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:08.327221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cf6c5-d7da-4e01-a1a4-9478a3505e74 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:08.416577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10faf2-b335-4d7e-a976-676e72e5e4fa None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:08.454286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b1689-3294-44c5-8f8d-eee78f014f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:08.454935 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b1689-3294-44c5-8f8d-eee78f014f8b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:08.455215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b1689-3294-44c5-8f8d-eee78f014f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:08.455488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b1689-3294-44c5-8f8d-eee78f014f8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:08.467139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b1689-3294-44c5-8f8d-eee78f014f8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:08.468689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b1689-3294-44c5-8f8d-eee78f014f8b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:08.483870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-552b1689-3294-44c5-8f8d-eee78f014f8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:08.483870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:08.483870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:08.483870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:08.483870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:08.483870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:08.483870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:08.483870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:08.483870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:08.483870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:08.483870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:08.483870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:08.483870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:08.483870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:08.483870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:08.483870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:08.484752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:08.484752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:08.484752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:08.484752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:08.484752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:08.484752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:08.484752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:08.484752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:08.484752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:08.484752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:08.484752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:08.484752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:08.484752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:08.484752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:08.484752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:08.484752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:08.484752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:08.485690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:08.485690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:08.485690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:08.485690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 244/489] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:07:08.486370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cf6c5-d7da-4e01-a1a4-9478a3505e74 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:08.486453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349cdd1-a64a-4777-b4a7-d1bab9a4fda8 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:08.489221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349cdd1-a64a-4777-b4a7-d1bab9a4fda8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:08.489221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349cdd1-a64a-4777-b4a7-d1bab9a4fda8 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:08.493027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 245/490] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:08.493813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349cdd1-a64a-4777-b4a7-d1bab9a4fda8 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:08.528491 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f60a86-76a6-4138-9542-df8bd99dc7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:08.529233 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f60a86-76a6-4138-9542-df8bd99dc7df None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:08.529606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f60a86-76a6-4138-9542-df8bd99dc7df None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:08.529891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f60a86-76a6-4138-9542-df8bd99dc7df None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:08.543883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f60a86-76a6-4138-9542-df8bd99dc7df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:08.550249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-43f60a86-76a6-4138-9542-df8bd99dc7df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:08.550249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:08.550249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:08.550249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:08.550249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:08.550249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:08.550249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:08.550249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:08.550249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:08.550249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:08.550249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:08.550249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:08.550249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:08.550249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:08.550249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:08.550249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:08.551191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:08.551191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:08.551191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:08.551191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:08.551191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:08.551191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:08.551191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:08.551191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:08.551191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:08.551191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:08.551191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:08.551191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:08.551191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:08.551191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:08.551191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:08.551191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:08.552005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:08.552005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:08.552005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:08.552005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:08.552005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:08.552005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:08.552005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:08.552005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:08.552005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:08.552005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:08.552005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:08.552005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:08.552005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 246/491] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:08.557318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2cd1f-e8c9-42ab-a43d-28cce49c2284 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:08.557318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2cd1f-e8c9-42ab-a43d-28cce49c2284 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:08.557318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2cd1f-e8c9-42ab-a43d-28cce49c2284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:08.580828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-fea2cd1f-e8c9-42ab-a43d-28cce49c2284 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:08.581998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fea2cd1f-e8c9-42ab-a43d-28cce49c2284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:08.606988 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:08.620748 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349cdd1-a64a-4777-b4a7-d1bab9a4fda8 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:08.629723 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:08.655176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 247/492] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:08.656010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2cd1f-e8c9-42ab-a43d-28cce49c2284 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:08.664906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeba198-9921-4506-a446-63afaebac93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:08.666395 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeba198-9921-4506-a446-63afaebac93a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:08.666965 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeba198-9921-4506-a446-63afaebac93a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:08.667475 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeba198-9921-4506-a446-63afaebac93a None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:08.668757 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeba198-9921-4506-a446-63afaebac93a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:08.669715 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeba198-9921-4506-a446-63afaebac93a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:08.671638 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeba198-9921-4506-a446-63afaebac93a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:08.687141 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 246/493] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:08.688063 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeba198-9921-4506-a446-63afaebac93a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:08.766444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2cd1f-e8c9-42ab-a43d-28cce49c2284 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:08.798743 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeba198-9921-4506-a446-63afaebac93a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:08.809569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea8fce-8603-4243-a423-d1818bccc5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:08.810250 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea8fce-8603-4243-a423-d1818bccc5cb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:08.810532 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea8fce-8603-4243-a423-d1818bccc5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:08.812419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea8fce-8603-4243-a423-d1818bccc5cb None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:08.812419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea8fce-8603-4243-a423-d1818bccc5cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:08.812675 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea8fce-8603-4243-a423-d1818bccc5cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:08.814750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea8fce-8603-4243-a423-d1818bccc5cb None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:08.829230 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 248/494] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:07:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:08.830097 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea8fce-8603-4243-a423-d1818bccc5cb None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:08.840009 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b2e17-d018-49d2-86f5-7552a0fbd579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:08.840907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b2e17-d018-49d2-86f5-7552a0fbd579 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:08.841434 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b2e17-d018-49d2-86f5-7552a0fbd579 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:08.841914 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b2e17-d018-49d2-86f5-7552a0fbd579 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:08.853961 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b2e17-d018-49d2-86f5-7552a0fbd579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:08.859457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-548b2e17-d018-49d2-86f5-7552a0fbd579 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:08.859457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:08.859457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:08.859457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:08.859457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:08.859457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:08.859457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:08.859457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:08.859457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:08.859457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:08.859457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:08.859457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:08.859457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:08.859457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:08.859457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:08.859457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:08.860343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:08.860343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:08.860343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:08.860343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:08.860343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:08.860343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:08.860343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:08.860343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:08.860343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:08.860343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:08.860343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:08.860343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:08.860343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:08.860343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:08.860343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:08.860343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:08.861152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:08.861152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:08.861152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:08.861152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:08.861152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:08.861152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:08.861152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:08.861152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:08.861152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:08.861152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:08.861152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:08.861152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:08.866955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 247/495] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:08.868021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b2e17-d018-49d2-86f5-7552a0fbd579 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:08.885310 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:08.889500 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:08.948034 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea8fce-8603-4243-a423-d1818bccc5cb None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:08.978729 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b2e17-d018-49d2-86f5-7552a0fbd579 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:08.983828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f691dd8-9e39-4d37-89ab-52bb282d1dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:08.984558 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f691dd8-9e39-4d37-89ab-52bb282d1dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:08.984912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f691dd8-9e39-4d37-89ab-52bb282d1dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:08.985256 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f691dd8-9e39-4d37-89ab-52bb282d1dc5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:08.994076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f691dd8-9e39-4d37-89ab-52bb282d1dc5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:08.995560 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f691dd8-9e39-4d37-89ab-52bb282d1dc5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:09.007978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-9f691dd8-9e39-4d37-89ab-52bb282d1dc5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:07:09.007978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:09.007978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:09.007978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:09.007978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:09.007978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:09.007978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:09.007978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:09.007978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:09.007978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:09.007978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:09.007978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:09.007978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:09.007978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:09.007978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:09.007978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:09.008989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:09.008989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:09.008989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:09.008989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:09.008989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:09.008989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:09.008989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:09.008989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:09.008989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:09.008989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:09.008989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:09.008989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:09.008989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:09.008989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:09.008989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:09.008989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:09.008989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:09.008989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:09.011661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:09.011661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:09.011661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:09.011661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:09.011661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:09.011661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:09.011661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:09.011661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:09.011661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:07:09.011661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:09.011661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 249/496] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 27 04:07:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:09.011661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f691dd8-9e39-4d37-89ab-52bb282d1dc5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:09.019196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a064124-91fe-4bb9-a300-b839e32ea5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:09.019827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a064124-91fe-4bb9-a300-b839e32ea5ee None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:09.020110 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a064124-91fe-4bb9-a300-b839e32ea5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:09.020439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a064124-91fe-4bb9-a300-b839e32ea5ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:09.032431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a064124-91fe-4bb9-a300-b839e32ea5ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:09.033928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a064124-91fe-4bb9-a300-b839e32ea5ee None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:09.051137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-9a064124-91fe-4bb9-a300-b839e32ea5ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:09.051137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:09.051137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:09.051137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:09.051137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:09.051137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:09.051137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:09.051137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:09.051137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:09.051137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:09.051137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:09.051137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:09.051137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:09.051137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:09.051137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:09.051137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:09.052223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:09.052223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:09.052223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:09.052223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:09.052223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:09.052223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:09.052223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:09.052223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:09.052223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:09.052223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:09.052223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:09.052223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:09.052223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:09.052223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:09.052223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:09.052223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:09.052223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:09.053306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:09.053306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:09.053306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:09.053306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 248/497] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:09.053306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a064124-91fe-4bb9-a300-b839e32ea5ee None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:09.123240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:09.127296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f691dd8-9e39-4d37-89ab-52bb282d1dc5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:09.129982 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:09.167629 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f40c4-605f-49ad-9800-0204145b6d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:09.168173 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f40c4-605f-49ad-9800-0204145b6d33 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:09.168461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f40c4-605f-49ad-9800-0204145b6d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:09.168745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f40c4-605f-49ad-9800-0204145b6d33 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:09.169412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f40c4-605f-49ad-9800-0204145b6d33 None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:09.169720 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f40c4-605f-49ad-9800-0204145b6d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:09.171146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f40c4-605f-49ad-9800-0204145b6d33 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:09.171249 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a064124-91fe-4bb9-a300-b839e32ea5ee None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:09.185008 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 250/498] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:07:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:09.185008 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f40c4-605f-49ad-9800-0204145b6d33 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:09.208219 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d05e17-7bb3-461d-aee2-a6b21bd82abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:09.208863 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d05e17-7bb3-461d-aee2-a6b21bd82abf None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:09.209146 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d05e17-7bb3-461d-aee2-a6b21bd82abf None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:09.209942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d05e17-7bb3-461d-aee2-a6b21bd82abf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:09.219607 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d05e17-7bb3-461d-aee2-a6b21bd82abf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:09.224766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-49d05e17-7bb3-461d-aee2-a6b21bd82abf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:09.224766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:09.224766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:09.224766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:09.224766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:09.224766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:09.224766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:09.224766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:09.224766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:09.224766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:09.224766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:09.224766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:09.224766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:09.224766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:09.224766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:09.224766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:09.226286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:09.226286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:09.226286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:09.226286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:09.226286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:09.226286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:09.226286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:09.226286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:09.226286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:09.226286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:09.226286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:09.226286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:09.226286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:09.226286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:09.226286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:09.226286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:09.227108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:09.227108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:09.227108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:09.227108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:09.227108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:09.227108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:09.227108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:09.227108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:09.227108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:09.227108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:09.227108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:09.227108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:09.227108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 249/499] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:09.227755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d05e17-7bb3-461d-aee2-a6b21bd82abf None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:09.284549 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f40c4-605f-49ad-9800-0204145b6d33 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:09.318064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ec201-dada-4f73-b575-2814562da41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:09.318665 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ec201-dada-4f73-b575-2814562da41b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:09.319001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ec201-dada-4f73-b575-2814562da41b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:09.319276 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ec201-dada-4f73-b575-2814562da41b None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:09.320006 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ec201-dada-4f73-b575-2814562da41b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:09.320324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ec201-dada-4f73-b575-2814562da41b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:09.321750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ec201-dada-4f73-b575-2814562da41b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:09.329327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d05e17-7bb3-461d-aee2-a6b21bd82abf None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:09.352334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:09.358061 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 251/500] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 27 04:07:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:09.359307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509ef87-d1e4-4adf-b6e4-6a956e803dcd None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:09.359597 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509ef87-d1e4-4adf-b6e4-6a956e803dcd None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:09.359872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509ef87-d1e4-4adf-b6e4-6a956e803dcd None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:09.362879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 252/501] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:09.362879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509ef87-d1e4-4adf-b6e4-6a956e803dcd None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:09.365519 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565d007-6a9c-43e7-94f9-1e0b096e0edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:09.366169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565d007-6a9c-43e7-94f9-1e0b096e0edc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:09.366453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565d007-6a9c-43e7-94f9-1e0b096e0edc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:09.366755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565d007-6a9c-43e7-94f9-1e0b096e0edc None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:09.367416 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565d007-6a9c-43e7-94f9-1e0b096e0edc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:09.367725 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565d007-6a9c-43e7-94f9-1e0b096e0edc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:09.369109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565d007-6a9c-43e7-94f9-1e0b096e0edc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:09.380246 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:09.380982 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 250/502] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:09.381703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565d007-6a9c-43e7-94f9-1e0b096e0edc None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:09.467118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509ef87-d1e4-4adf-b6e4-6a956e803dcd None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:09.482774 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565d007-6a9c-43e7-94f9-1e0b096e0edc None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:09.500341 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c483dc-25c0-4efd-9613-a133f26bb153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:09.500955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c483dc-25c0-4efd-9613-a133f26bb153 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:09.501236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c483dc-25c0-4efd-9613-a133f26bb153 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:09.501508 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c483dc-25c0-4efd-9613-a133f26bb153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:09.511024 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c483dc-25c0-4efd-9613-a133f26bb153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:09.512456 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c483dc-25c0-4efd-9613-a133f26bb153 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:09.515239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520da9a6-9760-41b1-9bc8-ea85cd4def92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:09.515833 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520da9a6-9760-41b1-9bc8-ea85cd4def92 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:09.516172 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520da9a6-9760-41b1-9bc8-ea85cd4def92 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:09.516453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520da9a6-9760-41b1-9bc8-ea85cd4def92 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:09.517122 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520da9a6-9760-41b1-9bc8-ea85cd4def92 None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:09.517430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520da9a6-9760-41b1-9bc8-ea85cd4def92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:09.518827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520da9a6-9760-41b1-9bc8-ea85cd4def92 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:09.526910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-70c483dc-25c0-4efd-9613-a133f26bb153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:09.526910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:09.526910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:09.526910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:09.526910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:09.526910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:09.526910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:09.526910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:09.526910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:09.526910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:09.526910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:09.526910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:09.526910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:09.526910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:09.526910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:09.526910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:09.527803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:09.527803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:09.527803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:09.527803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:09.527803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:09.527803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:09.527803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:09.527803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:09.527803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:09.527803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:09.527803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:09.527803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:09.527803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:09.527803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:09.527803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:09.527803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:09.527803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:09.529261 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:09.529261 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:09.529261 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:09.529421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 251/503] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:07:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:09.529421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520da9a6-9760-41b1-9bc8-ea85cd4def92 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:09.529549 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 253/504] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:09.529549 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d5307-616f-46e1-b2d0-72aa40a78497 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:09.529663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d5307-616f-46e1-b2d0-72aa40a78497 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:09.529881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d5307-616f-46e1-b2d0-72aa40a78497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:09.548383 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-542d5307-616f-46e1-b2d0-72aa40a78497 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:09.549463 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-542d5307-616f-46e1-b2d0-72aa40a78497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:09.577293 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:09.611596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:09.617677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 254/505] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:09.618547 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d5307-616f-46e1-b2d0-72aa40a78497 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:09.630337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520da9a6-9760-41b1-9bc8-ea85cd4def92 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:09.667782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcebbe5-28b2-4f5b-a9c6-c0346e1141d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:09.668379 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcebbe5-28b2-4f5b-a9c6-c0346e1141d8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:09.668659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcebbe5-28b2-4f5b-a9c6-c0346e1141d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:09.668931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcebbe5-28b2-4f5b-a9c6-c0346e1141d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:09.733000 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d5307-616f-46e1-b2d0-72aa40a78497 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:09.742023 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcebbe5-28b2-4f5b-a9c6-c0346e1141d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:09.743925 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcebbe5-28b2-4f5b-a9c6-c0346e1141d8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:09.768602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a857f73-c15a-4aed-86e5-dcf3df9fb401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:09.769463 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a857f73-c15a-4aed-86e5-dcf3df9fb401 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:09.769890 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a857f73-c15a-4aed-86e5-dcf3df9fb401 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:09.770315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a857f73-c15a-4aed-86e5-dcf3df9fb401 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:09.778164 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a857f73-c15a-4aed-86e5-dcf3df9fb401 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:09.779657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a857f73-c15a-4aed-86e5-dcf3df9fb401 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:09.788932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:09.791373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-5a857f73-c15a-4aed-86e5-dcf3df9fb401 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 27 04:07:09.791373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:09.791373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:09.791373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:09.791373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:09.791373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:09.791373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:09.791373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:09.791373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:09.791373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:09.791373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:09.791373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:09.791373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:09.791373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:09.791373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:09.791373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:09.792240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:09.792240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:09.792240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:09.792240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:09.792240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:09.792240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:09.792240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:09.792240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:09.792240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:09.792240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:09.792240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:09.792240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:09.792240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:09.792240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:09.792240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:09.792240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:09.792240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:09.792240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:09.793574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:09.793574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:09.793574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:09.793574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:09.793574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:09.793574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:09.793574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:09.793574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:09.793574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 27 04:07:09.793574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:09.793574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 255/506] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:07:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:09.793574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a857f73-c15a-4aed-86e5-dcf3df9fb401 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:09.854530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 252/507] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:07:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:07:09.854530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcebbe5-28b2-4f5b-a9c6-c0346e1141d8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:09.861359 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:09.907096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a857f73-c15a-4aed-86e5-dcf3df9fb401 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:09.938905 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256b84c-b8cc-481b-8ca8-f5f8242d00b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:09.939504 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256b84c-b8cc-481b-8ca8-f5f8242d00b9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:09.939783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256b84c-b8cc-481b-8ca8-f5f8242d00b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:09.940050 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256b84c-b8cc-481b-8ca8-f5f8242d00b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:09.940685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256b84c-b8cc-481b-8ca8-f5f8242d00b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:09.940985 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256b84c-b8cc-481b-8ca8-f5f8242d00b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:09.942356 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256b84c-b8cc-481b-8ca8-f5f8242d00b9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:09.954432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 256/508] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:09.955241 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256b84c-b8cc-481b-8ca8-f5f8242d00b9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:09.955808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcebbe5-28b2-4f5b-a9c6-c0346e1141d8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:09.992645 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f43a2-3cad-4796-878f-64ee6ec3d6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:09.993265 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f43a2-3cad-4796-878f-64ee6ec3d6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:09.993546 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f43a2-3cad-4796-878f-64ee6ec3d6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:09.993820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f43a2-3cad-4796-878f-64ee6ec3d6e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:10.003452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f43a2-3cad-4796-878f-64ee6ec3d6e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:10.004892 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f43a2-3cad-4796-878f-64ee6ec3d6e2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:10.012376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:10.020930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-497f43a2-3cad-4796-878f-64ee6ec3d6e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:10.020930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:10.020930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:10.020930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:10.020930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:10.020930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:10.020930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:10.020930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:10.020930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:10.020930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:10.020930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:10.020930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:10.020930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:10.020930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:10.020930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:10.020930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:10.022012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:10.022012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:10.022012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:10.022012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:10.022012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:10.022012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:10.022012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:10.022012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:10.022012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:10.022012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:10.022012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:10.022012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:10.022012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:10.022012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:10.022012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:10.022012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:10.022012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:10.023150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:10.023150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:10.023150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:10.023150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 253/509] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:10.023530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f43a2-3cad-4796-878f-64ee6ec3d6e2 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:10.056217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256b84c-b8cc-481b-8ca8-f5f8242d00b9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:10.075409 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:10.089713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cb99a-96e2-49c3-b04d-b749eceffb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:10.090315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cb99a-96e2-49c3-b04d-b749eceffb05 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:10.090599 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cb99a-96e2-49c3-b04d-b749eceffb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:10.090918 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cb99a-96e2-49c3-b04d-b749eceffb05 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:10.091651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9cb99a-96e2-49c3-b04d-b749eceffb05 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:10.091962 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9cb99a-96e2-49c3-b04d-b749eceffb05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:10.093418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9cb99a-96e2-49c3-b04d-b749eceffb05 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:10.110243 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 257/510] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Sep 27 04:07:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:10.111013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cb99a-96e2-49c3-b04d-b749eceffb05 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:10.122411 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f43a2-3cad-4796-878f-64ee6ec3d6e2 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:10.156251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100b0f0-4614-4861-9c57-72c1ab865f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:10.156873 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100b0f0-4614-4861-9c57-72c1ab865f57 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:10.157154 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100b0f0-4614-4861-9c57-72c1ab865f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:10.157434 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100b0f0-4614-4861-9c57-72c1ab865f57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:10.168325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100b0f0-4614-4861-9c57-72c1ab865f57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:10.169786 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100b0f0-4614-4861-9c57-72c1ab865f57 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:10.184068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-a100b0f0-4614-4861-9c57-72c1ab865f57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:10.184068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:10.184068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:10.184068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:10.184068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:10.184068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:10.184068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:10.184068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:10.184068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:10.184068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:10.184068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:10.184068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:10.184068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:10.184068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:10.184068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:10.184068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:10.185116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:10.185116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:10.185116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:10.185116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:10.185116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:10.185116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:10.185116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:10.185116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:10.185116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:10.185116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:10.185116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:10.185116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:10.185116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:10.185116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:10.185116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:10.185116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:10.185116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:10.186163 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:10.186163 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:10.186163 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:10.186547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 254/511] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:10.187569 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100b0f0-4614-4861-9c57-72c1ab865f57 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:10.211095 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cb99a-96e2-49c3-b04d-b749eceffb05 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:10.238102 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:10.245076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820f6bc-4a9c-434f-99d6-1d9d3aa08542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:10.245704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820f6bc-4a9c-434f-99d6-1d9d3aa08542 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:10.245985 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820f6bc-4a9c-434f-99d6-1d9d3aa08542 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:10.246260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820f6bc-4a9c-434f-99d6-1d9d3aa08542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:10.255958 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820f6bc-4a9c-434f-99d6-1d9d3aa08542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:10.257987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820f6bc-4a9c-434f-99d6-1d9d3aa08542 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:10.273859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-a820f6bc-4a9c-434f-99d6-1d9d3aa08542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:10.273859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:10.273859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:10.273859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:10.273859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:10.273859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:10.273859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:10.273859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:10.273859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:10.273859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:10.273859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:10.273859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:10.273859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:10.273859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:10.273859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:10.273859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:10.274806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:10.274806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:10.274806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:10.274806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:10.274806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:10.274806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:10.274806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:10.274806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:10.274806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:10.274806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:10.274806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:10.274806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:10.274806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:10.274806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:10.274806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:10.274806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:10.274806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:10.275664 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:10.275664 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:10.275664 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:10.275664 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 258/512] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:10.275876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820f6bc-4a9c-434f-99d6-1d9d3aa08542 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:10.289069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100b0f0-4614-4861-9c57-72c1ab865f57 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:10.305883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:10.323638 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbea201-98e6-4881-9bfa-8732bbd66c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:10.324288 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbea201-98e6-4881-9bfa-8732bbd66c12 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:10.324582 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbea201-98e6-4881-9bfa-8732bbd66c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:10.324855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbea201-98e6-4881-9bfa-8732bbd66c12 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:10.332365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbea201-98e6-4881-9bfa-8732bbd66c12 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:10.333806 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbea201-98e6-4881-9bfa-8732bbd66c12 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:10.346213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-0dbea201-98e6-4881-9bfa-8732bbd66c12 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 04:07:10.346213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:10.346213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:10.346213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:10.346213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:10.346213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:10.346213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:10.346213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:10.346213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:10.346213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:10.346213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:10.346213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:10.346213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:10.346213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:10.346213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:10.346213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:10.347429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:10.347429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:10.347429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:10.347429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:10.347429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:10.347429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:10.347429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:10.347429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:10.347429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:10.347429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:10.347429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:10.347429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:10.347429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:10.347429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:10.347429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:10.347429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:10.347429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:10.347429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:10.349143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:10.349143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:10.349143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:10.349143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:10.349143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:10.349143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:10.349143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:10.349143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:10.349143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 04:07:10.349143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:10.349143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 255/513] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:10.349143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbea201-98e6-4881-9bfa-8732bbd66c12 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:10.384377 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820f6bc-4a9c-434f-99d6-1d9d3aa08542 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:10.420330 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fc325-b908-4509-a55e-5393fbfde32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:10.420932 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fc325-b908-4509-a55e-5393fbfde32c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:10.421215 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fc325-b908-4509-a55e-5393fbfde32c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:10.421486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fc325-b908-4509-a55e-5393fbfde32c None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:10.422124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fc325-b908-4509-a55e-5393fbfde32c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:10.422431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fc325-b908-4509-a55e-5393fbfde32c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:10.423825 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fc325-b908-4509-a55e-5393fbfde32c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:10.435581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 259/514] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:10.436360 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fc325-b908-4509-a55e-5393fbfde32c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:10.456274 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbea201-98e6-4881-9bfa-8732bbd66c12 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:10.466596 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:10.490186 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5156b61-f529-4527-9c2b-8a9fba74431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:10.491406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5156b61-f529-4527-9c2b-8a9fba74431a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:10.491687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5156b61-f529-4527-9c2b-8a9fba74431a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:10.491959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5156b61-f529-4527-9c2b-8a9fba74431a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:10.524052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:10.533929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fc325-b908-4509-a55e-5393fbfde32c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:10.557141 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5156b61-f529-4527-9c2b-8a9fba74431a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:10.558608 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5156b61-f529-4527-9c2b-8a9fba74431a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:10.568144 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae579ad9-ccb2-4f83-9b85-be78b09c8230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:10.568772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae579ad9-ccb2-4f83-9b85-be78b09c8230 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:10.569062 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae579ad9-ccb2-4f83-9b85-be78b09c8230 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:10.569339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae579ad9-ccb2-4f83-9b85-be78b09c8230 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:10.569986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae579ad9-ccb2-4f83-9b85-be78b09c8230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:10.570295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae579ad9-ccb2-4f83-9b85-be78b09c8230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:10.571684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae579ad9-ccb2-4f83-9b85-be78b09c8230 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:10.582458 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 260/515] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:10.583276 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae579ad9-ccb2-4f83-9b85-be78b09c8230 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:10.658852 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 256/516] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:07:10.659628 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5156b61-f529-4527-9c2b-8a9fba74431a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:10.671222 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:10.685299 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae579ad9-ccb2-4f83-9b85-be78b09c8230 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:10.717323 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b733-eda0-48b9-a344-8309a7c0df50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:10.717923 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b733-eda0-48b9-a344-8309a7c0df50 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:10.718200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b733-eda0-48b9-a344-8309a7c0df50 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:10.718470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b733-eda0-48b9-a344-8309a7c0df50 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:10.719142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49b733-eda0-48b9-a344-8309a7c0df50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:10.719444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49b733-eda0-48b9-a344-8309a7c0df50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:10.720799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49b733-eda0-48b9-a344-8309a7c0df50 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:10.733529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 261/517] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:10.734558 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b733-eda0-48b9-a344-8309a7c0df50 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:10.748571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:10.758571 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5156b61-f529-4527-9c2b-8a9fba74431a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:10.791641 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c59de6-bdec-4a2f-acce-5c6c09702667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:10.792235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c59de6-bdec-4a2f-acce-5c6c09702667 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:10.792513 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c59de6-bdec-4a2f-acce-5c6c09702667 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:10.792784 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c59de6-bdec-4a2f-acce-5c6c09702667 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:10.793509 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c59de6-bdec-4a2f-acce-5c6c09702667 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:10.793813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c59de6-bdec-4a2f-acce-5c6c09702667 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:10.795260 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c59de6-bdec-4a2f-acce-5c6c09702667 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:10.830480 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 257/518] 10.222.0.48 () {56 vars in 1139 bytes} [Tue Sep 27 04:07:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:10.831441 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c59de6-bdec-4a2f-acce-5c6c09702667 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:10.839301 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b733-eda0-48b9-a344-8309a7c0df50 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:10.872753 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcc705-dad3-4e98-9625-d7eacb962fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:10.873366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcc705-dad3-4e98-9625-d7eacb962fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:10.873652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcc705-dad3-4e98-9625-d7eacb962fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:10.873919 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcc705-dad3-4e98-9625-d7eacb962fb5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:10.880607 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcc705-dad3-4e98-9625-d7eacb962fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:10.882064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcc705-dad3-4e98-9625-d7eacb962fb5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:10.893799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-5fdcc705-dad3-4e98-9625-d7eacb962fb5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 04:07:10.893799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:10.893799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:10.893799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:10.893799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:10.893799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:10.893799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:10.893799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:10.893799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:10.893799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:10.893799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:10.893799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:10.893799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:10.893799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:10.893799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:10.893799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:10.894868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:10.894868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:10.894868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:10.894868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:10.894868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:10.894868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:10.894868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:10.894868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:10.894868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:10.894868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:10.894868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:10.894868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:10.894868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:10.894868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:10.894868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:10.894868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:10.894868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:10.894868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:10.895960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:10.895960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:10.895960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:10.895960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:10.895960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:10.895960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:10.895960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:10.895960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:10.895960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 04:07:10.895960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:10.895960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 262/519] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:07:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:10.895960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcc705-dad3-4e98-9625-d7eacb962fb5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:10.897417 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:10.933009 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c59de6-bdec-4a2f-acce-5c6c09702667 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:10.965565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb39294-ecf1-431e-ba1e-0f098e48ac3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:10.966178 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb39294-ecf1-431e-ba1e-0f098e48ac3a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:10.966460 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb39294-ecf1-431e-ba1e-0f098e48ac3a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:10.966581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:10.966761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb39294-ecf1-431e-ba1e-0f098e48ac3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:10.973482 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb39294-ecf1-431e-ba1e-0f098e48ac3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:10.974973 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb39294-ecf1-431e-ba1e-0f098e48ac3a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:10.987644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-8bb39294-ecf1-431e-ba1e-0f098e48ac3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:10.987644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:10.987644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:10.987644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:10.987644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:10.987644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:10.987644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:10.987644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:10.987644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:10.987644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:10.987644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:10.987644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:10.987644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:10.987644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:10.987644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:10.988661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:10.988661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:10.988661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:10.988661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:10.988661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:10.988661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:10.988661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:10.988661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:10.988661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:10.988661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:10.988661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:10.988661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:10.988661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:10.988661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:10.988661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:10.988661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:10.988661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:10.989700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:10.989700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:10.989700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:10.989700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:10.989700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:10.989700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:10.989700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:10.989700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:10.990853 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 258/520] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:10.991798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb39294-ecf1-431e-ba1e-0f098e48ac3a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:10.998860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcc705-dad3-4e98-9625-d7eacb962fb5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:11.032401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7099a-101d-404d-b3b9-330889dab08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:11.033022 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7099a-101d-404d-b3b9-330889dab08a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:11.033300 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7099a-101d-404d-b3b9-330889dab08a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:11.033578 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7099a-101d-404d-b3b9-330889dab08a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:11.044206 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7099a-101d-404d-b3b9-330889dab08a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:11.045646 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7099a-101d-404d-b3b9-330889dab08a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:11.059181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-84e7099a-101d-404d-b3b9-330889dab08a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:11.059181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:11.059181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:11.059181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:11.059181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:11.059181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:11.059181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:11.059181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:11.059181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:11.059181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:11.059181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:11.059181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:11.059181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:11.059181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:11.059181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:11.059181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:11.060096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:11.060096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:11.060096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:11.060096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:11.060096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:11.060096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:11.060096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:11.060096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:11.060096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:11.060096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:11.060096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:11.060096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:11.060096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:11.060096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:11.060096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:11.060096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:11.060096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:11.060929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:11.060929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:11.060929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:11.060929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 263/521] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:11.061395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7099a-101d-404d-b3b9-330889dab08a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:11.089452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb39294-ecf1-431e-ba1e-0f098e48ac3a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:11.117083 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:11.125241 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8a0a6-cb68-41a9-841a-2b62195c625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:11.125839 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8a0a6-cb68-41a9-841a-2b62195c625a None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:11.126116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8a0a6-cb68-41a9-841a-2b62195c625a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:11.126388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8a0a6-cb68-41a9-841a-2b62195c625a None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:11.127062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8a0a6-cb68-41a9-841a-2b62195c625a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:11.128530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8a0a6-cb68-41a9-841a-2b62195c625a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:11.149359 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 259/522] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 27 04:07:10 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:07:11.150373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8a0a6-cb68-41a9-841a-2b62195c625a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:11.173428 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7099a-101d-404d-b3b9-330889dab08a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:11.202757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:11.219013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c357c-9a47-45ea-9dfc-fa94a3a6562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:11.219709 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c357c-9a47-45ea-9dfc-fa94a3a6562c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:11.219990 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c357c-9a47-45ea-9dfc-fa94a3a6562c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:11.220268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c357c-9a47-45ea-9dfc-fa94a3a6562c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:11.272532 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8a0a6-cb68-41a9-841a-2b62195c625a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:11.297261 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c357c-9a47-45ea-9dfc-fa94a3a6562c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:11.298794 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c357c-9a47-45ea-9dfc-fa94a3a6562c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:11.308635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f52636-d644-42c1-ae97-59d7fb419627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:11.309258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f52636-d644-42c1-ae97-59d7fb419627 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:11.309537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f52636-d644-42c1-ae97-59d7fb419627 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:11.309813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f52636-d644-42c1-ae97-59d7fb419627 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:11.310560 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f52636-d644-42c1-ae97-59d7fb419627 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:11.310899 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f52636-d644-42c1-ae97-59d7fb419627 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:11.312363 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f52636-d644-42c1-ae97-59d7fb419627 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:11.334181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 260/523] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Sep 27 04:07:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:11.335645 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f52636-d644-42c1-ae97-59d7fb419627 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:11.383417 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:11.420196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 264/524] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:07:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:07:11.420196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c357c-9a47-45ea-9dfc-fa94a3a6562c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:11.445788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:11.453491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f52636-d644-42c1-ae97-59d7fb419627 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:11.490327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97808406-fd5b-49bf-9154-7dd34e842664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:11.491523 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97808406-fd5b-49bf-9154-7dd34e842664 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:11.491815 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97808406-fd5b-49bf-9154-7dd34e842664 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:11.492070 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97808406-fd5b-49bf-9154-7dd34e842664 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:11.492760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97808406-fd5b-49bf-9154-7dd34e842664 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:11.493073 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97808406-fd5b-49bf-9154-7dd34e842664 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:11.494509 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97808406-fd5b-49bf-9154-7dd34e842664 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:11.513169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 261/525] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:11.514003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97808406-fd5b-49bf-9154-7dd34e842664 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:11.530566 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c357c-9a47-45ea-9dfc-fa94a3a6562c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:11.565985 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be172b-4fc7-44d1-ab5c-91b6177debf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:11.566588 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be172b-4fc7-44d1-ab5c-91b6177debf5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:11.566898 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be172b-4fc7-44d1-ab5c-91b6177debf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:11.567173 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be172b-4fc7-44d1-ab5c-91b6177debf5 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:11.567806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be172b-4fc7-44d1-ab5c-91b6177debf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:11.568115 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be172b-4fc7-44d1-ab5c-91b6177debf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:11.570067 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be172b-4fc7-44d1-ab5c-91b6177debf5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:11.586745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 265/526] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:11.586745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be172b-4fc7-44d1-ab5c-91b6177debf5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:11.622928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97808406-fd5b-49bf-9154-7dd34e842664 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:11.624584 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:11.660319 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc218b4-fb7a-44f2-9768-453aadaf9390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:11.661258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc218b4-fb7a-44f2-9768-453aadaf9390 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:11.661453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc218b4-fb7a-44f2-9768-453aadaf9390 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:11.661846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc218b4-fb7a-44f2-9768-453aadaf9390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:11.676342 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:11.699780 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be172b-4fc7-44d1-ab5c-91b6177debf5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:11.731863 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc218b4-fb7a-44f2-9768-453aadaf9390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:11.733225 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc218b4-fb7a-44f2-9768-453aadaf9390 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:11.742126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5b574-364a-4eae-9653-b9056103fbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:11.742903 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5b574-364a-4eae-9653-b9056103fbf7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:11.743190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5b574-364a-4eae-9653-b9056103fbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:11.743465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5b574-364a-4eae-9653-b9056103fbf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:11.753966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5b574-364a-4eae-9653-b9056103fbf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:11.755694 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5b574-364a-4eae-9653-b9056103fbf7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:11.770136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-8fe5b574-364a-4eae-9653-b9056103fbf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:11.770136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:11.770136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:11.770136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:11.770136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:11.770136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:11.770136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:11.770136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:11.770136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:11.770136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:11.770136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:11.770136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:11.770136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:11.770136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:11.770136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:11.770136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:11.771304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:11.771304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:11.771304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:11.771304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:11.771304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:11.771304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:11.771304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:11.771304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:11.771304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:11.771304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:11.771304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:11.771304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:11.771304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:11.771304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:11.771304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:11.771304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:11.771304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:11.772712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:11.772712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:11.772712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:11.772712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 266/527] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:11.772712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5b574-364a-4eae-9653-b9056103fbf7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:11.846797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 262/528] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:07:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:07:11.846797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc218b4-fb7a-44f2-9768-453aadaf9390 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:11.848994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:11.883993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5b574-364a-4eae-9653-b9056103fbf7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:11.921360 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56af90c-a242-43fa-a532-61f07e15fab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:11.922405 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56af90c-a242-43fa-a532-61f07e15fab1 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:11.922693 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56af90c-a242-43fa-a532-61f07e15fab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:11.923000 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56af90c-a242-43fa-a532-61f07e15fab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:11.923739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56af90c-a242-43fa-a532-61f07e15fab1 None admin] RBAC: Adding query filter params (role.id=e62613bfe0e143abbc25d60ea42a4416, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=3960d52dee8443cf9ec8930a389a7b60) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:11.924054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56af90c-a242-43fa-a532-61f07e15fab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:11.925493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56af90c-a242-43fa-a532-61f07e15fab1 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:11.927454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:11.932690 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 267/529] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:07:11 2022] GET /identity/v3/role_assignments?user.id=3960d52dee8443cf9ec8930a389a7b60&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=e62613bfe0e143abbc25d60ea42a4416 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:11.933508 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56af90c-a242-43fa-a532-61f07e15fab1 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:11.973946 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc218b4-fb7a-44f2-9768-453aadaf9390 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:12.023891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f71571-dee4-4142-aa8c-102fa5118123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:12.024894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f71571-dee4-4142-aa8c-102fa5118123 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:12.025396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f71571-dee4-4142-aa8c-102fa5118123 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:12.025863 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f71571-dee4-4142-aa8c-102fa5118123 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:12.036657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f71571-dee4-4142-aa8c-102fa5118123 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:12.038898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f71571-dee4-4142-aa8c-102fa5118123 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:12.054406 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56af90c-a242-43fa-a532-61f07e15fab1 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:12.055307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-f0f71571-dee4-4142-aa8c-102fa5118123 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:12.055307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:12.055307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:12.055307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:12.055307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:12.055307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:12.055307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:12.055307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:12.055307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:12.055307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:12.055307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:12.055307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:12.055307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:12.055307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:12.055307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:12.056129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:12.056129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:12.056129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:12.056129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:12.056129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:12.056129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:12.056129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:12.056129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:12.056129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:12.056129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:12.056129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:12.056129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:12.056129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:12.056129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:12.056129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:12.056129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:12.056129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:12.057030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:12.057030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:12.057030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:12.057030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:12.057030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:12.057030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:12.057030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:12.057030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:12.060628 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 263/530] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:12.061907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f71571-dee4-4142-aa8c-102fa5118123 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:12.105373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72802e7-99b1-4f8e-a578-ff9f06067b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:12.106373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72802e7-99b1-4f8e-a578-ff9f06067b8f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:12.106823 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72802e7-99b1-4f8e-a578-ff9f06067b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:12.107239 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72802e7-99b1-4f8e-a578-ff9f06067b8f None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:12.108059 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72802e7-99b1-4f8e-a578-ff9f06067b8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:12.108519 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72802e7-99b1-4f8e-a578-ff9f06067b8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:12.111225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72802e7-99b1-4f8e-a578-ff9f06067b8f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:12.129969 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 268/531] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:12.129969 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72802e7-99b1-4f8e-a578-ff9f06067b8f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:12.144851 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:12.193473 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f71571-dee4-4142-aa8c-102fa5118123 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:12.227142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:12.230213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144131bf-e6dd-49fa-ae82-315dc5628faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:12.231011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144131bf-e6dd-49fa-ae82-315dc5628faf None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:12.231404 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144131bf-e6dd-49fa-ae82-315dc5628faf None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:12.231779 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144131bf-e6dd-49fa-ae82-315dc5628faf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:12.243063 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144131bf-e6dd-49fa-ae82-315dc5628faf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:12.244666 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144131bf-e6dd-49fa-ae82-315dc5628faf None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:12.248895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72802e7-99b1-4f8e-a578-ff9f06067b8f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:12.260906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-144131bf-e6dd-49fa-ae82-315dc5628faf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:12.260906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:12.260906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:12.260906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:12.260906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:12.260906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:12.260906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:12.260906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:12.260906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:12.260906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:12.260906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:12.260906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:12.260906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:12.260906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:12.260906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:12.260906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:12.261837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:12.261837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:12.261837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:12.261837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:12.261837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:12.261837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:12.261837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:12.261837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:12.261837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:12.261837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:12.261837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:12.261837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:12.261837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:12.261837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:12.261837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:12.261837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:12.261837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:12.262674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:12.262674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:12.262674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:12.266811 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 264/532] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:12.267874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144131bf-e6dd-49fa-ae82-315dc5628faf None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:12.292972 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47303d78-5254-4196-babc-d0c251ffd9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:12.294760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47303d78-5254-4196-babc-d0c251ffd9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:12.295062 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47303d78-5254-4196-babc-d0c251ffd9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:12.295346 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47303d78-5254-4196-babc-d0c251ffd9d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:12.296104 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47303d78-5254-4196-babc-d0c251ffd9d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:12.296423 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47303d78-5254-4196-babc-d0c251ffd9d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:12.301309 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47303d78-5254-4196-babc-d0c251ffd9d6 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:12.327906 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 269/533] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:12.329042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47303d78-5254-4196-babc-d0c251ffd9d6 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:12.425886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144131bf-e6dd-49fa-ae82-315dc5628faf None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:12.441599 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:12.466127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf1aaa-276b-4fc4-b859-b748a9c53fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:12.466793 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf1aaa-276b-4fc4-b859-b748a9c53fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:12.467077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf1aaa-276b-4fc4-b859-b748a9c53fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:12.467348 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf1aaa-276b-4fc4-b859-b748a9c53fc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:12.470424 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47303d78-5254-4196-babc-d0c251ffd9d6 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:12.474753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf1aaa-276b-4fc4-b859-b748a9c53fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:12.476816 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf1aaa-276b-4fc4-b859-b748a9c53fc7 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:12.489118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-08bf1aaa-276b-4fc4-b859-b748a9c53fc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:12.489118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:12.489118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:12.489118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:12.489118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:12.489118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:12.489118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:12.489118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:12.489118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:12.489118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:12.489118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:12.489118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:12.489118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:12.489118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:12.489118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:12.490030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:12.490030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:12.490030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:12.490030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:12.490030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:12.490030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:12.490030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:12.490030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:12.490030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:12.490030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:12.490030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:12.490030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:12.490030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:12.490030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:12.490030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:12.490030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:12.490030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:12.490947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:12.490947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:12.490947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:12.490947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:12.490947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:12.490947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:12.490947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:12.490947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:12.490947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 265/534] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:12.491418 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf1aaa-276b-4fc4-b859-b748a9c53fc7 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:12.500149 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:12.523272 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59fc63-fd8e-4249-91e4-dcd65c4e8b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:12.524377 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59fc63-fd8e-4249-91e4-dcd65c4e8b2e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:12.524881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59fc63-fd8e-4249-91e4-dcd65c4e8b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:12.525642 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59fc63-fd8e-4249-91e4-dcd65c4e8b2e None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:12.526779 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59fc63-fd8e-4249-91e4-dcd65c4e8b2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:12.527440 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59fc63-fd8e-4249-91e4-dcd65c4e8b2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:12.529612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59fc63-fd8e-4249-91e4-dcd65c4e8b2e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:12.544971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 270/535] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:12.546332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59fc63-fd8e-4249-91e4-dcd65c4e8b2e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:12.601620 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf1aaa-276b-4fc4-b859-b748a9c53fc7 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:12.638289 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7591c9-2a76-4984-9ab3-e9a2fe7fc066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:12.638799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7591c9-2a76-4984-9ab3-e9a2fe7fc066 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:12.639083 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7591c9-2a76-4984-9ab3-e9a2fe7fc066 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:12.639406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7591c9-2a76-4984-9ab3-e9a2fe7fc066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:12.640138 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7591c9-2a76-4984-9ab3-e9a2fe7fc066 None admin] RBAC: Adding query filter params (role.id=e62613bfe0e143abbc25d60ea42a4416, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=405499a1b5dc4fb6ac7af73910c3d992) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:12.640446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7591c9-2a76-4984-9ab3-e9a2fe7fc066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:12.641867 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7591c9-2a76-4984-9ab3-e9a2fe7fc066 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:12.648398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 266/536] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:07:12 2022] GET /identity/v3/role_assignments?user.id=405499a1b5dc4fb6ac7af73910c3d992&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=e62613bfe0e143abbc25d60ea42a4416 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:12.649202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7591c9-2a76-4984-9ab3-e9a2fe7fc066 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:12.680594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59fc63-fd8e-4249-91e4-dcd65c4e8b2e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:12.695829 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:12.735719 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb80619-0803-41ba-8552-f410a2eabe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:12.736881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb80619-0803-41ba-8552-f410a2eabe96 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:12.737071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb80619-0803-41ba-8552-f410a2eabe96 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:12.739384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb80619-0803-41ba-8552-f410a2eabe96 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:12.739384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb80619-0803-41ba-8552-f410a2eabe96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:12.739384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb80619-0803-41ba-8552-f410a2eabe96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:12.739868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb80619-0803-41ba-8552-f410a2eabe96 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:12.754424 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 271/537] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:12.761119 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb80619-0803-41ba-8552-f410a2eabe96 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:12.810987 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7591c9-2a76-4984-9ab3-e9a2fe7fc066 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:12.828195 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:12.883300 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f001b-036c-451b-b8e8-f9a9efdb2372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:12.883943 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f001b-036c-451b-b8e8-f9a9efdb2372 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:12.884228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f001b-036c-451b-b8e8-f9a9efdb2372 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:12.884511 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f001b-036c-451b-b8e8-f9a9efdb2372 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:12.892885 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f001b-036c-451b-b8e8-f9a9efdb2372 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:12.894363 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f001b-036c-451b-b8e8-f9a9efdb2372 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:12.905711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-145f001b-036c-451b-b8e8-f9a9efdb2372 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:12.905711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:12.905711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:12.905711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:12.905711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:12.905711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:12.905711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:12.905711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:12.905711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:12.905711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:12.905711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:12.905711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:12.905711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:12.905711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:12.905711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:12.906574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:12.906574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:12.906574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:12.906574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:12.906574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:12.906574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:12.906574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:12.906574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:12.906574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:12.906574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:12.906574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:12.906574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:12.906574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:12.906574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:12.906574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:12.906574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:12.906574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:12.907456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:12.907456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:12.907456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:12.907456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:12.907456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:12.907456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:12.907456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:12.907456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:12.908427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 267/538] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:12.912249 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f001b-036c-451b-b8e8-f9a9efdb2372 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:12.922196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb80619-0803-41ba-8552-f410a2eabe96 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:12.986405 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5443752-8b4e-4179-948b-d7dfce27334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:12.987258 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5443752-8b4e-4179-948b-d7dfce27334e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:12.989205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5443752-8b4e-4179-948b-d7dfce27334e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:12.989593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5443752-8b4e-4179-948b-d7dfce27334e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:12.991159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5443752-8b4e-4179-948b-d7dfce27334e None admin] RBAC: Adding query filter params (role.id=e62613bfe0e143abbc25d60ea42a4416, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=e94f9a63cb4847c6916a84735d00b48f) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:12.993099 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5443752-8b4e-4179-948b-d7dfce27334e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:12.994752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5443752-8b4e-4179-948b-d7dfce27334e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:13.006851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 272/539] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:07:12 2022] GET /identity/v3/role_assignments?user.id=e94f9a63cb4847c6916a84735d00b48f&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=e62613bfe0e143abbc25d60ea42a4416 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:13.091596 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:13.099187 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f001b-036c-451b-b8e8-f9a9efdb2372 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:13.151943 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1394c2-bc40-4719-b816-7a78c8477ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:13.152579 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1394c2-bc40-4719-b816-7a78c8477ceb None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:13.152864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1394c2-bc40-4719-b816-7a78c8477ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:13.153142 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1394c2-bc40-4719-b816-7a78c8477ceb None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:13.153877 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1394c2-bc40-4719-b816-7a78c8477ceb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:13.154189 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1394c2-bc40-4719-b816-7a78c8477ceb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:13.155727 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1394c2-bc40-4719-b816-7a78c8477ceb None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:13.169536 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 268/540] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:13.175341 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5443752-8b4e-4179-948b-d7dfce27334e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:13.281708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5443752-8b4e-4179-948b-d7dfce27334e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:13.283560 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:13.328620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4b96a-a619-4075-85f0-ae273043773f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:13.329231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4b96a-a619-4075-85f0-ae273043773f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:13.329506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4b96a-a619-4075-85f0-ae273043773f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:13.329777 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4b96a-a619-4075-85f0-ae273043773f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:13.330517 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4b96a-a619-4075-85f0-ae273043773f None admin] RBAC: Adding query filter params (role.id=e62613bfe0e143abbc25d60ea42a4416, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=de5ccc88318a4b96969facf8df7bd504) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:13.330870 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4b96a-a619-4075-85f0-ae273043773f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:13.332425 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4b96a-a619-4075-85f0-ae273043773f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:13.342776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 273/541] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:07:13 2022] GET /identity/v3/role_assignments?user.id=de5ccc88318a4b96969facf8df7bd504&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=e62613bfe0e143abbc25d60ea42a4416 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:13.581959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d877a86-8d1f-4d9f-9976-9039e7578598 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:13.582981 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d877a86-8d1f-4d9f-9976-9039e7578598 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:13.583488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d877a86-8d1f-4d9f-9976-9039e7578598 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:13.585433 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 269/542] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:13.591609 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338f797-36d4-4e07-a69a-9fd2bb8ff670 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:13.592130 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338f797-36d4-4e07-a69a-9fd2bb8ff670 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:13.592205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338f797-36d4-4e07-a69a-9fd2bb8ff670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:13.619983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1338f797-36d4-4e07-a69a-9fd2bb8ff670 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:13.621121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1338f797-36d4-4e07-a69a-9fd2bb8ff670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:13.697166 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 274/543] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:13.968878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d877a86-8d1f-4d9f-9976-9039e7578598 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:14.095220 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d877a86-8d1f-4d9f-9976-9039e7578598 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:14.130391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56503ff-5b52-484b-91f4-44776d5f33a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:14.131049 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56503ff-5b52-484b-91f4-44776d5f33a8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:14.131863 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56503ff-5b52-484b-91f4-44776d5f33a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:14.132140 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56503ff-5b52-484b-91f4-44776d5f33a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:14.142861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56503ff-5b52-484b-91f4-44776d5f33a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:14.148414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-c56503ff-5b52-484b-91f4-44776d5f33a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:14.148414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:14.148414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:14.148414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:14.148414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:14.148414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:14.148414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:14.148414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:14.148414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:14.148414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:14.148414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:14.148414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:14.148414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:14.148414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:14.148414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:14.148414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:14.149294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:14.149294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:14.149294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:14.149294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:14.149294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:14.149294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:14.149294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:14.149294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:14.149294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:14.149294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:14.149294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:14.149294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:14.149294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:14.149294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:14.149294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:14.149294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:14.150097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:14.150097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:14.150097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:14.150097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:14.150097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:14.150097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:14.150097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:14.150097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:14.150097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:14.150097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:14.150097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:14.150097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:14.150097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 270/544] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:14.157040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338f797-36d4-4e07-a69a-9fd2bb8ff670 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:14.307816 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:14.313436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338f797-36d4-4e07-a69a-9fd2bb8ff670 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:14.356974 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8369dc-7210-458c-90b3-a3f463dd2b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:14.357594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8369dc-7210-458c-90b3-a3f463dd2b7d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:14.357877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8369dc-7210-458c-90b3-a3f463dd2b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:14.358173 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8369dc-7210-458c-90b3-a3f463dd2b7d None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:14.358889 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8369dc-7210-458c-90b3-a3f463dd2b7d None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:14.359385 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8369dc-7210-458c-90b3-a3f463dd2b7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:14.360770 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8369dc-7210-458c-90b3-a3f463dd2b7d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:14.374314 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 275/545] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:07:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:14.380256 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56503ff-5b52-484b-91f4-44776d5f33a8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:14.394633 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86672164-4bcc-4252-90d8-93c58e0397d9 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:14.395007 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86672164-4bcc-4252-90d8-93c58e0397d9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:14.395222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86672164-4bcc-4252-90d8-93c58e0397d9 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:14.396549 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 276/546] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:14.412373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcd23c-97d7-48e0-951f-32dc1cca831e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:14.412658 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcd23c-97d7-48e0-951f-32dc1cca831e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:14.413010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcd23c-97d7-48e0-951f-32dc1cca831e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:14.420881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:14.442667 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f6bcd23c-97d7-48e0-951f-32dc1cca831e None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:14.449622 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f6bcd23c-97d7-48e0-951f-32dc1cca831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:14.532188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56503ff-5b52-484b-91f4-44776d5f33a8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:14.576834 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2353b9-e198-474e-9f92-37f24539ff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:14.577498 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2353b9-e198-474e-9f92-37f24539ff35 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:14.577890 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2353b9-e198-474e-9f92-37f24539ff35 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:14.578176 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2353b9-e198-474e-9f92-37f24539ff35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:14.588952 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2353b9-e198-474e-9f92-37f24539ff35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:14.590427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2353b9-e198-474e-9f92-37f24539ff35 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:14.596508 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 277/547] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:07:14.607999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-8e2353b9-e198-474e-9f92-37f24539ff35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:14.607999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:14.607999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:14.607999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:14.607999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:14.607999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:14.607999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:14.607999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:14.607999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:14.607999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:14.607999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:14.607999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:14.607999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:14.607999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:14.607999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:14.607999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:14.608974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:14.608974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:14.608974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:14.608974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:14.608974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:14.608974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:14.608974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:14.608974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:14.608974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:14.608974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:14.608974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:14.608974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:14.608974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:14.608974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:14.608974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:14.608974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:14.608974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:14.610244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:14.610244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:14.610244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:14.610244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 271/548] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:14.615164 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcd23c-97d7-48e0-951f-32dc1cca831e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:14.737985 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:14.758347 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcd23c-97d7-48e0-951f-32dc1cca831e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:14.807596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3ed35-b72b-4da0-ae68-3eb4137c44db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:14.809025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3ed35-b72b-4da0-ae68-3eb4137c44db None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:14.809025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3ed35-b72b-4da0-ae68-3eb4137c44db None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:14.809025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3ed35-b72b-4da0-ae68-3eb4137c44db None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:14.809452 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3ed35-b72b-4da0-ae68-3eb4137c44db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:14.814741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3ed35-b72b-4da0-ae68-3eb4137c44db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:14.814741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3ed35-b72b-4da0-ae68-3eb4137c44db None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:14.833352 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 278/549] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:14.839156 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2353b9-e198-474e-9f92-37f24539ff35 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:14.933716 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:14.967106 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2353b9-e198-474e-9f92-37f24539ff35 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:14.974750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3ed35-b72b-4da0-ae68-3eb4137c44db None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:15.003005 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8a309-36c5-4b87-b084-2d50d93641cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:15.003643 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8a309-36c5-4b87-b084-2d50d93641cd None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:15.003926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8a309-36c5-4b87-b084-2d50d93641cd None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:15.004201 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8a309-36c5-4b87-b084-2d50d93641cd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:15.013539 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8a309-36c5-4b87-b084-2d50d93641cd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:15.015043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8a309-36c5-4b87-b084-2d50d93641cd None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:15.027376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-6dc8a309-36c5-4b87-b084-2d50d93641cd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 04:07:15.027376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:15.027376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:15.027376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:15.027376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:15.027376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:15.027376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:15.027376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:15.027376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:15.027376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:15.027376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:15.027376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:15.027376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:15.027376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:15.027376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:15.027376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:15.029233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:15.029233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:15.029233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:15.029233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:15.029233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:15.029233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:15.029233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:15.029233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:15.029233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:15.029233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:15.029233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:15.029233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:15.029233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:15.029233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:15.029233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:15.029233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:15.029233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:15.029233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:15.031562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:15.031562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:15.031562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:15.031562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:15.031562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:15.031562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:15.031562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:15.031562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:15.031562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 27 04:07:15.031562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:15.031562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 272/550] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:07:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:15.036928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8a309-36c5-4b87-b084-2d50d93641cd None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:15.161551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3ed35-b72b-4da0-ae68-3eb4137c44db None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:15.203385 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c3a9f-79f1-4070-9861-a78a93e79c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:15.205566 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c3a9f-79f1-4070-9861-a78a93e79c83 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:15.205851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c3a9f-79f1-4070-9861-a78a93e79c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:15.206123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c3a9f-79f1-4070-9861-a78a93e79c83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:15.226113 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c3a9f-79f1-4070-9861-a78a93e79c83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:15.232838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-df3c3a9f-79f1-4070-9861-a78a93e79c83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:15.232838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:15.232838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:15.232838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:15.232838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:15.232838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:15.232838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:15.232838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:15.232838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:15.232838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:15.232838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:15.232838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:15.232838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:15.232838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:15.232838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:15.232838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:15.233734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:15.233734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:15.233734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:15.233734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:15.233734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:15.233734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:15.233734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:15.233734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:15.233734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:15.233734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:15.233734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:15.233734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:15.233734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:15.233734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:15.233734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:15.233734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:15.234708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:15.234708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:15.234708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:15.234708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:15.234708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:15.234708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:15.234708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:15.234708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:15.234708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:15.234708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:15.234708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:15.234708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:15.241504 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 279/551] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:15.249509 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c3a9f-79f1-4070-9861-a78a93e79c83 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:15.264974 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:15.266896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8a309-36c5-4b87-b084-2d50d93641cd None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:15.302683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:15.310998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82928911-436a-4b1b-af1e-c12c8650aed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:15.311906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82928911-436a-4b1b-af1e-c12c8650aed8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:15.312536 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82928911-436a-4b1b-af1e-c12c8650aed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:15.313017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82928911-436a-4b1b-af1e-c12c8650aed8 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:15.313956 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82928911-436a-4b1b-af1e-c12c8650aed8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:15.314496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82928911-436a-4b1b-af1e-c12c8650aed8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:15.316678 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82928911-436a-4b1b-af1e-c12c8650aed8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:15.337300 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 273/552] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Sep 27 04:07:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:15.347168 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82928911-436a-4b1b-af1e-c12c8650aed8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:15.405814 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c3a9f-79f1-4070-9861-a78a93e79c83 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:15.451965 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df313083-c92a-487d-92c9-a6db77dc6443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:15.452724 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df313083-c92a-487d-92c9-a6db77dc6443 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:15.453011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df313083-c92a-487d-92c9-a6db77dc6443 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:15.453289 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df313083-c92a-487d-92c9-a6db77dc6443 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:15.453974 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df313083-c92a-487d-92c9-a6db77dc6443 None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:15.454291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df313083-c92a-487d-92c9-a6db77dc6443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:15.456329 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df313083-c92a-487d-92c9-a6db77dc6443 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:15.465918 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 280/553] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:07:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:15.470497 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bfe79-7512-4360-b030-92db7d841d70 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:15.470497 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bfe79-7512-4360-b030-92db7d841d70 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:15.470497 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bfe79-7512-4360-b030-92db7d841d70 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:15.473237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 281/554] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:15.474010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bfe79-7512-4360-b030-92db7d841d70 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:15.494925 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82928911-436a-4b1b-af1e-c12c8650aed8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:15.532384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe74a3-559c-4b5d-853b-542d4c44e34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:15.533730 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe74a3-559c-4b5d-853b-542d4c44e34f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:15.534246 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe74a3-559c-4b5d-853b-542d4c44e34f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:15.534898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe74a3-559c-4b5d-853b-542d4c44e34f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:15.557632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:15.595294 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bfe79-7512-4360-b030-92db7d841d70 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:15.607270 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:15.625284 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe74a3-559c-4b5d-853b-542d4c44e34f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:15.627749 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe74a3-559c-4b5d-853b-542d4c44e34f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:15.636446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135578d-21e9-441b-bb66-13f6d6ba0c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:15.637090 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135578d-21e9-441b-bb66-13f6d6ba0c17 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:15.637376 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135578d-21e9-441b-bb66-13f6d6ba0c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:15.637656 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135578d-21e9-441b-bb66-13f6d6ba0c17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:15.651282 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135578d-21e9-441b-bb66-13f6d6ba0c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:15.653169 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135578d-21e9-441b-bb66-13f6d6ba0c17 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:15.672713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-4135578d-21e9-441b-bb66-13f6d6ba0c17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:15.672713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:15.672713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:15.672713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:15.672713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:15.672713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:15.672713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:15.672713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:15.672713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:15.672713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:15.672713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:15.672713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:15.672713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:15.672713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:15.672713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:15.672713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:15.673715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:15.673715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:15.673715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:15.673715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:15.673715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:15.673715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:15.673715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:15.673715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:15.673715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:15.673715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:15.673715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:15.673715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:15.673715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:15.673715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:15.673715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:15.673715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:15.673715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:15.674595 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:15.674595 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:15.674595 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:15.679068 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 282/555] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:15.681341 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ebcd3-f24e-468c-8144-9171c3839922 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:15.681645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ebcd3-f24e-468c-8144-9171c3839922 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:15.681930 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ebcd3-f24e-468c-8144-9171c3839922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:15.704962 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-df0ebcd3-f24e-468c-8144-9171c3839922 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:15.706811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-df0ebcd3-f24e-468c-8144-9171c3839922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:15.764771 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 274/556] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:07:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 04:07:15.766145 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe74a3-559c-4b5d-853b-542d4c44e34f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:15.794397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 283/557] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:15.795289 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ebcd3-f24e-468c-8144-9171c3839922 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:15.853075 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:15.887148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:15.891261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe74a3-559c-4b5d-853b-542d4c44e34f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:15.911747 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ebcd3-f24e-468c-8144-9171c3839922 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:15.937096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bbbf1-48f9-4a05-8ab4-03c6b2dd7427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:15.938320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bbbf1-48f9-4a05-8ab4-03c6b2dd7427 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:15.939085 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bbbf1-48f9-4a05-8ab4-03c6b2dd7427 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:15.939975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bbbf1-48f9-4a05-8ab4-03c6b2dd7427 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:15.941107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bbbf1-48f9-4a05-8ab4-03c6b2dd7427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:15.941618 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bbbf1-48f9-4a05-8ab4-03c6b2dd7427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:15.944396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bbbf1-48f9-4a05-8ab4-03c6b2dd7427 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:15.952144 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb8e42-df46-4643-8ec0-b8b6ed878930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:15.952884 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb8e42-df46-4643-8ec0-b8b6ed878930 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:15.953152 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb8e42-df46-4643-8ec0-b8b6ed878930 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:15.953481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb8e42-df46-4643-8ec0-b8b6ed878930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:15.962477 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 275/558] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:15.964158 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625d095-4ae6-48c6-b5ef-a544dec5e0cb None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:15.964659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625d095-4ae6-48c6-b5ef-a544dec5e0cb None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:15.965202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625d095-4ae6-48c6-b5ef-a544dec5e0cb None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:15.967079 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 276/559] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:15.968145 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625d095-4ae6-48c6-b5ef-a544dec5e0cb None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:15.974616 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb8e42-df46-4643-8ec0-b8b6ed878930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:15.976111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb8e42-df46-4643-8ec0-b8b6ed878930 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:15.995984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-3ecb8e42-df46-4643-8ec0-b8b6ed878930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:15.995984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:15.995984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:15.995984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:15.995984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:15.995984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:15.995984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:15.995984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:15.995984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:15.995984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:15.995984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:15.995984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:15.995984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:15.995984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:15.995984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:15.995984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:15.996991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:15.996991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:15.996991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:15.996991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:15.996991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:15.996991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:15.996991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:15.996991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:15.996991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:15.996991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:15.996991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:15.996991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:15.996991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:15.996991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:15.996991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:15.996991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:15.996991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:15.997899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:15.997899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:15.997899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:16.001736 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 284/560] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:16.003009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23920a-fe16-40d7-90c6-5018262cab26 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:16.003301 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23920a-fe16-40d7-90c6-5018262cab26 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:16.003584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23920a-fe16-40d7-90c6-5018262cab26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:16.023631 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5e23920a-fe16-40d7-90c6-5018262cab26 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:16.024918 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5e23920a-fe16-40d7-90c6-5018262cab26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:16.097656 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 285/561] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:16.097877 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625d095-4ae6-48c6-b5ef-a544dec5e0cb None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:16.098487 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23920a-fe16-40d7-90c6-5018262cab26 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:16.132696 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe47ae-2c05-4b47-aef4-631160ee5923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:16.133334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe47ae-2c05-4b47-aef4-631160ee5923 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:16.133620 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe47ae-2c05-4b47-aef4-631160ee5923 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:16.133896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe47ae-2c05-4b47-aef4-631160ee5923 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:16.140497 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:16.142494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe47ae-2c05-4b47-aef4-631160ee5923 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:16.144408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe47ae-2c05-4b47-aef4-631160ee5923 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:16.158210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-3abe47ae-2c05-4b47-aef4-631160ee5923 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:07:16.158210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:16.158210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:16.158210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:16.158210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:16.158210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:16.158210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:16.158210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:16.158210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:16.158210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:16.158210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:16.158210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:16.158210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:16.158210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:16.158210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:16.158210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:16.159279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:16.159279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:16.159279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:16.159279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:16.159279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:16.159279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:16.159279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:16.159279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:16.159279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:16.159279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:16.159279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:16.159279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:16.159279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:16.159279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:16.159279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:16.159279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:16.159279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:16.159279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:16.160217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:16.160217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:16.160217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:16.160217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:16.160217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:16.160217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:16.160217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:16.160217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:16.160217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:07:16.160217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:16.164600 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 277/562] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 27 04:07:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:16.165865 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9654ee8-30c2-4748-aa57-0e2f3394d19d None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:16.166154 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9654ee8-30c2-4748-aa57-0e2f3394d19d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:16.166420 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9654ee8-30c2-4748-aa57-0e2f3394d19d None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:16.168330 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 278/563] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:16.169062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9654ee8-30c2-4748-aa57-0e2f3394d19d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:16.184871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:16.247896 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23920a-fe16-40d7-90c6-5018262cab26 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:16.295237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb80d5a-e5e2-46b8-8831-e1a1bf6f3e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:16.295851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb80d5a-e5e2-46b8-8831-e1a1bf6f3e8d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:16.296126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb80d5a-e5e2-46b8-8831-e1a1bf6f3e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:16.296412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb80d5a-e5e2-46b8-8831-e1a1bf6f3e8d None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:16.297071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb80d5a-e5e2-46b8-8831-e1a1bf6f3e8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:16.297380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb80d5a-e5e2-46b8-8831-e1a1bf6f3e8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:16.298782 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb80d5a-e5e2-46b8-8831-e1a1bf6f3e8d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:16.309499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9654ee8-30c2-4748-aa57-0e2f3394d19d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:16.310326 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 286/564] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:16.315572 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb80d5a-e5e2-46b8-8831-e1a1bf6f3e8d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:16.349411 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef144530-ddc5-4861-bdcf-16537a756f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:16.351334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef144530-ddc5-4861-bdcf-16537a756f05 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:16.351892 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef144530-ddc5-4861-bdcf-16537a756f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:16.352370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef144530-ddc5-4861-bdcf-16537a756f05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:16.364815 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef144530-ddc5-4861-bdcf-16537a756f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:16.369697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-ef144530-ddc5-4861-bdcf-16537a756f05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:16.369697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:16.369697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:16.369697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:16.369697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:16.369697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:16.369697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:16.369697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:16.369697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:16.369697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:16.369697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:16.369697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:16.369697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:16.369697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:16.369697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:16.369697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:16.370690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:16.370690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:16.370690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:16.370690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:16.370690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:16.370690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:16.370690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:16.370690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:16.370690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:16.370690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:16.370690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:16.370690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:16.370690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:16.370690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:16.370690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:16.370690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:16.371930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:16.371930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:16.371930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:16.371930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:16.371930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:16.371930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:16.371930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:16.371930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:16.371930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:16.371930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:16.371930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:16.371930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:16.371930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 279/565] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:16.372641 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b51a0-eb5f-439d-a2ed-4e01e64e0e31 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:16.372641 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b51a0-eb5f-439d-a2ed-4e01e64e0e31 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:16.373123 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b51a0-eb5f-439d-a2ed-4e01e64e0e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:16.397522 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-266b51a0-eb5f-439d-a2ed-4e01e64e0e31 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:16.398758 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-266b51a0-eb5f-439d-a2ed-4e01e64e0e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:16.426473 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:16.433717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb80d5a-e5e2-46b8-8831-e1a1bf6f3e8d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:16.477388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:16.478595 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018874b-dc3d-4c35-a188-79d593668d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:16.479394 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018874b-dc3d-4c35-a188-79d593668d92 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:16.479721 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018874b-dc3d-4c35-a188-79d593668d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:16.479971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018874b-dc3d-4c35-a188-79d593668d92 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:16.480791 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018874b-dc3d-4c35-a188-79d593668d92 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:16.481164 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018874b-dc3d-4c35-a188-79d593668d92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:16.482675 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018874b-dc3d-4c35-a188-79d593668d92 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:16.484910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 280/566] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:16.487888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b51a0-eb5f-439d-a2ed-4e01e64e0e31 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:16.501937 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 287/567] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 27 04:07:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:16.503047 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018874b-dc3d-4c35-a188-79d593668d92 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:16.605889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b51a0-eb5f-439d-a2ed-4e01e64e0e31 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:16.614272 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018874b-dc3d-4c35-a188-79d593668d92 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:16.642362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769377b1-859c-4076-8375-a6ba3be299a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:16.643088 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769377b1-859c-4076-8375-a6ba3be299a1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:16.643357 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769377b1-859c-4076-8375-a6ba3be299a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:16.643564 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769377b1-859c-4076-8375-a6ba3be299a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:16.650451 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769377b1-859c-4076-8375-a6ba3be299a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:16.650664 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8b323-7915-4e66-a32d-ef04fa062969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:16.651290 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8b323-7915-4e66-a32d-ef04fa062969 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:16.651576 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8b323-7915-4e66-a32d-ef04fa062969 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:16.651856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8b323-7915-4e66-a32d-ef04fa062969 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:16.651954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769377b1-859c-4076-8375-a6ba3be299a1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:16.662166 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8b323-7915-4e66-a32d-ef04fa062969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:16.664344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-769377b1-859c-4076-8375-a6ba3be299a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:16.664344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:16.664344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:16.664344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:16.664344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:16.664344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:16.664344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:16.664344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:16.664344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:16.664344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:16.664344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:16.664344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:16.664344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:16.664344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:16.664344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:16.665196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:16.665196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:16.665196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:16.665196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:16.665196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:16.665196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:16.665196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:16.665196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:16.665196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:16.665196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:16.665196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:16.665196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:16.665196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:16.665196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:16.665196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:16.665196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:16.665196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:16.666087 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:16.666087 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:16.666087 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:16.666087 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:16.666087 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:16.666087 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:16.666087 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:16.666087 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:16.667467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-ddb8b323-7915-4e66-a32d-ef04fa062969 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:16.667467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:16.667467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:16.667467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:16.667467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:16.667467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:16.667467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:16.667467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:16.667467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:16.667467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:16.667467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:16.667467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:16.667467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:16.667467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:16.667467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:16.667467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:16.668343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:16.668343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:16.668343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:16.668343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:16.668343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:16.668343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:16.668343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:16.668343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:16.668343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:16.668343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:16.668343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:16.668343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:16.668343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:16.668343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:16.668343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:16.668343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:16.669851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:16.669851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:16.669851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:16.669851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:16.669851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:16.669851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:16.669851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:16.669851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:16.669851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:16.669851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:16.669851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:16.669851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:16.671534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 281/568] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:16.671534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769377b1-859c-4076-8375-a6ba3be299a1 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:16.677750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 288/569] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:16.677750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8b323-7915-4e66-a32d-ef04fa062969 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:16.693662 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:16.731476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:16.773711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769377b1-859c-4076-8375-a6ba3be299a1 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:16.784461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8b323-7915-4e66-a32d-ef04fa062969 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:16.807523 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a4f39-e9b8-409c-83f8-16ba75762df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:16.808146 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a4f39-e9b8-409c-83f8-16ba75762df4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:16.808434 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a4f39-e9b8-409c-83f8-16ba75762df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:16.808714 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a4f39-e9b8-409c-83f8-16ba75762df4 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:16.809389 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a4f39-e9b8-409c-83f8-16ba75762df4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:16.809700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a4f39-e9b8-409c-83f8-16ba75762df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:16.811369 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a4f39-e9b8-409c-83f8-16ba75762df4 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:16.821701 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 282/570] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:07:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:16.822606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a4f39-e9b8-409c-83f8-16ba75762df4 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:16.825810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347daf6-39c9-43e1-8240-3ca49f5bc9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:16.826640 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347daf6-39c9-43e1-8240-3ca49f5bc9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:16.826952 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347daf6-39c9-43e1-8240-3ca49f5bc9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:16.827220 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347daf6-39c9-43e1-8240-3ca49f5bc9a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:16.837734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347daf6-39c9-43e1-8240-3ca49f5bc9a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:16.839208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347daf6-39c9-43e1-8240-3ca49f5bc9a8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:16.854548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-3347daf6-39c9-43e1-8240-3ca49f5bc9a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:16.854548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:16.854548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:16.854548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:16.854548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:16.854548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:16.854548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:16.854548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:16.854548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:16.854548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:16.854548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:16.854548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:16.854548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:16.854548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:16.854548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:16.854548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:16.855708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:16.855708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:16.855708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:16.855708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:16.855708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:16.855708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:16.855708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:16.855708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:16.855708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:16.855708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:16.855708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:16.855708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:16.855708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:16.855708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:16.855708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:16.855708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:16.855708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:16.856594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:16.856594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:16.856594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:16.856594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 289/571] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:16.856594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347daf6-39c9-43e1-8240-3ca49f5bc9a8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:16.919394 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:16.925679 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a4f39-e9b8-409c-83f8-16ba75762df4 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:16.945352 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:16.957704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347daf6-39c9-43e1-8240-3ca49f5bc9a8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:16.959437 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac89af0-5579-4a6d-ac77-1fede225dcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:16.960034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac89af0-5579-4a6d-ac77-1fede225dcbf None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:16.960311 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac89af0-5579-4a6d-ac77-1fede225dcbf None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:16.960579 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac89af0-5579-4a6d-ac77-1fede225dcbf None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:16.961268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac89af0-5579-4a6d-ac77-1fede225dcbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:16.961573 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac89af0-5579-4a6d-ac77-1fede225dcbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:16.963017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac89af0-5579-4a6d-ac77-1fede225dcbf None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:16.974429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 283/572] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:16.975274 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac89af0-5579-4a6d-ac77-1fede225dcbf None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:16.995299 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d53389-bf34-4ad0-a575-32af55bea35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:16.995910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d53389-bf34-4ad0-a575-32af55bea35b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:16.996196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d53389-bf34-4ad0-a575-32af55bea35b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:16.996475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d53389-bf34-4ad0-a575-32af55bea35b None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:16.997145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d53389-bf34-4ad0-a575-32af55bea35b None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:16.997455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d53389-bf34-4ad0-a575-32af55bea35b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:16.998851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d53389-bf34-4ad0-a575-32af55bea35b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:17.007200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 290/573] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:07:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:17.007974 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d53389-bf34-4ad0-a575-32af55bea35b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:17.074944 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac89af0-5579-4a6d-ac77-1fede225dcbf None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:17.104447 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d53389-bf34-4ad0-a575-32af55bea35b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:17.109307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea6d9d-f367-437f-8f1f-5d4a585f5199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:17.109937 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea6d9d-f367-437f-8f1f-5d4a585f5199 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:17.110225 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea6d9d-f367-437f-8f1f-5d4a585f5199 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:17.110503 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea6d9d-f367-437f-8f1f-5d4a585f5199 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:17.121052 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea6d9d-f367-437f-8f1f-5d4a585f5199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:17.125911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-3aea6d9d-f367-437f-8f1f-5d4a585f5199 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:17.125911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:17.125911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:17.125911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:17.125911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:17.125911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:17.125911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:17.125911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:17.125911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:17.125911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:17.125911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:17.125911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:17.125911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:17.125911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:17.125911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:17.125911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:17.126959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:17.126959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:17.126959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:17.126959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:17.126959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:17.126959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:17.126959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:17.126959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:17.126959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:17.126959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:17.126959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:17.126959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:17.126959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:17.126959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:17.126959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:17.126959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:17.127994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:17.127994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:17.127994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:17.127994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:17.127994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:17.127994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:17.127994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:17.127994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:17.127994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:17.127994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:17.127994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:17.127994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:17.127994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 284/574] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:17.129267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea6d9d-f367-437f-8f1f-5d4a585f5199 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:17.136722 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:17.147875 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1bc98-96a8-48cd-95f3-dfc9ad1210c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:17.148518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1bc98-96a8-48cd-95f3-dfc9ad1210c2 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:17.148803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1bc98-96a8-48cd-95f3-dfc9ad1210c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:17.149079 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1bc98-96a8-48cd-95f3-dfc9ad1210c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:17.159826 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1bc98-96a8-48cd-95f3-dfc9ad1210c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:17.161326 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1bc98-96a8-48cd-95f3-dfc9ad1210c2 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:17.173864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:17.175856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-95b1bc98-96a8-48cd-95f3-dfc9ad1210c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:17.175856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:17.175856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:17.175856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:17.175856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:17.175856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:17.175856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:17.175856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:17.175856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:17.175856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:17.175856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:17.175856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:17.175856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:17.175856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:17.175856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:17.175856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:17.176846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:17.176846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:17.176846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:17.176846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:17.176846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:17.176846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:17.176846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:17.176846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:17.176846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:17.176846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:17.176846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:17.176846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:17.176846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:17.176846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:17.176846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:17.176846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:17.176846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:17.177751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:17.177751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:17.177751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:17.177751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 291/575] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:17.178698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1bc98-96a8-48cd-95f3-dfc9ad1210c2 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:17.235874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea6d9d-f367-437f-8f1f-5d4a585f5199 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:17.268892 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2d9be-9d6d-41e8-b389-7990dc655bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:17.269633 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2d9be-9d6d-41e8-b389-7990dc655bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:17.269908 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2d9be-9d6d-41e8-b389-7990dc655bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:17.270185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2d9be-9d6d-41e8-b389-7990dc655bb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:17.270871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2d9be-9d6d-41e8-b389-7990dc655bb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:17.271180 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2d9be-9d6d-41e8-b389-7990dc655bb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:17.272550 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2d9be-9d6d-41e8-b389-7990dc655bb6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:17.274581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1bc98-96a8-48cd-95f3-dfc9ad1210c2 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:17.283389 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 285/576] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:17.284245 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2d9be-9d6d-41e8-b389-7990dc655bb6 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:17.311857 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519b0d7-0a32-4844-a93d-39051e7954e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:17.312462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519b0d7-0a32-4844-a93d-39051e7954e3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:17.312748 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519b0d7-0a32-4844-a93d-39051e7954e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:17.313028 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519b0d7-0a32-4844-a93d-39051e7954e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:17.313756 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519b0d7-0a32-4844-a93d-39051e7954e3 None admin] RBAC: Adding query filter params (role.id=e62613bfe0e143abbc25d60ea42a4416, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=c295a3063c3b45be96b406f586180142) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:17.314072 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519b0d7-0a32-4844-a93d-39051e7954e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:17.315541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519b0d7-0a32-4844-a93d-39051e7954e3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:17.320846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 292/577] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:07:17 2022] GET /identity/v3/role_assignments?user.id=c295a3063c3b45be96b406f586180142&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=e62613bfe0e143abbc25d60ea42a4416 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:17.321623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519b0d7-0a32-4844-a93d-39051e7954e3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:17.376756 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:17.397844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:17.405673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2d9be-9d6d-41e8-b389-7990dc655bb6 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:17.444887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68f88d-7b95-4fd7-8e73-ab15be921923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:17.445544 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68f88d-7b95-4fd7-8e73-ab15be921923 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:17.445844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68f88d-7b95-4fd7-8e73-ab15be921923 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:17.446133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68f88d-7b95-4fd7-8e73-ab15be921923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:17.455581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519b0d7-0a32-4844-a93d-39051e7954e3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:17.458995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68f88d-7b95-4fd7-8e73-ab15be921923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:17.461450 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68f88d-7b95-4fd7-8e73-ab15be921923 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:17.477631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-6a68f88d-7b95-4fd7-8e73-ab15be921923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:17.477631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:17.477631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:17.477631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:17.477631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:17.477631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:17.477631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:17.477631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:17.477631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:17.477631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:17.477631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:17.477631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:17.477631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:17.477631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:17.477631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:17.477631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:17.478992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:17.478992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:17.478992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:17.478992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:17.478992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:17.478992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:17.478992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:17.478992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:17.478992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:17.478992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:17.478992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:17.478992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:17.478992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:17.478992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:17.478992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:17.478992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:17.478992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:17.479881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:17.479881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:17.479881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:17.479881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 286/578] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:17.479881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68f88d-7b95-4fd7-8e73-ab15be921923 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:17.501769 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f120d41-09f1-49c8-8344-10c61b39f532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:17.502462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f120d41-09f1-49c8-8344-10c61b39f532 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:17.502659 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f120d41-09f1-49c8-8344-10c61b39f532 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:17.502958 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f120d41-09f1-49c8-8344-10c61b39f532 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:17.503878 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f120d41-09f1-49c8-8344-10c61b39f532 None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:17.503980 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f120d41-09f1-49c8-8344-10c61b39f532 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:17.505475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f120d41-09f1-49c8-8344-10c61b39f532 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:17.518349 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 293/579] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:07:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:17.519201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f120d41-09f1-49c8-8344-10c61b39f532 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:17.605878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68f88d-7b95-4fd7-8e73-ab15be921923 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:17.627419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f120d41-09f1-49c8-8344-10c61b39f532 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:17.629616 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:17.641302 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d461434-58f4-4160-8f62-f6e21f06077e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:17.641915 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d461434-58f4-4160-8f62-f6e21f06077e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:17.642209 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d461434-58f4-4160-8f62-f6e21f06077e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:17.642487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d461434-58f4-4160-8f62-f6e21f06077e None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:17.643186 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d461434-58f4-4160-8f62-f6e21f06077e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:17.643601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d461434-58f4-4160-8f62-f6e21f06077e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:17.644876 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d461434-58f4-4160-8f62-f6e21f06077e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:17.661821 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 287/580] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:17.663225 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d461434-58f4-4160-8f62-f6e21f06077e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:17.664220 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ee808-8689-4cae-9136-2d1c019e3065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:17.664851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ee808-8689-4cae-9136-2d1c019e3065 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:17.665130 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ee808-8689-4cae-9136-2d1c019e3065 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:17.665401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ee808-8689-4cae-9136-2d1c019e3065 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:17.674002 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ee808-8689-4cae-9136-2d1c019e3065 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:17.675776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ee808-8689-4cae-9136-2d1c019e3065 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:17.677606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:17.687728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-be5ee808-8689-4cae-9136-2d1c019e3065 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:17.687728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:17.687728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:17.687728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:17.687728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:17.687728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:17.687728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:17.687728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:17.687728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:17.687728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:17.687728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:17.687728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:17.687728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:17.687728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:17.687728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:17.688648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:17.688648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:17.688648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:17.688648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:17.688648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:17.688648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:17.688648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:17.688648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:17.688648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:17.688648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:17.688648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:17.688648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:17.688648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:17.688648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:17.688648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:17.688648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:17.688648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:17.689618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:17.689618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:17.689618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:17.689618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:17.689618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:17.689618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:17.689618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:17.689618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:17.693453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 294/581] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:17.694312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ee808-8689-4cae-9136-2d1c019e3065 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:17.765689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d461434-58f4-4160-8f62-f6e21f06077e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:17.813400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6f842-ac8f-4f79-b437-b401b80d61fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:17.814150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6f842-ac8f-4f79-b437-b401b80d61fb None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:17.814528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6f842-ac8f-4f79-b437-b401b80d61fb None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:17.814987 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6f842-ac8f-4f79-b437-b401b80d61fb None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:17.815644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6f842-ac8f-4f79-b437-b401b80d61fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:17.815945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6f842-ac8f-4f79-b437-b401b80d61fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:17.817314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6f842-ac8f-4f79-b437-b401b80d61fb None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:17.818139 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ee808-8689-4cae-9136-2d1c019e3065 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:17.830576 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 288/582] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:17.831614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6f842-ac8f-4f79-b437-b401b80d61fb None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:17.859314 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44087290-df81-4c67-ad10-49ba1f5d5642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:17.860432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44087290-df81-4c67-ad10-49ba1f5d5642 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:17.861042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44087290-df81-4c67-ad10-49ba1f5d5642 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:17.861702 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44087290-df81-4c67-ad10-49ba1f5d5642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:17.874240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44087290-df81-4c67-ad10-49ba1f5d5642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:17.875859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44087290-df81-4c67-ad10-49ba1f5d5642 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:17.890520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-44087290-df81-4c67-ad10-49ba1f5d5642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:17.890520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:17.890520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:17.890520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:17.890520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:17.890520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:17.890520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:17.890520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:17.890520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:17.890520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:17.890520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:17.890520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:17.890520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:17.890520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:17.890520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:17.890520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:17.896273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:17.896273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:17.896273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:17.896273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:17.896273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:17.896273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:17.896273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:17.896273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:17.896273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:17.896273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:17.896273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:17.896273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:17.896273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:17.896273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:17.896273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:17.896273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:17.896273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:17.897949 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:17.897949 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:17.897949 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:17.897949 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 295/583] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:17.897949 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44087290-df81-4c67-ad10-49ba1f5d5642 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:17.912383 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:17.914711 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:17.944916 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6f842-ac8f-4f79-b437-b401b80d61fb None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:17.980328 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a42cb3-4311-4dca-87a7-fe72109c7579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:17.981470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42cb3-4311-4dca-87a7-fe72109c7579 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:17.981854 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42cb3-4311-4dca-87a7-fe72109c7579 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:17.982206 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42cb3-4311-4dca-87a7-fe72109c7579 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:17.990634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a42cb3-4311-4dca-87a7-fe72109c7579 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:17.992190 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a42cb3-4311-4dca-87a7-fe72109c7579 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:17.998740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44087290-df81-4c67-ad10-49ba1f5d5642 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:18.003381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-42a42cb3-4311-4dca-87a7-fe72109c7579 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 27 04:07:18.003381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:18.003381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:18.003381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:18.003381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:18.003381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:18.003381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:18.003381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:18.003381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:18.003381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:18.003381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:18.003381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:18.003381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:18.003381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:18.003381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:18.003381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:18.004496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:18.004496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:18.004496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:18.004496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:18.004496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:18.004496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:18.004496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:18.004496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:18.004496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:18.004496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:18.004496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:18.004496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:18.004496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:18.004496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:18.004496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:18.004496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:18.004496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:18.004496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:18.010753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:18.010753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:18.010753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:18.010753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:18.010753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:18.010753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:18.010753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:18.010753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:18.010753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 27 04:07:18.010753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:18.010753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 289/584] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:07:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:18.010753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a42cb3-4311-4dca-87a7-fe72109c7579 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:18.040516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb5b11-2051-43cf-b027-232746b49f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:18.041124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb5b11-2051-43cf-b027-232746b49f15 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:18.041449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb5b11-2051-43cf-b027-232746b49f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:18.041725 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb5b11-2051-43cf-b027-232746b49f15 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:18.042418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb5b11-2051-43cf-b027-232746b49f15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:18.042766 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb5b11-2051-43cf-b027-232746b49f15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:18.044428 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb5b11-2051-43cf-b027-232746b49f15 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:18.062017 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 296/585] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:18.062017 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb5b11-2051-43cf-b027-232746b49f15 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:18.123333 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a42cb3-4311-4dca-87a7-fe72109c7579 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:18.153806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:18.155037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:18.159144 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e98f28-ea3a-4d04-a79b-bb1c37211773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:18.160434 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e98f28-ea3a-4d04-a79b-bb1c37211773 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:18.160961 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e98f28-ea3a-4d04-a79b-bb1c37211773 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:18.161480 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e98f28-ea3a-4d04-a79b-bb1c37211773 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:18.169116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e98f28-ea3a-4d04-a79b-bb1c37211773 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:18.170578 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e98f28-ea3a-4d04-a79b-bb1c37211773 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:18.179134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb5b11-2051-43cf-b027-232746b49f15 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:18.181896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-45e98f28-ea3a-4d04-a79b-bb1c37211773 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 04:07:18.181896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:18.181896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:18.181896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:18.181896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:18.181896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:18.181896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:18.181896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:18.181896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:18.181896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:18.181896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:18.181896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:18.181896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:18.181896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:18.181896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:18.181896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:18.183068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:18.183068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:18.183068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:18.183068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:18.183068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:18.183068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:18.183068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:18.183068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:18.183068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:18.183068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:18.183068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:18.183068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:18.183068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:18.183068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:18.183068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:18.183068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:18.183068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:18.183068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:18.184232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:18.184232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:18.184232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:18.184232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:18.184232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:18.184232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:18.184232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:18.184232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:18.184232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 04:07:18.184232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:18.187509 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 290/586] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:18.188407 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e98f28-ea3a-4d04-a79b-bb1c37211773 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:18.221258 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e7cca-440f-4184-936c-639f745451d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:18.222075 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e7cca-440f-4184-936c-639f745451d1 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:18.222353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e7cca-440f-4184-936c-639f745451d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:18.222627 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e7cca-440f-4184-936c-639f745451d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:18.223320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e7cca-440f-4184-936c-639f745451d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:18.223627 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e7cca-440f-4184-936c-639f745451d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:18.225000 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e7cca-440f-4184-936c-639f745451d1 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:18.241263 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 297/587] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:18.241955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e7cca-440f-4184-936c-639f745451d1 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:18.295888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e98f28-ea3a-4d04-a79b-bb1c37211773 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:18.330521 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012babe-d001-4cb8-970a-41404a8c18cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:18.331530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012babe-d001-4cb8-970a-41404a8c18cb None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:18.331820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012babe-d001-4cb8-970a-41404a8c18cb None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:18.332092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012babe-d001-4cb8-970a-41404a8c18cb None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:18.332818 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012babe-d001-4cb8-970a-41404a8c18cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:18.333121 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012babe-d001-4cb8-970a-41404a8c18cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:18.334838 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012babe-d001-4cb8-970a-41404a8c18cb None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:18.339917 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e7cca-440f-4184-936c-639f745451d1 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:18.356704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 291/588] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Sep 27 04:07:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:18.356704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012babe-d001-4cb8-970a-41404a8c18cb None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:18.379576 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85389f-0dd0-435d-a7dd-c660103f23a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:18.380226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85389f-0dd0-435d-a7dd-c660103f23a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:18.380510 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85389f-0dd0-435d-a7dd-c660103f23a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:18.380783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85389f-0dd0-435d-a7dd-c660103f23a5 None admin] PATH_INFO: `/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/3960d52dee8443cf9ec8930a389a7b60/roles/e62613bfe0e143abbc25d60ea42a4416` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:18.384553 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:18.405296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85389f-0dd0-435d-a7dd-c660103f23a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=37e7a8d1446d4cdea0ba00124411cd93, user_id=3960d52dee8443cf9ec8930a389a7b60, role_id=e62613bfe0e143abbc25d60ea42a4416)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:18.406932 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85389f-0dd0-435d-a7dd-c660103f23a5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:18.410800 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:18.421521 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 298/589] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:07:18 2022] PUT /identity/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/3960d52dee8443cf9ec8930a389a7b60/roles/e62613bfe0e143abbc25d60ea42a4416 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:07:18.422632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85389f-0dd0-435d-a7dd-c660103f23a5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:18.470324 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012babe-d001-4cb8-970a-41404a8c18cb None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:18.519333 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9837226-33f7-4d34-84fd-3f0f38b1966d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:18.520358 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9837226-33f7-4d34-84fd-3f0f38b1966d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:18.520881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9837226-33f7-4d34-84fd-3f0f38b1966d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:18.521357 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9837226-33f7-4d34-84fd-3f0f38b1966d None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:18.523986 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9837226-33f7-4d34-84fd-3f0f38b1966d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:18.524635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9837226-33f7-4d34-84fd-3f0f38b1966d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:18.526905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9837226-33f7-4d34-84fd-3f0f38b1966d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:18.554820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 292/590] 10.222.0.48 () {56 vars in 1139 bytes} [Tue Sep 27 04:07:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:18.556803 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9837226-33f7-4d34-84fd-3f0f38b1966d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:18.562861 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85389f-0dd0-435d-a7dd-c660103f23a5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:18.602569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7ca18-3688-4d71-b041-52f1f9f04319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:18.603576 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7ca18-3688-4d71-b041-52f1f9f04319 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:18.603867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7ca18-3688-4d71-b041-52f1f9f04319 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:18.604197 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7ca18-3688-4d71-b041-52f1f9f04319 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:18.614065 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7ca18-3688-4d71-b041-52f1f9f04319 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:18.615621 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7ca18-3688-4d71-b041-52f1f9f04319 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:18.633334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-b2d7ca18-3688-4d71-b041-52f1f9f04319 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 04:07:18.633334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:18.633334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:18.633334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:18.633334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:18.633334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:18.633334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:18.633334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:18.633334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:18.633334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:18.633334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:18.633334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:18.633334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:18.633334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:18.633334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:18.633334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:18.634320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:18.634320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:18.634320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:18.634320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:18.634320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:18.634320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:18.634320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:18.634320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:18.634320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:18.634320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:18.634320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:18.634320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:18.634320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:18.634320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:18.634320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:18.634320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:18.634320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:18.634320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:18.635292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:18.635292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:18.635292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:18.635292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:18.635292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:18.635292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:18.635292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:18.635292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:18.635292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 04:07:18.635292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:18.635292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 299/591] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:07:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:18.635916 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7ca18-3688-4d71-b041-52f1f9f04319 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:18.684903 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9837226-33f7-4d34-84fd-3f0f38b1966d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:18.695241 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:18.696516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:18.724159 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664abcd6-e8e2-4ca6-a79c-dd430b22bfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:18.725470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664abcd6-e8e2-4ca6-a79c-dd430b22bfec None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:18.725792 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664abcd6-e8e2-4ca6-a79c-dd430b22bfec None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:18.726137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664abcd6-e8e2-4ca6-a79c-dd430b22bfec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:18.736995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664abcd6-e8e2-4ca6-a79c-dd430b22bfec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:18.738633 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664abcd6-e8e2-4ca6-a79c-dd430b22bfec None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:18.754835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-664abcd6-e8e2-4ca6-a79c-dd430b22bfec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:18.754835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:18.754835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:18.754835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:18.754835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:18.754835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:18.754835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:18.754835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:18.754835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:18.754835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:18.754835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:18.754835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:18.754835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:18.754835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:18.754835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:18.754835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:18.756003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:18.756003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:18.756003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:18.756003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:18.756003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:18.756003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:18.756003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:18.756003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:18.756003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:18.756003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:18.756003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:18.756003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:18.756003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:18.756003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:18.756003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:18.756003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:18.756003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:18.757044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:18.757044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:18.757044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:18.757044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 293/592] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:18.758641 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664abcd6-e8e2-4ca6-a79c-dd430b22bfec None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:18.761908 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7ca18-3688-4d71-b041-52f1f9f04319 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:18.804535 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b565f-768d-4549-b79c-03b86a74ecd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:18.805532 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b565f-768d-4549-b79c-03b86a74ecd8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:18.805816 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b565f-768d-4549-b79c-03b86a74ecd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:18.806096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b565f-768d-4549-b79c-03b86a74ecd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:18.820387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b565f-768d-4549-b79c-03b86a74ecd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:18.822391 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b565f-768d-4549-b79c-03b86a74ecd8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:18.839925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-bf9b565f-768d-4549-b79c-03b86a74ecd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:18.839925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:18.839925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:18.839925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:18.839925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:18.839925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:18.839925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:18.839925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:18.839925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:18.839925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:18.839925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:18.839925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:18.839925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:18.839925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:18.839925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:18.839925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:18.841127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:18.841127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:18.841127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:18.841127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:18.841127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:18.841127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:18.841127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:18.841127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:18.841127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:18.841127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:18.841127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:18.841127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:18.841127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:18.841127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:18.841127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:18.841127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:18.841127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:18.842126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:18.842126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:18.842126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:18.842126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 300/593] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:18.842485 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b565f-768d-4549-b79c-03b86a74ecd8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:18.871146 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664abcd6-e8e2-4ca6-a79c-dd430b22bfec None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:18.905702 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43d5ba-1f46-4654-8719-67e9841ece02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:18.906459 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43d5ba-1f46-4654-8719-67e9841ece02 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:18.906906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43d5ba-1f46-4654-8719-67e9841ece02 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:18.907380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43d5ba-1f46-4654-8719-67e9841ece02 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:18.908318 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43d5ba-1f46-4654-8719-67e9841ece02 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:18.908735 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43d5ba-1f46-4654-8719-67e9841ece02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:18.910281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43d5ba-1f46-4654-8719-67e9841ece02 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:18.930700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 294/594] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Sep 27 04:07:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:18.931807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43d5ba-1f46-4654-8719-67e9841ece02 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:18.956624 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:18.974454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:18.983692 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b565f-768d-4549-b79c-03b86a74ecd8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:19.029889 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173d022-6ada-4337-a3fd-c96a265d86d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:19.031263 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173d022-6ada-4337-a3fd-c96a265d86d4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:19.031995 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173d022-6ada-4337-a3fd-c96a265d86d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:19.032453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173d022-6ada-4337-a3fd-c96a265d86d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:19.033543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173d022-6ada-4337-a3fd-c96a265d86d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:19.034412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173d022-6ada-4337-a3fd-c96a265d86d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:19.036013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173d022-6ada-4337-a3fd-c96a265d86d4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:19.050571 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43d5ba-1f46-4654-8719-67e9841ece02 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:19.054462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 301/595] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:19.055522 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173d022-6ada-4337-a3fd-c96a265d86d4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:19.105015 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82da13a-4b9d-47f2-bd20-f58ecc8c77bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:19.106273 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82da13a-4b9d-47f2-bd20-f58ecc8c77bc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:19.106917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82da13a-4b9d-47f2-bd20-f58ecc8c77bc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:19.107479 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82da13a-4b9d-47f2-bd20-f58ecc8c77bc None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:19.108315 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82da13a-4b9d-47f2-bd20-f58ecc8c77bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:19.108964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82da13a-4b9d-47f2-bd20-f58ecc8c77bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:19.111207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82da13a-4b9d-47f2-bd20-f58ecc8c77bc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:19.127085 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 295/596] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:19.128249 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82da13a-4b9d-47f2-bd20-f58ecc8c77bc None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:19.180462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173d022-6ada-4337-a3fd-c96a265d86d4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:19.228446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b80fb-4152-41b1-8c80-8cc359188514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:19.229389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b80fb-4152-41b1-8c80-8cc359188514 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:19.229854 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b80fb-4152-41b1-8c80-8cc359188514 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:19.230310 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b80fb-4152-41b1-8c80-8cc359188514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:19.236281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:19.247018 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b80fb-4152-41b1-8c80-8cc359188514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:19.248498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b80fb-4152-41b1-8c80-8cc359188514 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:19.267468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82da13a-4b9d-47f2-bd20-f58ecc8c77bc None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:19.271499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-b79b80fb-4152-41b1-8c80-8cc359188514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:19.271499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:19.271499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:19.271499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:19.271499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:19.271499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:19.271499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:19.271499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:19.271499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:19.271499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:19.271499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:19.271499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:19.271499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:19.271499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:19.271499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:19.271499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:19.272486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:19.272486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:19.272486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:19.272486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:19.272486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:19.272486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:19.272486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:19.272486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:19.272486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:19.272486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:19.272486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:19.272486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:19.272486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:19.272486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:19.272486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:19.272486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:19.272486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:19.273377 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:19.273377 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:19.273377 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:19.275982 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 302/597] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:19.277469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b80fb-4152-41b1-8c80-8cc359188514 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:19.294162 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:19.310368 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58f4c2-10d9-42c5-aa99-2163b757a33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:19.311239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58f4c2-10d9-42c5-aa99-2163b757a33a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:19.311543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58f4c2-10d9-42c5-aa99-2163b757a33a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:19.311819 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58f4c2-10d9-42c5-aa99-2163b757a33a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:19.322170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58f4c2-10d9-42c5-aa99-2163b757a33a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:19.324064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58f4c2-10d9-42c5-aa99-2163b757a33a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:19.339670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-5f58f4c2-10d9-42c5-aa99-2163b757a33a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:19.339670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:19.339670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:19.339670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:19.339670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:19.339670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:19.339670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:19.339670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:19.339670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:19.339670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:19.339670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:19.339670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:19.339670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:19.339670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:19.339670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:19.340668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:19.340668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:19.340668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:19.340668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:19.340668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:19.340668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:19.340668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:19.340668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:19.340668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:19.340668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:19.340668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:19.340668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:19.340668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:19.340668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:19.340668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:19.340668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:19.340668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:19.341594 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:19.341594 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:19.341594 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:19.341594 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:19.341594 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:19.341594 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:19.341594 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:19.341594 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:19.345847 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 296/598] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:19.346904 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58f4c2-10d9-42c5-aa99-2163b757a33a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:19.418526 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b80fb-4152-41b1-8c80-8cc359188514 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:19.467022 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e898ff3-4262-4846-a95b-d99d6749c867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:19.468455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e898ff3-4262-4846-a95b-d99d6749c867 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:19.469358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e898ff3-4262-4846-a95b-d99d6749c867 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:19.470131 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e898ff3-4262-4846-a95b-d99d6749c867 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:19.479436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e898ff3-4262-4846-a95b-d99d6749c867 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:19.481940 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e898ff3-4262-4846-a95b-d99d6749c867 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:19.493605 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58f4c2-10d9-42c5-aa99-2163b757a33a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:19.498495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-3e898ff3-4262-4846-a95b-d99d6749c867 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:19.498495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:19.498495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:19.498495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:19.498495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:19.498495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:19.498495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:19.498495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:19.498495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:19.498495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:19.498495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:19.498495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:19.498495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:19.498495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:19.498495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:19.499417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:19.499417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:19.499417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:19.499417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:19.499417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:19.499417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:19.499417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:19.499417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:19.499417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:19.499417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:19.499417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:19.499417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:19.499417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:19.499417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:19.499417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:19.499417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:19.499417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:19.500336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:19.500336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:19.500336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:19.500336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:19.500336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:19.500336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:19.500336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:19.500336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:19.503362 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 303/599] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:19.504418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e898ff3-4262-4846-a95b-d99d6749c867 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:19.535342 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d571fb0-e9c3-4b89-b9b6-079abbcd0b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:19.536204 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d571fb0-e9c3-4b89-b9b6-079abbcd0b9b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:19.536490 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d571fb0-e9c3-4b89-b9b6-079abbcd0b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:19.536764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d571fb0-e9c3-4b89-b9b6-079abbcd0b9b None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:19.538029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d571fb0-e9c3-4b89-b9b6-079abbcd0b9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:19.538350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d571fb0-e9c3-4b89-b9b6-079abbcd0b9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:19.539747 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d571fb0-e9c3-4b89-b9b6-079abbcd0b9b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:19.546838 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:19.555090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 297/600] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:19.555090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d571fb0-e9c3-4b89-b9b6-079abbcd0b9b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:19.583123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:19.620238 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e898ff3-4262-4846-a95b-d99d6749c867 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:19.655340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc6ffb-9f15-4049-acb2-20416eb3a7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:19.655941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc6ffb-9f15-4049-acb2-20416eb3a7ed None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:19.656047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d571fb0-e9c3-4b89-b9b6-079abbcd0b9b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:19.656252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc6ffb-9f15-4049-acb2-20416eb3a7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:19.656488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc6ffb-9f15-4049-acb2-20416eb3a7ed None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:19.657178 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc6ffb-9f15-4049-acb2-20416eb3a7ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:19.657507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc6ffb-9f15-4049-acb2-20416eb3a7ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:19.659285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc6ffb-9f15-4049-acb2-20416eb3a7ed None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:19.672476 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 304/601] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:19.673639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a2093-7bf1-484a-a680-88fe8b686a38 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:19.673921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a2093-7bf1-484a-a680-88fe8b686a38 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:19.674193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a2093-7bf1-484a-a680-88fe8b686a38 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:19.677382 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 305/602] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:19.678731 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a2093-7bf1-484a-a680-88fe8b686a38 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:19.703178 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2230b0-c78a-4554-a989-dc3bc7f2a334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:19.703787 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2230b0-c78a-4554-a989-dc3bc7f2a334 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:19.704077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2230b0-c78a-4554-a989-dc3bc7f2a334 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:19.704355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2230b0-c78a-4554-a989-dc3bc7f2a334 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:19.705054 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2230b0-c78a-4554-a989-dc3bc7f2a334 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:19.705363 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2230b0-c78a-4554-a989-dc3bc7f2a334 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:19.706817 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2230b0-c78a-4554-a989-dc3bc7f2a334 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:19.723724 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 298/603] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:19.723724 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2230b0-c78a-4554-a989-dc3bc7f2a334 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:19.785631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:19.791861 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a2093-7bf1-484a-a680-88fe8b686a38 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:19.822219 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:19.828736 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fc16b-3c39-4747-a3c3-18eb7ba5c7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:19.829361 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fc16b-3c39-4747-a3c3-18eb7ba5c7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:19.829641 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fc16b-3c39-4747-a3c3-18eb7ba5c7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:19.830159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fc16b-3c39-4747-a3c3-18eb7ba5c7b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:19.832977 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2230b0-c78a-4554-a989-dc3bc7f2a334 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:19.836764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fc16b-3c39-4747-a3c3-18eb7ba5c7b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:19.838226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fc16b-3c39-4747-a3c3-18eb7ba5c7b5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:19.849120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-669fc16b-3c39-4747-a3c3-18eb7ba5c7b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:19.849120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:19.849120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:19.849120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:19.849120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:19.849120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:19.849120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:19.849120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:19.849120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:19.849120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:19.849120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:19.849120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:19.849120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:19.849120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:19.849120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:19.850085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:19.850085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:19.850085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:19.850085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:19.850085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:19.850085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:19.850085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:19.850085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:19.850085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:19.850085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:19.850085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:19.850085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:19.850085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:19.850085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:19.850085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:19.850085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:19.850085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:19.851032 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:19.851032 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:19.851032 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:19.851032 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:19.851032 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:19.851032 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:19.851032 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:19.851032 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:19.851032 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 306/604] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:19.851523 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157650c-f48a-4424-ab01-29f5e43d5067 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:19.851593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157650c-f48a-4424-ab01-29f5e43d5067 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:19.852371 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157650c-f48a-4424-ab01-29f5e43d5067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:19.870627 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8157650c-f48a-4424-ab01-29f5e43d5067 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:19.871832 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8157650c-f48a-4424-ab01-29f5e43d5067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:19.872855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002b9dc-0836-45df-be8d-7a5982093cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:19.873502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002b9dc-0836-45df-be8d-7a5982093cb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:19.873788 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002b9dc-0836-45df-be8d-7a5982093cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:19.874058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002b9dc-0836-45df-be8d-7a5982093cb2 None admin] PATH_INFO: `/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/405499a1b5dc4fb6ac7af73910c3d992/roles/e62613bfe0e143abbc25d60ea42a4416` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:19.889010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002b9dc-0836-45df-be8d-7a5982093cb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=37e7a8d1446d4cdea0ba00124411cd93, user_id=405499a1b5dc4fb6ac7af73910c3d992, role_id=e62613bfe0e143abbc25d60ea42a4416)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:19.890454 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002b9dc-0836-45df-be8d-7a5982093cb2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:19.903568 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 299/605] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:07:19 2022] PUT /identity/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/405499a1b5dc4fb6ac7af73910c3d992/roles/e62613bfe0e143abbc25d60ea42a4416 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:07:19.904572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002b9dc-0836-45df-be8d-7a5982093cb2 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:19.967498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 307/606] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:19.968912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157650c-f48a-4424-ab01-29f5e43d5067 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:20.092808 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157650c-f48a-4424-ab01-29f5e43d5067 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:20.113524 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002b9dc-0836-45df-be8d-7a5982093cb2 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:20.117983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:20.132827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:20.135028 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51911983-759c-4996-95a2-6856e31e2925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:20.136114 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51911983-759c-4996-95a2-6856e31e2925 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:20.136495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51911983-759c-4996-95a2-6856e31e2925 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:20.136906 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51911983-759c-4996-95a2-6856e31e2925 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:20.137710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51911983-759c-4996-95a2-6856e31e2925 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:20.138148 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51911983-759c-4996-95a2-6856e31e2925 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:20.139774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51911983-759c-4996-95a2-6856e31e2925 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:20.154043 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 308/607] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:20.161217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51911983-759c-4996-95a2-6856e31e2925 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:20.163496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547df402-51a0-4ef1-87c1-5bae8948eb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:20.164212 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547df402-51a0-4ef1-87c1-5bae8948eb14 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:20.164492 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547df402-51a0-4ef1-87c1-5bae8948eb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:20.165179 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547df402-51a0-4ef1-87c1-5bae8948eb14 None admin] PATH_INFO: `/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/e94f9a63cb4847c6916a84735d00b48f/roles/e62613bfe0e143abbc25d60ea42a4416` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:20.186105 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547df402-51a0-4ef1-87c1-5bae8948eb14 None admin] RBAC: Authorizing `identity:create_grant(project_id=37e7a8d1446d4cdea0ba00124411cd93, user_id=e94f9a63cb4847c6916a84735d00b48f, role_id=e62613bfe0e143abbc25d60ea42a4416)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:20.187916 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547df402-51a0-4ef1-87c1-5bae8948eb14 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:20.208268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 300/608] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:07:19 2022] PUT /identity/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/e94f9a63cb4847c6916a84735d00b48f/roles/e62613bfe0e143abbc25d60ea42a4416 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:07:20.270965 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547df402-51a0-4ef1-87c1-5bae8948eb14 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:20.318162 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51911983-759c-4996-95a2-6856e31e2925 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:20.415463 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77036d9-0ece-471c-b768-1e7559c74f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:20.416163 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77036d9-0ece-471c-b768-1e7559c74f8a None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:20.416444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77036d9-0ece-471c-b768-1e7559c74f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:20.416725 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77036d9-0ece-471c-b768-1e7559c74f8a None admin] PATH_INFO: `/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/de5ccc88318a4b96969facf8df7bd504/roles/e62613bfe0e143abbc25d60ea42a4416` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:20.433319 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547df402-51a0-4ef1-87c1-5bae8948eb14 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:20.436553 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77036d9-0ece-471c-b768-1e7559c74f8a None admin] RBAC: Authorizing `identity:create_grant(project_id=37e7a8d1446d4cdea0ba00124411cd93, user_id=de5ccc88318a4b96969facf8df7bd504, role_id=e62613bfe0e143abbc25d60ea42a4416)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:20.438224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77036d9-0ece-471c-b768-1e7559c74f8a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:20.456079 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 309/609] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:07:20 2022] PUT /identity/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/de5ccc88318a4b96969facf8df7bd504/roles/e62613bfe0e143abbc25d60ea42a4416 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:07:20.477857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834d005-caee-4541-9c59-e9e82e9dec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:20.478886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834d005-caee-4541-9c59-e9e82e9dec97 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:20.479171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834d005-caee-4541-9c59-e9e82e9dec97 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:20.479447 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834d005-caee-4541-9c59-e9e82e9dec97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:20.492392 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834d005-caee-4541-9c59-e9e82e9dec97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:20.497712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-a834d005-caee-4541-9c59-e9e82e9dec97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:20.497712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:20.497712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:20.497712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:20.497712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:20.497712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:20.497712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:20.497712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:20.497712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:20.497712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:20.497712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:20.497712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:20.497712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:20.497712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:20.497712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:20.497712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:20.498703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:20.498703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:20.498703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:20.498703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:20.498703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:20.498703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:20.498703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:20.498703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:20.498703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:20.498703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:20.498703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:20.498703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:20.498703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:20.498703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:20.498703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:20.498703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:20.499644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:20.499644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:20.499644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:20.499644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:20.499644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:20.499644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:20.499644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:20.499644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:20.499644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:20.499644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:20.499644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:20.499644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:20.499644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 301/610] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:07:20.505378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77036d9-0ece-471c-b768-1e7559c74f8a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:20.541992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:20.620264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77036d9-0ece-471c-b768-1e7559c74f8a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:20.673092 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de48b1c-b452-4398-ae83-fdb18a30a7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:20.673706 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de48b1c-b452-4398-ae83-fdb18a30a7eb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:20.673997 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de48b1c-b452-4398-ae83-fdb18a30a7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:20.674270 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de48b1c-b452-4398-ae83-fdb18a30a7eb None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:20.674973 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de48b1c-b452-4398-ae83-fdb18a30a7eb None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:20.675280 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de48b1c-b452-4398-ae83-fdb18a30a7eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:20.676655 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de48b1c-b452-4398-ae83-fdb18a30a7eb None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:20.690434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 310/611] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:07:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:20.696172 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834d005-caee-4541-9c59-e9e82e9dec97 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:20.717979 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:20.812986 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834d005-caee-4541-9c59-e9e82e9dec97 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:20.849251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af6aa1-b6e5-4c7c-8308-a1e09232eb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:20.850485 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af6aa1-b6e5-4c7c-8308-a1e09232eb87 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:20.850797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af6aa1-b6e5-4c7c-8308-a1e09232eb87 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:20.851077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af6aa1-b6e5-4c7c-8308-a1e09232eb87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:20.862250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af6aa1-b6e5-4c7c-8308-a1e09232eb87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:20.863864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af6aa1-b6e5-4c7c-8308-a1e09232eb87 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:20.880038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-70af6aa1-b6e5-4c7c-8308-a1e09232eb87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:20.880038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:20.880038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:20.880038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:20.880038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:20.880038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:20.880038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:20.880038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:20.880038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:20.880038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:20.880038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:20.880038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:20.880038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:20.880038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:20.880038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:20.880038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:20.881029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:20.881029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:20.881029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:20.881029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:20.881029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:20.881029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:20.881029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:20.881029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:20.881029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:20.881029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:20.881029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:20.881029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:20.881029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:20.881029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:20.881029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:20.881029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:20.881029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:20.881920 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:20.881920 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:20.881920 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:20.881920 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 302/612] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:20.887176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de48b1c-b452-4398-ae83-fdb18a30a7eb None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:20.894047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5aeb89-6731-4559-b501-fbfd6b0beed4 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:20.894047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5aeb89-6731-4559-b501-fbfd6b0beed4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:20.894047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5aeb89-6731-4559-b501-fbfd6b0beed4 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:20.894683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 303/613] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:20.900095 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0cf4-08fd-4ac2-9d29-bf9fe374f1f3 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:20.900381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0cf4-08fd-4ac2-9d29-bf9fe374f1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:20.900658 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0cf4-08fd-4ac2-9d29-bf9fe374f1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:20.920157 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-fbef0cf4-08fd-4ac2-9d29-bf9fe374f1f3 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:20.921365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fbef0cf4-08fd-4ac2-9d29-bf9fe374f1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:20.995883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:21.006349 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de48b1c-b452-4398-ae83-fdb18a30a7eb None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:21.028895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:21.035505 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 304/614] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:07:21.055145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5623be2-8f82-4a95-b22d-0299e5be95d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:21.055765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5623be2-8f82-4a95-b22d-0299e5be95d8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:21.056049 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5623be2-8f82-4a95-b22d-0299e5be95d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:21.056327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5623be2-8f82-4a95-b22d-0299e5be95d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:21.057059 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5623be2-8f82-4a95-b22d-0299e5be95d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:21.057353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5623be2-8f82-4a95-b22d-0299e5be95d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:21.058816 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5623be2-8f82-4a95-b22d-0299e5be95d8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:21.071680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 311/615] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:21.079798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0cf4-08fd-4ac2-9d29-bf9fe374f1f3 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:21.215631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0cf4-08fd-4ac2-9d29-bf9fe374f1f3 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:21.258760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a346d9c-8908-4a02-9e6c-7582b0b5378d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:21.259354 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a346d9c-8908-4a02-9e6c-7582b0b5378d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:21.259640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a346d9c-8908-4a02-9e6c-7582b0b5378d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:21.259918 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a346d9c-8908-4a02-9e6c-7582b0b5378d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:21.267764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a346d9c-8908-4a02-9e6c-7582b0b5378d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:21.269217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a346d9c-8908-4a02-9e6c-7582b0b5378d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:21.281400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-0a346d9c-8908-4a02-9e6c-7582b0b5378d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 04:07:21.281400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:21.281400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:21.281400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:21.281400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:21.281400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:21.281400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:21.281400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:21.281400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:21.281400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:21.281400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:21.281400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:21.281400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:21.281400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:21.281400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:21.281400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:21.282366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:21.282366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:21.282366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:21.282366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:21.282366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:21.282366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:21.282366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:21.282366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:21.282366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:21.282366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:21.282366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:21.282366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:21.282366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:21.282366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:21.282366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:21.282366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:21.282366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:21.282366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:21.283380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:21.283380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:21.283380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:21.283380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:21.283380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:21.283380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:21.283380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:21.283380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:21.283380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 27 04:07:21.283380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:21.283380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 305/616] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:07:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:21.291977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5623be2-8f82-4a95-b22d-0299e5be95d8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:21.352764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a346d9c-8908-4a02-9e6c-7582b0b5378d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:21.456731 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:21.505539 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5623be2-8f82-4a95-b22d-0299e5be95d8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:21.508315 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a346d9c-8908-4a02-9e6c-7582b0b5378d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:21.571773 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2765907-bb39-4f3d-8e81-5d3d11107028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:21.572554 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2765907-bb39-4f3d-8e81-5d3d11107028 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:21.573290 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2765907-bb39-4f3d-8e81-5d3d11107028 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:21.573568 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2765907-bb39-4f3d-8e81-5d3d11107028 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:21.574315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2765907-bb39-4f3d-8e81-5d3d11107028 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:21.574627 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2765907-bb39-4f3d-8e81-5d3d11107028 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:21.576427 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2765907-bb39-4f3d-8e81-5d3d11107028 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:21.579089 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc62fd-9bed-4825-a93c-e5f9f3505fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:21.579720 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc62fd-9bed-4825-a93c-e5f9f3505fde None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:21.579999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc62fd-9bed-4825-a93c-e5f9f3505fde None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:21.580271 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc62fd-9bed-4825-a93c-e5f9f3505fde None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:21.597474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc62fd-9bed-4825-a93c-e5f9f3505fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:21.603898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-d2cc62fd-9bed-4825-a93c-e5f9f3505fde None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:21.603898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:21.603898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:21.603898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:21.603898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:21.603898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:21.603898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:21.603898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:21.603898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:21.603898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:21.603898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:21.603898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:21.603898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:21.603898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:21.603898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:21.603898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:21.604832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:21.604832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:21.604832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:21.604832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:21.604832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:21.604832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:21.604832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:21.604832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:21.604832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:21.604832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:21.604832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:21.604832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:21.604832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:21.604832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:21.604832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:21.604832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:21.605674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:21.605674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:21.605674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:21.605674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:21.605674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:21.605674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:21.605674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:21.605674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:21.605674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:21.605674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:21.605674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:21.605674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:21.606319 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 306/617] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:07:21.617514 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc62fd-9bed-4825-a93c-e5f9f3505fde None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:21.619294 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 312/618] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Sep 27 04:07:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:21.627720 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2765907-bb39-4f3d-8e81-5d3d11107028 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:21.663317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:21.802093 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc62fd-9bed-4825-a93c-e5f9f3505fde None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:21.824150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2765907-bb39-4f3d-8e81-5d3d11107028 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:21.836277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:21.861277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ff3b6-5b5f-4f82-b713-f3102fe70d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:21.862211 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ff3b6-5b5f-4f82-b713-f3102fe70d52 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:21.862702 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ff3b6-5b5f-4f82-b713-f3102fe70d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:21.863552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ff3b6-5b5f-4f82-b713-f3102fe70d52 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:21.868640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ff3b6-5b5f-4f82-b713-f3102fe70d52 None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:21.869411 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ff3b6-5b5f-4f82-b713-f3102fe70d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:21.871547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ff3b6-5b5f-4f82-b713-f3102fe70d52 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:21.882657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 307/619] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:07:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:21.888096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ff3b6-5b5f-4f82-b713-f3102fe70d52 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:21.915996 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b664f3-4da9-420a-a301-a27a303c7757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:21.916711 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b664f3-4da9-420a-a301-a27a303c7757 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:21.916951 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b664f3-4da9-420a-a301-a27a303c7757 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:21.917191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b664f3-4da9-420a-a301-a27a303c7757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:21.938553 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b664f3-4da9-420a-a301-a27a303c7757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:21.940416 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b664f3-4da9-420a-a301-a27a303c7757 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:21.971569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-31b664f3-4da9-420a-a301-a27a303c7757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:21.971569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:21.971569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:21.971569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:21.971569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:21.971569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:21.971569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:21.971569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:21.971569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:21.971569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:21.971569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:21.971569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:21.971569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:21.971569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:21.971569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:21.971569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:21.972628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:21.972628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:21.972628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:21.972628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:21.972628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:21.972628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:21.972628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:21.972628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:21.972628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:21.972628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:21.972628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:21.972628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:21.972628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:21.972628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:21.972628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:21.972628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:21.972628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:21.973566 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:21.973566 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:21.973566 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:21.977484 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 313/620] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:07:21.984334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b664f3-4da9-420a-a301-a27a303c7757 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:22.023420 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ff3b6-5b5f-4f82-b713-f3102fe70d52 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:22.058291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:22.068816 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475136b1-8bbc-4edf-982d-6eebe7435569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:22.069455 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475136b1-8bbc-4edf-982d-6eebe7435569 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:22.069739 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475136b1-8bbc-4edf-982d-6eebe7435569 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:22.070014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475136b1-8bbc-4edf-982d-6eebe7435569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:22.095743 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475136b1-8bbc-4edf-982d-6eebe7435569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:22.097130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475136b1-8bbc-4edf-982d-6eebe7435569 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:22.108665 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b664f3-4da9-420a-a301-a27a303c7757 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:22.128135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-475136b1-8bbc-4edf-982d-6eebe7435569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:22.128135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:22.128135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:22.128135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:22.128135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:22.128135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:22.128135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:22.128135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:22.128135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:22.128135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:22.128135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:22.128135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:22.128135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:22.128135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:22.128135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:22.128135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:22.129185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:22.129185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:22.129185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:22.129185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:22.129185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:22.129185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:22.129185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:22.129185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:22.129185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:22.129185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:22.129185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:22.129185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:22.129185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:22.129185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:22.129185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:22.129185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:22.129185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:22.130079 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:22.130079 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:22.130079 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:22.130079 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 308/621] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:07:22.135810 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475136b1-8bbc-4edf-982d-6eebe7435569 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:22.158206 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedc99a-3d27-4b3d-9b39-5ca8a27fa308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:22.158862 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedc99a-3d27-4b3d-9b39-5ca8a27fa308 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:22.159150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedc99a-3d27-4b3d-9b39-5ca8a27fa308 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:22.159426 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedc99a-3d27-4b3d-9b39-5ca8a27fa308 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:22.160264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedc99a-3d27-4b3d-9b39-5ca8a27fa308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:22.160577 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedc99a-3d27-4b3d-9b39-5ca8a27fa308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:22.161954 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedc99a-3d27-4b3d-9b39-5ca8a27fa308 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:22.184730 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 314/622] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:22.193234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedc99a-3d27-4b3d-9b39-5ca8a27fa308 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:22.204566 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:22.301136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475136b1-8bbc-4edf-982d-6eebe7435569 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:22.340468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d6af7-1988-47ca-b846-c8da576ed330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:22.341075 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d6af7-1988-47ca-b846-c8da576ed330 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:22.341353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d6af7-1988-47ca-b846-c8da576ed330 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:22.341625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d6af7-1988-47ca-b846-c8da576ed330 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:22.342270 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d6af7-1988-47ca-b846-c8da576ed330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:22.342574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d6af7-1988-47ca-b846-c8da576ed330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:22.343977 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d6af7-1988-47ca-b846-c8da576ed330 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:22.363267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedc99a-3d27-4b3d-9b39-5ca8a27fa308 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:22.373872 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 309/623] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:22.383754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d6af7-1988-47ca-b846-c8da576ed330 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:22.411084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:22.442579 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62cb92-b21f-4296-b0a8-3f58bf8818e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:22.443341 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62cb92-b21f-4296-b0a8-3f58bf8818e1 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:22.444149 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62cb92-b21f-4296-b0a8-3f58bf8818e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:22.444423 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62cb92-b21f-4296-b0a8-3f58bf8818e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:22.467334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62cb92-b21f-4296-b0a8-3f58bf8818e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:22.468973 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62cb92-b21f-4296-b0a8-3f58bf8818e1 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:22.489280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:22.494441 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d6af7-1988-47ca-b846-c8da576ed330 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:22.495811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-6a62cb92-b21f-4296-b0a8-3f58bf8818e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:22.495811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:22.495811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:22.495811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:22.495811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:22.495811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:22.495811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:22.495811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:22.495811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:22.495811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:22.495811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:22.495811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:22.495811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:22.495811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:22.495811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:22.496695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:22.496695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:22.496695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:22.496695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:22.496695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:22.496695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:22.496695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:22.496695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:22.496695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:22.496695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:22.496695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:22.496695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:22.496695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:22.496695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:22.496695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:22.496695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:22.496695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:22.497650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:22.497650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:22.497650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:22.497650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:22.497650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:22.497650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:22.497650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:22.497650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:22.507103 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 315/624] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:22.508092 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62cb92-b21f-4296-b0a8-3f58bf8818e1 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:22.533955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a58f4-80be-4e1b-82b7-1dccbedfb228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:22.534587 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a58f4-80be-4e1b-82b7-1dccbedfb228 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:22.534898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a58f4-80be-4e1b-82b7-1dccbedfb228 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:22.535170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a58f4-80be-4e1b-82b7-1dccbedfb228 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:22.544440 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a58f4-80be-4e1b-82b7-1dccbedfb228 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:22.546019 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a58f4-80be-4e1b-82b7-1dccbedfb228 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:22.558387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-5a3a58f4-80be-4e1b-82b7-1dccbedfb228 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:07:22.558387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:22.558387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:22.558387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:22.558387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:22.558387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:22.558387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:22.558387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:22.558387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:22.558387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:22.558387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:22.558387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:22.558387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:22.558387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:22.558387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:22.558387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:22.559458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:22.559458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:22.559458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:22.559458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:22.559458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:22.559458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:22.559458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:22.559458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:22.559458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:22.559458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:22.559458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:22.559458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:22.559458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:22.559458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:22.559458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:22.559458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:22.559458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:22.559458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:22.560391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:22.560391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:22.560391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:22.560391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:22.560391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:22.560391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:22.560391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:22.560391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:22.560391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:07:22.560391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:22.560391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 310/625] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 27 04:07:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:22.565339 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a58f4-80be-4e1b-82b7-1dccbedfb228 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:22.669256 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a58f4-80be-4e1b-82b7-1dccbedfb228 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:22.680105 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62cb92-b21f-4296-b0a8-3f58bf8818e1 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:22.703760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce400d-3922-433f-9cfe-2a35330600ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:22.704369 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce400d-3922-433f-9cfe-2a35330600ab None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:22.704651 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce400d-3922-433f-9cfe-2a35330600ab None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:22.704929 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce400d-3922-433f-9cfe-2a35330600ab None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:22.705937 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce400d-3922-433f-9cfe-2a35330600ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:22.706223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce400d-3922-433f-9cfe-2a35330600ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:22.707937 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce400d-3922-433f-9cfe-2a35330600ab None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:22.719534 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8262a58-54e0-4417-923e-86d7f8427273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:22.720455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8262a58-54e0-4417-923e-86d7f8427273 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:22.720943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8262a58-54e0-4417-923e-86d7f8427273 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:22.721420 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8262a58-54e0-4417-923e-86d7f8427273 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:22.722313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8262a58-54e0-4417-923e-86d7f8427273 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:22.722979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8262a58-54e0-4417-923e-86d7f8427273 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:22.724627 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8262a58-54e0-4417-923e-86d7f8427273 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:22.730823 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 311/626] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 27 04:07:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:22.732192 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c185a-3db6-4356-9797-ee31d86802a0 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:22.732486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c185a-3db6-4356-9797-ee31d86802a0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:22.732764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c185a-3db6-4356-9797-ee31d86802a0 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:22.736112 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 312/627] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:22.738907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c185a-3db6-4356-9797-ee31d86802a0 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:22.744494 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 316/628] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:22.745810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749460f0-b7b1-479e-a797-28f3975c1a21 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:22.746115 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749460f0-b7b1-479e-a797-28f3975c1a21 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:22.746365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749460f0-b7b1-479e-a797-28f3975c1a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:22.756818 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:22.769065 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-749460f0-b7b1-479e-a797-28f3975c1a21 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:22.770436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-749460f0-b7b1-479e-a797-28f3975c1a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:22.813446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:22.866488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 317/629] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:22.866488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749460f0-b7b1-479e-a797-28f3975c1a21 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:22.912445 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c185a-3db6-4356-9797-ee31d86802a0 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:22.973025 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857ef2b-7fb5-4f68-afc6-b8dce7492fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:22.973553 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857ef2b-7fb5-4f68-afc6-b8dce7492fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:22.973896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857ef2b-7fb5-4f68-afc6-b8dce7492fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:22.974174 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857ef2b-7fb5-4f68-afc6-b8dce7492fe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:22.974870 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749460f0-b7b1-479e-a797-28f3975c1a21 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:23.023453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dd6fe-e9cb-4430-80e2-467bb36d422b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:23.024180 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dd6fe-e9cb-4430-80e2-467bb36d422b None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:23.024501 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dd6fe-e9cb-4430-80e2-467bb36d422b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:23.025780 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dd6fe-e9cb-4430-80e2-467bb36d422b None admin] PATH_INFO: `/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/c295a3063c3b45be96b406f586180142/roles/e62613bfe0e143abbc25d60ea42a4416` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:23.045705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410dd6fe-e9cb-4430-80e2-467bb36d422b None admin] RBAC: Authorizing `identity:create_grant(project_id=37e7a8d1446d4cdea0ba00124411cd93, user_id=c295a3063c3b45be96b406f586180142, role_id=e62613bfe0e143abbc25d60ea42a4416)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:23.047968 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410dd6fe-e9cb-4430-80e2-467bb36d422b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:23.062875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857ef2b-7fb5-4f68-afc6-b8dce7492fe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:23.064341 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857ef2b-7fb5-4f68-afc6-b8dce7492fe3 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:23.070544 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 318/630] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:07:22 2022] PUT /identity/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/c295a3063c3b45be96b406f586180142/roles/e62613bfe0e143abbc25d60ea42a4416 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:07:23.071837 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783340ee-e6be-4d14-93fb-ea8d5c91dd98 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:23.072120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783340ee-e6be-4d14-93fb-ea8d5c91dd98 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:23.072394 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783340ee-e6be-4d14-93fb-ea8d5c91dd98 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:23.074794 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 319/631] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:23.080311 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34fa2a-4d97-44a0-a456-570032b4842e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:23.080612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34fa2a-4d97-44a0-a456-570032b4842e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:23.080917 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34fa2a-4d97-44a0-a456-570032b4842e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:23.091288 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:23.112081 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-2d34fa2a-4d97-44a0-a456-570032b4842e None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:23.113339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2d34fa2a-4d97-44a0-a456-570032b4842e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:23.153332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:23.227370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 320/632] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:07:23.228831 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34fa2a-4d97-44a0-a456-570032b4842e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:23.247428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 313/633] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:07:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:07:23.252950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857ef2b-7fb5-4f68-afc6-b8dce7492fe3 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:23.341752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34fa2a-4d97-44a0-a456-570032b4842e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:23.362114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857ef2b-7fb5-4f68-afc6-b8dce7492fe3 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:23.382078 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91789d7e-e144-409d-9a85-5646d08d332a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:23.382708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91789d7e-e144-409d-9a85-5646d08d332a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:23.383009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91789d7e-e144-409d-9a85-5646d08d332a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:23.383474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:23.383701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91789d7e-e144-409d-9a85-5646d08d332a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:23.402278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91789d7e-e144-409d-9a85-5646d08d332a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:23.405243 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae5fca-2246-4dbd-926b-1f3aba8ed75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:23.405895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae5fca-2246-4dbd-926b-1f3aba8ed75c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:23.406176 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae5fca-2246-4dbd-926b-1f3aba8ed75c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:23.406447 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae5fca-2246-4dbd-926b-1f3aba8ed75c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:23.411834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-91789d7e-e144-409d-9a85-5646d08d332a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:23.411834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:23.411834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:23.411834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:23.411834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:23.411834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:23.411834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:23.411834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:23.411834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:23.411834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:23.411834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:23.411834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:23.411834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:23.411834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:23.411834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:23.411834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:23.413307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:23.413307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:23.413307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:23.413307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:23.413307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:23.413307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:23.413307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:23.413307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:23.413307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:23.413307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:23.413307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:23.413307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:23.413307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:23.413307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:23.413307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:23.413307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:23.414165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:23.414165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:23.414165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:23.414165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:23.414165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:23.414165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:23.414165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:23.414165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:23.414165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:23.414165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:23.414165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:23.414165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:23.417265 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 321/634] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:23.419246 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51f2e7-0ab6-4b8d-b408-d86a1c20bc5d None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:23.419746 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51f2e7-0ab6-4b8d-b408-d86a1c20bc5d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:23.420268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51f2e7-0ab6-4b8d-b408-d86a1c20bc5d None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:23.421955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 322/635] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:23.422997 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51f2e7-0ab6-4b8d-b408-d86a1c20bc5d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:23.424318 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae5fca-2246-4dbd-926b-1f3aba8ed75c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:23.425960 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae5fca-2246-4dbd-926b-1f3aba8ed75c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:23.440384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:23.443236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-93ae5fca-2246-4dbd-926b-1f3aba8ed75c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:23.443236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:23.443236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:23.443236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:23.443236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:23.443236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:23.443236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:23.443236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:23.443236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:23.443236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:23.443236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:23.443236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:23.443236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:23.443236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:23.443236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:23.443236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:23.444640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:23.444640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:23.444640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:23.444640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:23.444640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:23.444640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:23.444640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:23.444640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:23.444640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:23.444640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:23.444640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:23.444640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:23.444640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:23.444640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:23.444640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:23.444640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:23.444640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:23.445885 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:23.445885 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:23.445885 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:23.445885 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 314/636] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:07:23.450889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a23a1-06a3-4ae3-be47-d7ef990606ff None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:23.451175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a23a1-06a3-4ae3-be47-d7ef990606ff None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:23.451453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a23a1-06a3-4ae3-be47-d7ef990606ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:23.471775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-aa6a23a1-06a3-4ae3-be47-d7ef990606ff None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:23.472956 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-aa6a23a1-06a3-4ae3-be47-d7ef990606ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:23.542167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51f2e7-0ab6-4b8d-b408-d86a1c20bc5d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:23.544902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 315/637] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:23.545734 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a23a1-06a3-4ae3-be47-d7ef990606ff None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:23.592138 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8723842-79bf-49a3-8930-591dc9a0cdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:23.593239 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8723842-79bf-49a3-8930-591dc9a0cdc3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:23.593706 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8723842-79bf-49a3-8930-591dc9a0cdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:23.594546 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8723842-79bf-49a3-8930-591dc9a0cdc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:23.595710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8723842-79bf-49a3-8930-591dc9a0cdc3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:23.596226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8723842-79bf-49a3-8930-591dc9a0cdc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:23.598234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8723842-79bf-49a3-8930-591dc9a0cdc3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:23.610258 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 323/638] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:07:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:23.611411 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8723842-79bf-49a3-8930-591dc9a0cdc3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:23.653509 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:23.664744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a23a1-06a3-4ae3-be47-d7ef990606ff None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:23.706147 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:23.709439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47978c58-768b-4df8-b8d9-1e33df3dd52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:23.710798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47978c58-768b-4df8-b8d9-1e33df3dd52a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:23.711309 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47978c58-768b-4df8-b8d9-1e33df3dd52a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:23.712099 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47978c58-768b-4df8-b8d9-1e33df3dd52a None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:23.713271 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47978c58-768b-4df8-b8d9-1e33df3dd52a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:23.713786 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47978c58-768b-4df8-b8d9-1e33df3dd52a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:23.716045 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47978c58-768b-4df8-b8d9-1e33df3dd52a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:23.732285 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 316/639] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:23.733384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47978c58-768b-4df8-b8d9-1e33df3dd52a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:23.737816 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8723842-79bf-49a3-8930-591dc9a0cdc3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:23.789182 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177848a0-1312-45ad-968f-2fd6bf6bbd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:23.790443 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177848a0-1312-45ad-968f-2fd6bf6bbd99 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:23.791087 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177848a0-1312-45ad-968f-2fd6bf6bbd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:23.791982 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177848a0-1312-45ad-968f-2fd6bf6bbd99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:23.805235 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177848a0-1312-45ad-968f-2fd6bf6bbd99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:23.812432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-177848a0-1312-45ad-968f-2fd6bf6bbd99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:23.812432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:23.812432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:23.812432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:23.812432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:23.812432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:23.812432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:23.812432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:23.812432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:23.812432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:23.812432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:23.812432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:23.812432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:23.812432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:23.812432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:23.812432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:23.813612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:23.813612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:23.813612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:23.813612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:23.813612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:23.813612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:23.813612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:23.813612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:23.813612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:23.813612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:23.813612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:23.813612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:23.813612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:23.813612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:23.813612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:23.813612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:23.814710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:23.814710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:23.814710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:23.814710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:23.814710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:23.814710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:23.814710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:23.814710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:23.814710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:23.814710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:23.814710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:23.814710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:23.818379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 324/640] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:23.820589 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177848a0-1312-45ad-968f-2fd6bf6bbd99 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:23.851927 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47978c58-768b-4df8-b8d9-1e33df3dd52a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:23.888304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4395bd7-ca16-444d-b8a3-c5c17d3495bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:23.889216 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4395bd7-ca16-444d-b8a3-c5c17d3495bb None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:23.889499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4395bd7-ca16-444d-b8a3-c5c17d3495bb None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:23.889773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4395bd7-ca16-444d-b8a3-c5c17d3495bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:23.900811 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4395bd7-ca16-444d-b8a3-c5c17d3495bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:23.902412 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4395bd7-ca16-444d-b8a3-c5c17d3495bb None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:23.918610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-e4395bd7-ca16-444d-b8a3-c5c17d3495bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:23.918610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:23.918610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:23.918610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:23.918610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:23.918610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:23.918610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:23.918610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:23.918610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:23.918610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:23.918610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:23.918610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:23.918610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:23.918610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:23.918610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:23.918610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:23.924691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:23.924691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:23.924691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:23.924691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:23.924691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:23.924691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:23.924691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:23.924691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:23.924691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:23.924691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:23.924691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:23.924691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:23.924691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:23.924691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:23.924691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:23.924691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:23.924691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:23.925601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:23.925601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:23.925601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:23.925601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 317/641] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:23.925820 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177848a0-1312-45ad-968f-2fd6bf6bbd99 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:23.925907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4395bd7-ca16-444d-b8a3-c5c17d3495bb None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:23.933479 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:23.961981 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99babda-c805-4cc0-b141-0e0896ccfbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:23.962616 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99babda-c805-4cc0-b141-0e0896ccfbf4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:23.962925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99babda-c805-4cc0-b141-0e0896ccfbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:23.963200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99babda-c805-4cc0-b141-0e0896ccfbf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:23.965015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:23.971412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99babda-c805-4cc0-b141-0e0896ccfbf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:23.972849 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99babda-c805-4cc0-b141-0e0896ccfbf4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:23.985231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-d99babda-c805-4cc0-b141-0e0896ccfbf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:23.985231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:23.985231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:23.985231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:23.985231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:23.985231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:23.985231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:23.985231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:23.985231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:23.985231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:23.985231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:23.985231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:23.985231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:23.985231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:23.985231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:23.986739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:23.986739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:23.986739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:23.986739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:23.986739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:23.986739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:23.986739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:23.986739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:23.986739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:23.986739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:23.986739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:23.986739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:23.986739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:23.986739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:23.986739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:23.986739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:23.986739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:23.987657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:23.987657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:23.987657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:23.987657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:23.987657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:23.987657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:23.987657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:23.987657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:23.987657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 325/642] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:23.987657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99babda-c805-4cc0-b141-0e0896ccfbf4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:24.036856 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4395bd7-ca16-444d-b8a3-c5c17d3495bb None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:24.073714 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604bca7-92a6-4d75-a892-8ab5e5dd900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:24.074567 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604bca7-92a6-4d75-a892-8ab5e5dd900b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:24.075033 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604bca7-92a6-4d75-a892-8ab5e5dd900b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:24.075315 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604bca7-92a6-4d75-a892-8ab5e5dd900b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:24.086842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604bca7-92a6-4d75-a892-8ab5e5dd900b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:24.092710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-d604bca7-92a6-4d75-a892-8ab5e5dd900b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:24.092710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:24.092710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:24.092710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:24.092710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:24.092710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:24.092710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:24.092710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:24.092710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:24.092710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:24.092710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:24.092710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:24.092710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:24.092710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:24.092710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:24.092710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:24.093659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:24.093659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:24.093659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:24.093659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:24.093659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:24.093659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:24.093659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:24.093659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:24.093659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:24.093659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:24.093659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:24.093659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:24.093659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:24.093659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:24.093659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:24.093659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:24.094555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:24.094555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:24.094555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:24.094555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:24.094555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:24.094555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:24.094555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:24.094555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:24.094555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:24.094555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:24.094555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:24.094555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:24.094555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 318/643] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:24.094555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604bca7-92a6-4d75-a892-8ab5e5dd900b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:24.101698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99babda-c805-4cc0-b141-0e0896ccfbf4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:24.135437 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eae76c-d46b-47c4-b3cb-86a78f829fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:24.136039 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eae76c-d46b-47c4-b3cb-86a78f829fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:24.136366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eae76c-d46b-47c4-b3cb-86a78f829fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:24.136690 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eae76c-d46b-47c4-b3cb-86a78f829fe3 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:24.137354 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eae76c-d46b-47c4-b3cb-86a78f829fe3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:24.137709 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eae76c-d46b-47c4-b3cb-86a78f829fe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:24.139092 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eae76c-d46b-47c4-b3cb-86a78f829fe3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:24.147357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 326/644] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:07:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:24.148152 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eae76c-d46b-47c4-b3cb-86a78f829fe3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:24.164622 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:24.201900 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604bca7-92a6-4d75-a892-8ab5e5dd900b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:24.212693 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:24.237354 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caef141-2e5d-4b19-90a3-a03b6386c281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:24.237963 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caef141-2e5d-4b19-90a3-a03b6386c281 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:24.238245 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caef141-2e5d-4b19-90a3-a03b6386c281 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:24.238522 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caef141-2e5d-4b19-90a3-a03b6386c281 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:24.239205 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caef141-2e5d-4b19-90a3-a03b6386c281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:24.239512 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caef141-2e5d-4b19-90a3-a03b6386c281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:24.240928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caef141-2e5d-4b19-90a3-a03b6386c281 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:24.253051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 319/645] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:24.254262 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caef141-2e5d-4b19-90a3-a03b6386c281 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:24.265424 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eae76c-d46b-47c4-b3cb-86a78f829fe3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:24.299034 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20f27b-5cf9-4cd8-85b2-f6007be98161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:24.299641 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20f27b-5cf9-4cd8-85b2-f6007be98161 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:24.299924 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20f27b-5cf9-4cd8-85b2-f6007be98161 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:24.300200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20f27b-5cf9-4cd8-85b2-f6007be98161 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:24.300893 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20f27b-5cf9-4cd8-85b2-f6007be98161 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:24.301203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20f27b-5cf9-4cd8-85b2-f6007be98161 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:24.302627 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20f27b-5cf9-4cd8-85b2-f6007be98161 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:24.318864 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 327/646] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:24.318864 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20f27b-5cf9-4cd8-85b2-f6007be98161 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:24.365160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caef141-2e5d-4b19-90a3-a03b6386c281 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:24.392590 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:24.410902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311234-b41d-45b9-92c4-bcb92544ab5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:24.411515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311234-b41d-45b9-92c4-bcb92544ab5d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:24.411796 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311234-b41d-45b9-92c4-bcb92544ab5d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:24.412093 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311234-b41d-45b9-92c4-bcb92544ab5d None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:24.413363 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a311234-b41d-45b9-92c4-bcb92544ab5d None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:24.413681 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a311234-b41d-45b9-92c4-bcb92544ab5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:24.415071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a311234-b41d-45b9-92c4-bcb92544ab5d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:24.423869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 320/647] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:07:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:24.424672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311234-b41d-45b9-92c4-bcb92544ab5d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:24.431373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20f27b-5cf9-4cd8-85b2-f6007be98161 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:24.449160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:24.470830 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04919d15-2e2d-4cb5-8322-f27e156337e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:24.471653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04919d15-2e2d-4cb5-8322-f27e156337e3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:24.472007 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04919d15-2e2d-4cb5-8322-f27e156337e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:24.472389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04919d15-2e2d-4cb5-8322-f27e156337e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:24.484866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04919d15-2e2d-4cb5-8322-f27e156337e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:24.486564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04919d15-2e2d-4cb5-8322-f27e156337e3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:24.503085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-04919d15-2e2d-4cb5-8322-f27e156337e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:24.503085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:24.503085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:24.503085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:24.503085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:24.503085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:24.503085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:24.503085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:24.503085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:24.503085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:24.503085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:24.503085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:24.503085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:24.503085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:24.503085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:24.503085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:24.504320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:24.504320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:24.504320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:24.504320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:24.504320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:24.504320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:24.504320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:24.504320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:24.504320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:24.504320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:24.504320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:24.504320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:24.504320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:24.504320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:24.504320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:24.504320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:24.504320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:24.505449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:24.505449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:24.505449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:24.511191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 328/648] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:24.511191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04919d15-2e2d-4cb5-8322-f27e156337e3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:24.537950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311234-b41d-45b9-92c4-bcb92544ab5d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:24.572948 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de51ecb-9131-47f6-963a-b152f3e7c077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:24.573575 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de51ecb-9131-47f6-963a-b152f3e7c077 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:24.573857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de51ecb-9131-47f6-963a-b152f3e7c077 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:24.574140 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de51ecb-9131-47f6-963a-b152f3e7c077 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:24.581385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de51ecb-9131-47f6-963a-b152f3e7c077 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:24.582853 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de51ecb-9131-47f6-963a-b152f3e7c077 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:24.594687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-0de51ecb-9131-47f6-963a-b152f3e7c077 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 27 04:07:24.594687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:24.594687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:24.594687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:24.594687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:24.594687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:24.594687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:24.594687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:24.594687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:24.594687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:24.594687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:24.594687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:24.594687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:24.594687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:24.594687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:24.594687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:24.600907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:24.600907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:24.600907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:24.600907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:24.600907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:24.600907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:24.600907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:24.600907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:24.600907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:24.600907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:24.600907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:24.600907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:24.600907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:24.600907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:24.600907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:24.600907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:24.600907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:24.600907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:24.602133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:24.602133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:24.602133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:24.602133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:24.602133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:24.602133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:24.602133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:24.602133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:24.602133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 27 04:07:24.602133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:24.602133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 321/649] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:07:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:24.602133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de51ecb-9131-47f6-963a-b152f3e7c077 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:24.624492 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04919d15-2e2d-4cb5-8322-f27e156337e3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:24.652380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:24.659104 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76200c07-e61e-47ed-a0fc-ec577e2aaf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:24.659948 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76200c07-e61e-47ed-a0fc-ec577e2aaf6f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:24.660302 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76200c07-e61e-47ed-a0fc-ec577e2aaf6f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:24.660954 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76200c07-e61e-47ed-a0fc-ec577e2aaf6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:24.661926 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76200c07-e61e-47ed-a0fc-ec577e2aaf6f None admin] RBAC: Adding query filter params (role.id=e62613bfe0e143abbc25d60ea42a4416, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=3960d52dee8443cf9ec8930a389a7b60) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:24.662348 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76200c07-e61e-47ed-a0fc-ec577e2aaf6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:24.663907 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76200c07-e61e-47ed-a0fc-ec577e2aaf6f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:24.669549 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 329/650] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:07:24 2022] GET /identity/v3/role_assignments?user.id=3960d52dee8443cf9ec8930a389a7b60&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=e62613bfe0e143abbc25d60ea42a4416 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:24.670334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76200c07-e61e-47ed-a0fc-ec577e2aaf6f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:24.718454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:24.729740 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de51ecb-9131-47f6-963a-b152f3e7c077 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:24.768517 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197f574-1811-422e-bccd-c04f81de842c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:24.769126 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197f574-1811-422e-bccd-c04f81de842c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:24.769420 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197f574-1811-422e-bccd-c04f81de842c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:24.769699 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197f574-1811-422e-bccd-c04f81de842c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:24.788183 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197f574-1811-422e-bccd-c04f81de842c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:24.789543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197f574-1811-422e-bccd-c04f81de842c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:24.806041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-a197f574-1811-422e-bccd-c04f81de842c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:24.806041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:24.806041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:24.806041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:24.806041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:24.806041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:24.806041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:24.806041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:24.806041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:24.806041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:24.806041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:24.806041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:24.806041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:24.806041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:24.806041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:24.806041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:24.807116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:24.807116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:24.807116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:24.807116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:24.807116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:24.807116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:24.807116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:24.807116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:24.807116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:24.807116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:24.807116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:24.807116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:24.807116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:24.807116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:24.807116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:24.807116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:24.807116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:24.808020 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:24.808020 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:24.808020 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:24.808020 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 322/651] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:24.808763 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197f574-1811-422e-bccd-c04f81de842c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:24.824182 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76200c07-e61e-47ed-a0fc-ec577e2aaf6f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:24.872933 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291f1a4-366b-45b5-96f8-40a5505668cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:24.874003 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291f1a4-366b-45b5-96f8-40a5505668cd None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:24.874880 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291f1a4-366b-45b5-96f8-40a5505668cd None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:24.875596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291f1a4-366b-45b5-96f8-40a5505668cd None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:24.876336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291f1a4-366b-45b5-96f8-40a5505668cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:24.876879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291f1a4-366b-45b5-96f8-40a5505668cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:24.878662 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291f1a4-366b-45b5-96f8-40a5505668cd None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:24.894243 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 330/652] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:24.895787 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291f1a4-366b-45b5-96f8-40a5505668cd None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:24.926915 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:24.931627 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197f574-1811-422e-bccd-c04f81de842c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:24.978591 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fe4b3-1575-43c7-aeca-680af9a3a77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:24.979903 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe4b3-1575-43c7-aeca-680af9a3a77f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:24.980357 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe4b3-1575-43c7-aeca-680af9a3a77f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:24.980947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe4b3-1575-43c7-aeca-680af9a3a77f None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:24.982291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fe4b3-1575-43c7-aeca-680af9a3a77f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:24.982887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fe4b3-1575-43c7-aeca-680af9a3a77f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:24.984577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fe4b3-1575-43c7-aeca-680af9a3a77f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:25.007525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 323/653] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Sep 27 04:07:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:25.008258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fe4b3-1575-43c7-aeca-680af9a3a77f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:25.026654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:25.036708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291f1a4-366b-45b5-96f8-40a5505668cd None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:25.080221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59520417-7c6e-404f-90e4-034cc9b8641f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:25.081239 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59520417-7c6e-404f-90e4-034cc9b8641f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:25.081805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59520417-7c6e-404f-90e4-034cc9b8641f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:25.082236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59520417-7c6e-404f-90e4-034cc9b8641f None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:25.083071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59520417-7c6e-404f-90e4-034cc9b8641f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:25.083527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59520417-7c6e-404f-90e4-034cc9b8641f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:25.086278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59520417-7c6e-404f-90e4-034cc9b8641f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:25.101182 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 331/654] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:25.102312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59520417-7c6e-404f-90e4-034cc9b8641f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:25.129095 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fe4b3-1575-43c7-aeca-680af9a3a77f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:25.165805 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e2e33-6b08-42c7-a4b3-c25c2c8ed181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:25.166603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e2e33-6b08-42c7-a4b3-c25c2c8ed181 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:25.167002 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e2e33-6b08-42c7-a4b3-c25c2c8ed181 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:25.167407 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e2e33-6b08-42c7-a4b3-c25c2c8ed181 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:25.175481 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e2e33-6b08-42c7-a4b3-c25c2c8ed181 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:25.177096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e2e33-6b08-42c7-a4b3-c25c2c8ed181 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:25.190430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-a64e2e33-6b08-42c7-a4b3-c25c2c8ed181 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 04:07:25.190430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:25.190430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:25.190430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:25.190430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:25.190430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:25.190430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:25.190430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:25.190430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:25.190430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:25.190430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:25.190430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:25.190430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:25.190430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:25.190430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:25.190430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:25.191664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:25.191664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:25.191664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:25.191664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:25.191664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:25.191664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:25.191664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:25.191664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:25.191664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:25.191664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:25.191664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:25.191664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:25.191664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:25.191664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:25.191664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:25.191664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:25.191664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:25.191664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:25.192858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:25.192858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:25.192858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:25.192858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:25.192858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:25.192858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:25.192858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:25.192858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:25.192858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 04:07:25.192858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:25.199148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 324/655] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:25.199148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e2e33-6b08-42c7-a4b3-c25c2c8ed181 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:25.223183 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:25.236244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59520417-7c6e-404f-90e4-034cc9b8641f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:25.276678 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce46ae-899e-4277-88fb-20276da6777f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:25.277569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce46ae-899e-4277-88fb-20276da6777f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:25.278106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce46ae-899e-4277-88fb-20276da6777f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:25.278529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce46ae-899e-4277-88fb-20276da6777f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:25.313777 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e2e33-6b08-42c7-a4b3-c25c2c8ed181 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:25.319364 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:25.351345 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43309d01-20ea-4978-8233-1072176f72af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:25.351971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43309d01-20ea-4978-8233-1072176f72af None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:25.352253 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43309d01-20ea-4978-8233-1072176f72af None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:25.352535 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43309d01-20ea-4978-8233-1072176f72af None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:25.360491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43309d01-20ea-4978-8233-1072176f72af None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:25.361765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce46ae-899e-4277-88fb-20276da6777f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:25.362085 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43309d01-20ea-4978-8233-1072176f72af None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:25.363249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce46ae-899e-4277-88fb-20276da6777f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:25.374502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-43309d01-20ea-4978-8233-1072176f72af None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 04:07:25.374502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:25.374502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:25.374502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:25.374502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:25.374502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:25.374502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:25.374502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:25.374502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:25.374502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:25.374502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:25.374502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:25.374502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:25.374502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:25.374502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:25.374502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:25.375688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:25.375688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:25.375688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:25.375688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:25.375688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:25.375688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:25.375688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:25.375688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:25.375688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:25.375688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:25.375688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:25.375688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:25.375688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:25.375688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:25.375688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:25.375688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:25.375688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:25.375688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:25.376990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:25.376990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:25.376990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:25.376990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:25.376990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:25.376990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:25.376990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:25.376990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:25.376990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 04:07:25.376990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:25.380249 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 325/656] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:07:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:25.380988 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43309d01-20ea-4978-8233-1072176f72af None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:25.466748 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:25.482865 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 332/657] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:07:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:07:25.484176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e6126-636e-4889-b700-a71ca4906ad4 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:25.484488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e6126-636e-4889-b700-a71ca4906ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:25.484736 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e6126-636e-4889-b700-a71ca4906ad4 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:25.486010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 333/658] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:25.486701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e6126-636e-4889-b700-a71ca4906ad4 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:25.497644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43309d01-20ea-4978-8233-1072176f72af None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:25.534091 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2d6c5-d926-4486-b670-bef37ff654aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:25.535029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2d6c5-d926-4486-b670-bef37ff654aa None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:25.535508 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2d6c5-d926-4486-b670-bef37ff654aa None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:25.535785 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2d6c5-d926-4486-b670-bef37ff654aa None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:25.536524 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2d6c5-d926-4486-b670-bef37ff654aa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:25.536831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2d6c5-d926-4486-b670-bef37ff654aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:25.538818 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2d6c5-d926-4486-b670-bef37ff654aa None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:25.549195 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:25.557210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 326/659] 10.222.0.48 () {56 vars in 1139 bytes} [Tue Sep 27 04:07:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:25.558089 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2d6c5-d926-4486-b670-bef37ff654aa None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:25.604703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e6126-636e-4889-b700-a71ca4906ad4 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:25.641754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac13b4-638a-404f-97f4-44df48ed0050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:25.642280 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac13b4-638a-404f-97f4-44df48ed0050 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:25.642565 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac13b4-638a-404f-97f4-44df48ed0050 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:25.643144 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac13b4-638a-404f-97f4-44df48ed0050 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:25.644321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac13b4-638a-404f-97f4-44df48ed0050 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:25.644639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac13b4-638a-404f-97f4-44df48ed0050 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:25.646221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac13b4-638a-404f-97f4-44df48ed0050 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:25.668164 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 334/660] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Sep 27 04:07:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:25.668347 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2d6c5-d926-4486-b670-bef37ff654aa None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:25.668444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d652b-ace5-40e1-9105-6cb0ea80ff96 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:25.668444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d652b-ace5-40e1-9105-6cb0ea80ff96 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:25.668444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d652b-ace5-40e1-9105-6cb0ea80ff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:25.683428 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ea2d652b-ace5-40e1-9105-6cb0ea80ff96 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:25.684607 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ea2d652b-ace5-40e1-9105-6cb0ea80ff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:25.703865 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f405cfe-c60c-40c0-a5a0-8dcbe4ee2728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:25.704493 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f405cfe-c60c-40c0-a5a0-8dcbe4ee2728 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:25.704776 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f405cfe-c60c-40c0-a5a0-8dcbe4ee2728 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:25.705396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f405cfe-c60c-40c0-a5a0-8dcbe4ee2728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:25.708115 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:25.719254 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f405cfe-c60c-40c0-a5a0-8dcbe4ee2728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:25.721854 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f405cfe-c60c-40c0-a5a0-8dcbe4ee2728 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:25.742090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-1f405cfe-c60c-40c0-a5a0-8dcbe4ee2728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:25.742090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:25.742090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:25.742090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:25.742090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:25.742090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:25.742090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:25.742090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:25.742090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:25.742090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:25.742090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:25.742090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:25.742090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:25.742090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:25.742090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:25.742090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:25.743150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:25.743150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:25.743150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:25.743150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:25.743150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:25.743150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:25.743150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:25.743150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:25.743150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:25.743150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:25.743150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:25.743150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:25.743150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:25.743150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:25.743150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:25.743150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:25.743150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:25.744127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:25.744127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:25.744127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:25.747798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 327/661] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:25.748668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f405cfe-c60c-40c0-a5a0-8dcbe4ee2728 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:25.760110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 335/662] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:25.760949 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d652b-ace5-40e1-9105-6cb0ea80ff96 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:25.824558 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:25.858562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f405cfe-c60c-40c0-a5a0-8dcbe4ee2728 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:25.896502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e81433-09f7-46a4-a8e0-d159ac292bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:25.897602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e81433-09f7-46a4-a8e0-d159ac292bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:25.898101 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e81433-09f7-46a4-a8e0-d159ac292bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:25.898684 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e81433-09f7-46a4-a8e0-d159ac292bf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:25.902147 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d652b-ace5-40e1-9105-6cb0ea80ff96 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:25.950683 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b183f8-0e47-4024-9caa-ce40ffbc8884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:25.951349 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b183f8-0e47-4024-9caa-ce40ffbc8884 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:25.952035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b183f8-0e47-4024-9caa-ce40ffbc8884 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:25.952325 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b183f8-0e47-4024-9caa-ce40ffbc8884 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:25.959028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:25.977853 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e81433-09f7-46a4-a8e0-d159ac292bf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:25.979751 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e81433-09f7-46a4-a8e0-d159ac292bf3 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:26.046456 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b183f8-0e47-4024-9caa-ce40ffbc8884 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:26.047946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b183f8-0e47-4024-9caa-ce40ffbc8884 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:26.084630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 328/663] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:07:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:07:26.085551 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e81433-09f7-46a4-a8e0-d159ac292bf3 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:26.096177 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:26.160488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 336/664] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:07:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:07:26.160488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b183f8-0e47-4024-9caa-ce40ffbc8884 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:26.183961 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:26.197566 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e81433-09f7-46a4-a8e0-d159ac292bf3 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:26.232975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db20586-a886-45d6-8ed1-0fca73133ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:26.233740 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db20586-a886-45d6-8ed1-0fca73133ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:26.234088 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db20586-a886-45d6-8ed1-0fca73133ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:26.234429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db20586-a886-45d6-8ed1-0fca73133ee6 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:26.235174 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db20586-a886-45d6-8ed1-0fca73133ee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:26.235650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db20586-a886-45d6-8ed1-0fca73133ee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:26.237107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db20586-a886-45d6-8ed1-0fca73133ee6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:26.249661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 329/665] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:26.250548 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db20586-a886-45d6-8ed1-0fca73133ee6 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:26.264971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b183f8-0e47-4024-9caa-ce40ffbc8884 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:26.299552 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cadd3-551b-4c0c-a0e6-7a2a88fb70cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:26.300171 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cadd3-551b-4c0c-a0e6-7a2a88fb70cb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:26.300448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cadd3-551b-4c0c-a0e6-7a2a88fb70cb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:26.300723 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cadd3-551b-4c0c-a0e6-7a2a88fb70cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:26.309247 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:26.312801 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cadd3-551b-4c0c-a0e6-7a2a88fb70cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:26.318368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-ca6cadd3-551b-4c0c-a0e6-7a2a88fb70cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:26.318368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:26.318368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:26.318368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:26.318368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:26.318368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:26.318368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:26.318368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:26.318368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:26.318368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:26.318368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:26.318368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:26.318368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:26.318368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:26.318368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:26.318368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:26.319518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:26.319518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:26.319518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:26.319518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:26.319518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:26.319518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:26.319518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:26.319518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:26.319518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:26.319518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:26.319518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:26.319518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:26.319518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:26.319518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:26.319518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:26.319518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:26.320586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:26.320586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:26.320586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:26.320586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:26.320586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:26.320586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:26.320586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:26.320586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:26.320586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:26.320586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:26.320586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:26.320586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:26.321475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 337/666] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:26.322316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cadd3-551b-4c0c-a0e6-7a2a88fb70cb None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:26.361252 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db20586-a886-45d6-8ed1-0fca73133ee6 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:26.400687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43afb28-5fc6-42de-8bc7-01f8c30df49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:26.400687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43afb28-5fc6-42de-8bc7-01f8c30df49a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:26.400687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43afb28-5fc6-42de-8bc7-01f8c30df49a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:26.401724 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43afb28-5fc6-42de-8bc7-01f8c30df49a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:26.417221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43afb28-5fc6-42de-8bc7-01f8c30df49a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:26.418667 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43afb28-5fc6-42de-8bc7-01f8c30df49a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:26.426914 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:26.434439 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cadd3-551b-4c0c-a0e6-7a2a88fb70cb None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:26.435080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-c43afb28-5fc6-42de-8bc7-01f8c30df49a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:26.435080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:26.435080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:26.435080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:26.435080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:26.435080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:26.435080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:26.435080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:26.435080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:26.435080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:26.435080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:26.435080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:26.435080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:26.435080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:26.435080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:26.435080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:26.436197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:26.436197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:26.436197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:26.436197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:26.436197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:26.436197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:26.436197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:26.436197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:26.436197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:26.436197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:26.436197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:26.436197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:26.436197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:26.436197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:26.436197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:26.436197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:26.436197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:26.437257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:26.437257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:26.437257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:26.444799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 330/667] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:26.444799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43afb28-5fc6-42de-8bc7-01f8c30df49a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:26.476402 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34283ba0-c1f3-4b33-9902-35642962af46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:26.477126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34283ba0-c1f3-4b33-9902-35642962af46 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:26.477415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34283ba0-c1f3-4b33-9902-35642962af46 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:26.477693 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34283ba0-c1f3-4b33-9902-35642962af46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:26.487956 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34283ba0-c1f3-4b33-9902-35642962af46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:26.489401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34283ba0-c1f3-4b33-9902-35642962af46 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:26.504645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-34283ba0-c1f3-4b33-9902-35642962af46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:26.504645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:26.504645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:26.504645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:26.504645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:26.504645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:26.504645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:26.504645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:26.504645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:26.504645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:26.504645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:26.504645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:26.504645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:26.504645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:26.504645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:26.504645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:26.505632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:26.505632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:26.505632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:26.505632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:26.505632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:26.505632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:26.505632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:26.505632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:26.505632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:26.505632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:26.505632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:26.505632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:26.505632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:26.505632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:26.505632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:26.505632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:26.505632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:26.507228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:26.507228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:26.507228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:26.507228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 338/668] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:26.507228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34283ba0-c1f3-4b33-9902-35642962af46 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:26.565004 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43afb28-5fc6-42de-8bc7-01f8c30df49a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:26.566278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:26.606457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597e4bf-b27d-46d8-a29a-f76c05545c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:26.607214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597e4bf-b27d-46d8-a29a-f76c05545c59 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:26.607399 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597e4bf-b27d-46d8-a29a-f76c05545c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:26.607674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597e4bf-b27d-46d8-a29a-f76c05545c59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:26.615773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597e4bf-b27d-46d8-a29a-f76c05545c59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:26.617460 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597e4bf-b27d-46d8-a29a-f76c05545c59 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:26.617579 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34283ba0-c1f3-4b33-9902-35642962af46 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:26.628887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-3597e4bf-b27d-46d8-a29a-f76c05545c59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:26.628887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:26.628887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:26.628887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:26.628887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:26.628887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:26.628887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:26.628887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:26.628887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:26.628887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:26.628887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:26.628887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:26.628887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:26.628887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:26.628887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:26.629850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:26.629850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:26.629850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:26.629850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:26.629850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:26.629850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:26.629850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:26.629850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:26.629850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:26.629850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:26.629850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:26.629850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:26.629850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:26.629850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:26.629850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:26.629850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:26.629850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:26.631837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:26.631837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:26.631837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:26.631837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:26.631837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:26.631837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:26.631837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:26.631837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:26.631837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 331/669] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:26.631837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597e4bf-b27d-46d8-a29a-f76c05545c59 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:26.660244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0ccdd-51bb-40e6-a961-6b1262d29121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:26.661183 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0ccdd-51bb-40e6-a961-6b1262d29121 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:26.661619 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0ccdd-51bb-40e6-a961-6b1262d29121 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:26.661891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0ccdd-51bb-40e6-a961-6b1262d29121 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:26.662744 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0ccdd-51bb-40e6-a961-6b1262d29121 None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:26.662949 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0ccdd-51bb-40e6-a961-6b1262d29121 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:26.664317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0ccdd-51bb-40e6-a961-6b1262d29121 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:26.672688 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 339/670] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:07:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:26.673264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0ccdd-51bb-40e6-a961-6b1262d29121 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:26.700416 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:26.745419 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597e4bf-b27d-46d8-a29a-f76c05545c59 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:26.777324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0ccdd-51bb-40e6-a961-6b1262d29121 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:26.779995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2d263-8b4e-4446-a882-f464c4ff712b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:26.780599 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2d263-8b4e-4446-a882-f464c4ff712b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:26.780878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2d263-8b4e-4446-a882-f464c4ff712b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:26.781146 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2d263-8b4e-4446-a882-f464c4ff712b None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:26.781783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2d263-8b4e-4446-a882-f464c4ff712b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:26.782086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2d263-8b4e-4446-a882-f464c4ff712b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:26.783474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2d263-8b4e-4446-a882-f464c4ff712b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:26.792105 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:26.796046 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 332/671] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:26.800928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2d263-8b4e-4446-a882-f464c4ff712b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:26.814987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f9ab4-0d18-4682-abc7-021910977b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:26.815633 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f9ab4-0d18-4682-abc7-021910977b62 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:26.815870 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f9ab4-0d18-4682-abc7-021910977b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:26.816144 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f9ab4-0d18-4682-abc7-021910977b62 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:26.816797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f9ab4-0d18-4682-abc7-021910977b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:26.817119 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f9ab4-0d18-4682-abc7-021910977b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:26.819050 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f9ab4-0d18-4682-abc7-021910977b62 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:26.831350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 340/672] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:26.832150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f9ab4-0d18-4682-abc7-021910977b62 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:26.908482 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2d263-8b4e-4446-a882-f464c4ff712b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:26.932031 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:26.947561 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97ff1c-2b4f-417e-a2b3-25b458c4bf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:26.948171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97ff1c-2b4f-417e-a2b3-25b458c4bf98 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:26.948451 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97ff1c-2b4f-417e-a2b3-25b458c4bf98 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:26.948653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f9ab4-0d18-4682-abc7-021910977b62 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:26.948756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97ff1c-2b4f-417e-a2b3-25b458c4bf98 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:26.949401 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97ff1c-2b4f-417e-a2b3-25b458c4bf98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:26.949705 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97ff1c-2b4f-417e-a2b3-25b458c4bf98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:26.951180 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97ff1c-2b4f-417e-a2b3-25b458c4bf98 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:26.968105 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 333/673] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:26.968974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97ff1c-2b4f-417e-a2b3-25b458c4bf98 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:26.985047 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279d812-fb45-43c6-9666-bcbc8a5519cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:26.985677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279d812-fb45-43c6-9666-bcbc8a5519cc None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:26.985955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279d812-fb45-43c6-9666-bcbc8a5519cc None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:26.986228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279d812-fb45-43c6-9666-bcbc8a5519cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:26.997781 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279d812-fb45-43c6-9666-bcbc8a5519cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:26.999269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279d812-fb45-43c6-9666-bcbc8a5519cc None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:27.014685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-9279d812-fb45-43c6-9666-bcbc8a5519cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:27.014685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:27.014685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:27.014685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:27.014685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:27.014685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:27.014685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:27.014685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:27.014685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:27.014685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:27.014685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:27.014685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:27.014685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:27.014685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:27.014685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:27.014685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:27.015698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:27.015698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:27.015698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:27.015698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:27.015698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:27.015698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:27.015698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:27.015698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:27.015698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:27.015698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:27.015698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:27.015698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:27.015698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:27.015698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:27.015698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:27.015698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:27.015698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:27.016602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:27.016602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:27.016602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:27.016602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 341/674] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:27.016602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279d812-fb45-43c6-9666-bcbc8a5519cc None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:27.044113 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:27.075383 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97ff1c-2b4f-417e-a2b3-25b458c4bf98 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:27.109303 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26bc29-a3f3-4984-aef0-1ec650921b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:27.109931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26bc29-a3f3-4984-aef0-1ec650921b83 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:27.110244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26bc29-a3f3-4984-aef0-1ec650921b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:27.110523 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26bc29-a3f3-4984-aef0-1ec650921b83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:27.117540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279d812-fb45-43c6-9666-bcbc8a5519cc None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:27.117991 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26bc29-a3f3-4984-aef0-1ec650921b83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:27.119194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26bc29-a3f3-4984-aef0-1ec650921b83 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:27.130226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-4d26bc29-a3f3-4984-aef0-1ec650921b83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:27.130226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:27.130226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:27.130226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:27.130226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:27.130226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:27.130226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:27.130226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:27.130226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:27.130226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:27.130226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:27.130226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:27.130226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:27.130226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:27.130226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:27.131325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:27.131325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:27.131325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:27.131325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:27.131325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:27.131325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:27.131325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:27.131325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:27.131325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:27.131325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:27.131325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:27.131325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:27.131325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:27.131325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:27.131325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:27.131325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:27.131325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:27.132381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:27.132381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:27.132381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:27.132381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:27.132381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:27.132381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:27.132381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:27.132381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:27.132381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 334/675] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:27.132381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26bc29-a3f3-4984-aef0-1ec650921b83 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:27.154982 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22987165-da1d-4cc9-8df2-a2e937dc8030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:27.155607 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22987165-da1d-4cc9-8df2-a2e937dc8030 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:27.155891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22987165-da1d-4cc9-8df2-a2e937dc8030 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:27.156191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22987165-da1d-4cc9-8df2-a2e937dc8030 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:27.163360 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22987165-da1d-4cc9-8df2-a2e937dc8030 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:27.164583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22987165-da1d-4cc9-8df2-a2e937dc8030 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:27.173031 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:27.175550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-22987165-da1d-4cc9-8df2-a2e937dc8030 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:27.175550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:27.175550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:27.175550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:27.175550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:27.175550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:27.175550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:27.175550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:27.175550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:27.175550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:27.175550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:27.175550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:27.175550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:27.175550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:27.175550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:27.176603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:27.176603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:27.176603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:27.176603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:27.176603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:27.176603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:27.176603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:27.176603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:27.176603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:27.176603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:27.176603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:27.176603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:27.176603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:27.176603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:27.176603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:27.176603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:27.176603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:27.178431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:27.178431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:27.178431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:27.178431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:27.178431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:27.178431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:27.178431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:27.178431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:27.178431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 342/676] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:27.178431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22987165-da1d-4cc9-8df2-a2e937dc8030 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:27.235842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26bc29-a3f3-4984-aef0-1ec650921b83 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:27.259919 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:27.268219 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4769c-0d94-42e4-a700-fadfd10e5f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:27.268824 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4769c-0d94-42e4-a700-fadfd10e5f65 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:27.269129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4769c-0d94-42e4-a700-fadfd10e5f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:27.269406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4769c-0d94-42e4-a700-fadfd10e5f65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:27.270145 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4769c-0d94-42e4-a700-fadfd10e5f65 None admin] RBAC: Adding query filter params (role.id=e62613bfe0e143abbc25d60ea42a4416, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=405499a1b5dc4fb6ac7af73910c3d992) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:27.270444 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4769c-0d94-42e4-a700-fadfd10e5f65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:27.272411 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4769c-0d94-42e4-a700-fadfd10e5f65 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:27.275411 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22987165-da1d-4cc9-8df2-a2e937dc8030 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:27.277956 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 335/677] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:07:27 2022] GET /identity/v3/role_assignments?user.id=405499a1b5dc4fb6ac7af73910c3d992&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=e62613bfe0e143abbc25d60ea42a4416 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:27.279123 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc521255-d379-4f23-b9e9-fc53eb18db29 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:27.279408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc521255-d379-4f23-b9e9-fc53eb18db29 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:27.279684 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc521255-d379-4f23-b9e9-fc53eb18db29 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:27.283034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 336/678] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:27.283034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc521255-d379-4f23-b9e9-fc53eb18db29 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:27.317888 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4705b6-11ac-44d6-b390-4dff3ff1a3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:27.318551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4705b6-11ac-44d6-b390-4dff3ff1a3ee None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:27.318869 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4705b6-11ac-44d6-b390-4dff3ff1a3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:27.319150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4705b6-11ac-44d6-b390-4dff3ff1a3ee None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:27.319822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4705b6-11ac-44d6-b390-4dff3ff1a3ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:27.320135 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4705b6-11ac-44d6-b390-4dff3ff1a3ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:27.321551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4705b6-11ac-44d6-b390-4dff3ff1a3ee None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:27.334815 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 343/679] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:27.335706 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4705b6-11ac-44d6-b390-4dff3ff1a3ee None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:27.410299 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc521255-d379-4f23-b9e9-fc53eb18db29 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:27.413577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:27.450932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e0d08-8867-4e20-8b42-c614d8f8ca36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:27.451643 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e0d08-8867-4e20-8b42-c614d8f8ca36 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:27.451937 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e0d08-8867-4e20-8b42-c614d8f8ca36 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:27.452210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e0d08-8867-4e20-8b42-c614d8f8ca36 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:27.452314 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4705b6-11ac-44d6-b390-4dff3ff1a3ee None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:27.452919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e0d08-8867-4e20-8b42-c614d8f8ca36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:27.453643 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e0d08-8867-4e20-8b42-c614d8f8ca36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:27.454727 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e0d08-8867-4e20-8b42-c614d8f8ca36 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:27.469854 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 337/680] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:27.471036 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81c14f-47a8-4fd9-9c0d-e8125bb73171 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:27.471316 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81c14f-47a8-4fd9-9c0d-e8125bb73171 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:27.472251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81c14f-47a8-4fd9-9c0d-e8125bb73171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:27.492282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1e81c14f-47a8-4fd9-9c0d-e8125bb73171 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:27.493818 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1e81c14f-47a8-4fd9-9c0d-e8125bb73171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:27.496054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29ae7b-8cdb-4fed-9b0f-0d4524b4b90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:27.496663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29ae7b-8cdb-4fed-9b0f-0d4524b4b90a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:27.496944 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29ae7b-8cdb-4fed-9b0f-0d4524b4b90a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:27.497220 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29ae7b-8cdb-4fed-9b0f-0d4524b4b90a None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:27.497920 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29ae7b-8cdb-4fed-9b0f-0d4524b4b90a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:27.498231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29ae7b-8cdb-4fed-9b0f-0d4524b4b90a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:27.499684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29ae7b-8cdb-4fed-9b0f-0d4524b4b90a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:27.511519 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 344/681] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:27.512347 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29ae7b-8cdb-4fed-9b0f-0d4524b4b90a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:27.525871 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:27.573651 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 338/682] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:27.574585 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81c14f-47a8-4fd9-9c0d-e8125bb73171 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:27.639751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29ae7b-8cdb-4fed-9b0f-0d4524b4b90a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:27.676010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97fd9a-60f6-4567-af70-58161a7a3c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:27.677089 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97fd9a-60f6-4567-af70-58161a7a3c11 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:27.677560 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97fd9a-60f6-4567-af70-58161a7a3c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:27.678053 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97fd9a-60f6-4567-af70-58161a7a3c11 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:27.686495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97fd9a-60f6-4567-af70-58161a7a3c11 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:27.688191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97fd9a-60f6-4567-af70-58161a7a3c11 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:27.692184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:27.699864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81c14f-47a8-4fd9-9c0d-e8125bb73171 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:27.703161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-1b97fd9a-60f6-4567-af70-58161a7a3c11 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 04:07:27.703161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:27.703161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:27.703161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:27.703161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:27.703161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:27.703161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:27.703161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:27.703161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:27.703161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:27.703161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:27.703161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:27.703161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:27.703161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:27.703161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:27.703161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:27.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:27.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:27.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:27.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:27.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:27.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:27.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:27.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:27.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:27.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:27.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:27.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:27.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:27.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:27.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:27.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:27.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:27.704070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:27.704998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:27.704998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:27.704998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:27.704998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:27.704998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:27.704998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:27.704998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:27.704998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:27.704998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 27 04:07:27.704998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:27.707178 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 345/683] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:07:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:27.708100 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97fd9a-60f6-4567-af70-58161a7a3c11 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:27.741085 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f833ee5-864c-4b39-ba82-85a2774004fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:27.741927 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f833ee5-864c-4b39-ba82-85a2774004fb None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:27.742392 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f833ee5-864c-4b39-ba82-85a2774004fb None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:27.742699 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f833ee5-864c-4b39-ba82-85a2774004fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:27.743668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f833ee5-864c-4b39-ba82-85a2774004fb None admin] RBAC: Adding query filter params (role.id=e62613bfe0e143abbc25d60ea42a4416, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=e94f9a63cb4847c6916a84735d00b48f) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:27.744068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f833ee5-864c-4b39-ba82-85a2774004fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:27.745753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f833ee5-864c-4b39-ba82-85a2774004fb None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:27.759051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 339/684] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:07:27 2022] GET /identity/v3/role_assignments?user.id=e94f9a63cb4847c6916a84735d00b48f&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=e62613bfe0e143abbc25d60ea42a4416 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:27.760374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f833ee5-864c-4b39-ba82-85a2774004fb None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:27.780418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:27.821542 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97fd9a-60f6-4567-af70-58161a7a3c11 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:27.860581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf74b3d-6eec-446f-b012-d9d88bd8cb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:27.861428 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf74b3d-6eec-446f-b012-d9d88bd8cb3b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:27.861855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf74b3d-6eec-446f-b012-d9d88bd8cb3b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:27.862273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf74b3d-6eec-446f-b012-d9d88bd8cb3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:27.863199 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf74b3d-6eec-446f-b012-d9d88bd8cb3b None admin] RBAC: Adding query filter params (role.id=e62613bfe0e143abbc25d60ea42a4416, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=de5ccc88318a4b96969facf8df7bd504) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:27.863758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf74b3d-6eec-446f-b012-d9d88bd8cb3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:27.866045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf74b3d-6eec-446f-b012-d9d88bd8cb3b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:27.873051 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 346/685] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:07:27 2022] GET /identity/v3/role_assignments?user.id=de5ccc88318a4b96969facf8df7bd504&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=e62613bfe0e143abbc25d60ea42a4416 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:27.874128 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf74b3d-6eec-446f-b012-d9d88bd8cb3b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:27.918919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f833ee5-864c-4b39-ba82-85a2774004fb None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:28.002485 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec58723-7eb1-4192-af21-7db95a916c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:28.003878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec58723-7eb1-4192-af21-7db95a916c64 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:28.004316 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec58723-7eb1-4192-af21-7db95a916c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:28.004742 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec58723-7eb1-4192-af21-7db95a916c64 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:28.006045 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec58723-7eb1-4192-af21-7db95a916c64 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:28.007131 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec58723-7eb1-4192-af21-7db95a916c64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:28.009057 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec58723-7eb1-4192-af21-7db95a916c64 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:28.043294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 340/686] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Sep 27 04:07:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:28.049348 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec58723-7eb1-4192-af21-7db95a916c64 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:28.051338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf74b3d-6eec-446f-b012-d9d88bd8cb3b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:28.083154 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:28.099183 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:28.107283 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5af64-c2a1-4520-869a-b9ed9c95a35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:28.108050 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5af64-c2a1-4520-869a-b9ed9c95a35c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:28.109061 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5af64-c2a1-4520-869a-b9ed9c95a35c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:28.109061 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5af64-c2a1-4520-869a-b9ed9c95a35c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:28.121506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5af64-c2a1-4520-869a-b9ed9c95a35c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:28.127624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-bfb5af64-c2a1-4520-869a-b9ed9c95a35c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:07:28.127624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:28.127624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:28.127624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:28.127624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:28.127624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:28.127624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:28.127624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:28.127624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:28.127624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:28.127624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:28.127624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:28.127624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:28.127624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:28.127624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:28.127624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:28.128551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:28.128551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:28.128551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:28.128551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:28.128551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:28.128551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:28.128551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:28.128551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:28.128551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:28.128551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:28.128551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:28.128551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:28.128551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:28.128551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:28.128551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:28.128551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:28.129381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:28.129381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:28.129381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:28.129381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:28.129381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:28.129381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:28.129381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:28.129381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:28.129381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:28.129381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:28.129381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:07:28.129381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:28.129381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 347/687] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:07:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:28.135042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5af64-c2a1-4520-869a-b9ed9c95a35c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:28.196006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec58723-7eb1-4192-af21-7db95a916c64 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:28.246810 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975fa5-d300-45da-937f-70350d166936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:28.248250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975fa5-d300-45da-937f-70350d166936 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:28.248813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975fa5-d300-45da-937f-70350d166936 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:28.249230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975fa5-d300-45da-937f-70350d166936 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:28.258371 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5af64-c2a1-4520-869a-b9ed9c95a35c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:28.294549 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5660d1b-9174-43d1-b44b-e563f239f086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:28.295626 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5660d1b-9174-43d1-b44b-e563f239f086 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:28.295626 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5660d1b-9174-43d1-b44b-e563f239f086 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:28.296085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5660d1b-9174-43d1-b44b-e563f239f086 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:28.296891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5660d1b-9174-43d1-b44b-e563f239f086 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:28.297310 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5660d1b-9174-43d1-b44b-e563f239f086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:28.298889 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5660d1b-9174-43d1-b44b-e563f239f086 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:28.308767 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 348/688] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:07:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:07:28.320011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5660d1b-9174-43d1-b44b-e563f239f086 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:28.329080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21975fa5-d300-45da-937f-70350d166936 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:28.330789 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21975fa5-d300-45da-937f-70350d166936 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:28.351125 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:28.440745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 341/689] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:07:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 04:07:28.447154 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975fa5-d300-45da-937f-70350d166936 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:28.517816 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:28.552380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975fa5-d300-45da-937f-70350d166936 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:28.587822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd52e4-feb0-46e0-8270-8966921196d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:28.588734 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd52e4-feb0-46e0-8270-8966921196d8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:28.589163 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd52e4-feb0-46e0-8270-8966921196d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:28.589582 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd52e4-feb0-46e0-8270-8966921196d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:28.599078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:28.601723 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd52e4-feb0-46e0-8270-8966921196d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:28.603643 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd52e4-feb0-46e0-8270-8966921196d8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:28.627428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-26fd52e4-feb0-46e0-8270-8966921196d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:28.627428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:28.627428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:28.627428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:28.627428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:28.627428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:28.627428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:28.627428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:28.627428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:28.627428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:28.627428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:28.627428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:28.627428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:28.627428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:28.627428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:28.627428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:28.628528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:28.628528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:28.628528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:28.628528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:28.628528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:28.628528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:28.628528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:28.628528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:28.628528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:28.628528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:28.628528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:28.628528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:28.628528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:28.628528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:28.628528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:28.628528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:28.628528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:28.629440 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:28.629440 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:28.629440 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:28.629990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 342/690] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:28.638370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd52e4-feb0-46e0-8270-8966921196d8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:28.645559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5660d1b-9174-43d1-b44b-e563f239f086 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:28.714868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c53f29-95de-457a-9fa7-68c57add2432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:28.715512 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c53f29-95de-457a-9fa7-68c57add2432 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:28.715797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c53f29-95de-457a-9fa7-68c57add2432 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:28.716070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c53f29-95de-457a-9fa7-68c57add2432 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:28.737461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c53f29-95de-457a-9fa7-68c57add2432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:28.738977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c53f29-95de-457a-9fa7-68c57add2432 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:28.765604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-69c53f29-95de-457a-9fa7-68c57add2432 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:28.765604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:28.765604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:28.765604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:28.765604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:28.765604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:28.765604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:28.765604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:28.765604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:28.765604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:28.765604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:28.765604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:28.765604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:28.765604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:28.765604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:28.765604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:28.766604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:28.766604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:28.766604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:28.766604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:28.766604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:28.766604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:28.766604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:28.766604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:28.766604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:28.766604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:28.766604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:28.766604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:28.766604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:28.766604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:28.766604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:28.766604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:28.766604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:28.767613 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:28.767613 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:28.767613 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:28.767613 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 349/691] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:28.772696 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c53f29-95de-457a-9fa7-68c57add2432 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:28.861877 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd52e4-feb0-46e0-8270-8966921196d8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:28.915323 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcf27e-23f7-47e8-8b65-a3afd8057d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:28.916024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcf27e-23f7-47e8-8b65-a3afd8057d6a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:28.916311 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcf27e-23f7-47e8-8b65-a3afd8057d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:28.916588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcf27e-23f7-47e8-8b65-a3afd8057d6a None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:28.917335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bcf27e-23f7-47e8-8b65-a3afd8057d6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:28.917650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bcf27e-23f7-47e8-8b65-a3afd8057d6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:28.918619 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c53f29-95de-457a-9fa7-68c57add2432 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:28.919089 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bcf27e-23f7-47e8-8b65-a3afd8057d6a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:28.921365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:28.933917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 343/692] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:28.941757 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcf27e-23f7-47e8-8b65-a3afd8057d6a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:28.969324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac8d69-d5a4-4799-8a25-ca56baabd402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:28.969936 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac8d69-d5a4-4799-8a25-ca56baabd402 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:28.970219 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac8d69-d5a4-4799-8a25-ca56baabd402 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:28.970498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac8d69-d5a4-4799-8a25-ca56baabd402 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:28.971183 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac8d69-d5a4-4799-8a25-ca56baabd402 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:28.971492 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac8d69-d5a4-4799-8a25-ca56baabd402 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:28.972873 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac8d69-d5a4-4799-8a25-ca56baabd402 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:28.985430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 350/693] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:07:28.992230 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac8d69-d5a4-4799-8a25-ca56baabd402 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:28.998744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:29.095976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac8d69-d5a4-4799-8a25-ca56baabd402 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:29.145505 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0568fe-d620-473f-8330-5a8c568039a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:29.146167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0568fe-d620-473f-8330-5a8c568039a3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:29.148474 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0568fe-d620-473f-8330-5a8c568039a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:29.148780 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0568fe-d620-473f-8330-5a8c568039a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:29.164485 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0568fe-d620-473f-8330-5a8c568039a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:29.165941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0568fe-d620-473f-8330-5a8c568039a3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:29.180923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcf27e-23f7-47e8-8b65-a3afd8057d6a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:29.187868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-9a0568fe-d620-473f-8330-5a8c568039a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:07:29.187868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:29.187868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:29.187868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:29.187868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:29.187868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:29.187868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:29.187868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:29.187868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:29.187868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:29.187868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:29.187868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:29.187868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:29.187868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:29.187868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:29.187868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:29.188855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:29.188855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:29.188855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:29.188855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:29.188855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:29.188855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:29.188855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:29.188855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:29.188855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:29.188855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:29.188855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:29.188855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:29.188855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:29.188855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:29.188855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:29.188855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:29.188855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:29.188855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:29.189801 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:29.189801 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:29.189801 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:29.189801 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:29.189801 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:29.189801 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:29.189801 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:29.189801 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:29.189801 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:07:29.189801 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:29.196637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 351/694] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 27 04:07:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:29.197594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0568fe-d620-473f-8330-5a8c568039a3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:29.252729 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:29.253545 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b808db3-f3c5-469c-bb74-fdb743683b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:29.255630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b808db3-f3c5-469c-bb74-fdb743683b7e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:29.256458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b808db3-f3c5-469c-bb74-fdb743683b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:29.256736 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b808db3-f3c5-469c-bb74-fdb743683b7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:29.276539 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b808db3-f3c5-469c-bb74-fdb743683b7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:29.278022 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b808db3-f3c5-469c-bb74-fdb743683b7e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:29.294760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-6b808db3-f3c5-469c-bb74-fdb743683b7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:29.294760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:29.294760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:29.294760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:29.294760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:29.294760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:29.294760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:29.294760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:29.294760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:29.294760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:29.294760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:29.294760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:29.294760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:29.294760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:29.294760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:29.296799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:29.296799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:29.296799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:29.296799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:29.296799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:29.296799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:29.296799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:29.296799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:29.296799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:29.296799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:29.296799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:29.296799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:29.296799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:29.296799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:29.296799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:29.296799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:29.296799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:29.298251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:29.298251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:29.298251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:29.298251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:29.298251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:29.298251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:29.298251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:29.298251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:29.309933 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 344/695] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:29.311930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b808db3-f3c5-469c-bb74-fdb743683b7e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:29.406854 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0568fe-d620-473f-8330-5a8c568039a3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:29.468628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13083ea-e37e-4485-b021-63dcc738519d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:29.469237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13083ea-e37e-4485-b021-63dcc738519d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:29.469518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13083ea-e37e-4485-b021-63dcc738519d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:29.469793 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13083ea-e37e-4485-b021-63dcc738519d None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:29.470523 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13083ea-e37e-4485-b021-63dcc738519d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:29.470859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13083ea-e37e-4485-b021-63dcc738519d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:29.471953 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:29.472284 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13083ea-e37e-4485-b021-63dcc738519d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:29.494017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b808db3-f3c5-469c-bb74-fdb743683b7e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:29.495284 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 352/696] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 27 04:07:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:29.496189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13083ea-e37e-4485-b021-63dcc738519d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:29.567433 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dea81-bbeb-4de9-9d48-4a2dd6238d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:29.568058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dea81-bbeb-4de9-9d48-4a2dd6238d19 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:29.568891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dea81-bbeb-4de9-9d48-4a2dd6238d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:29.569177 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dea81-bbeb-4de9-9d48-4a2dd6238d19 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:29.569935 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dea81-bbeb-4de9-9d48-4a2dd6238d19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:29.570247 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dea81-bbeb-4de9-9d48-4a2dd6238d19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:29.571735 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dea81-bbeb-4de9-9d48-4a2dd6238d19 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:29.580723 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:29.598589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 345/697] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:29.602588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dea81-bbeb-4de9-9d48-4a2dd6238d19 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:29.608670 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13083ea-e37e-4485-b021-63dcc738519d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:29.692074 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759c46a-a443-4a8c-887b-7e0286f651fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:29.693097 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759c46a-a443-4a8c-887b-7e0286f651fb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:29.693992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759c46a-a443-4a8c-887b-7e0286f651fb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:29.694270 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759c46a-a443-4a8c-887b-7e0286f651fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:29.730756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dea81-bbeb-4de9-9d48-4a2dd6238d19 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:29.770006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94534b67-cb6c-4563-b75f-f624f79929c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:29.771005 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94534b67-cb6c-4563-b75f-f624f79929c2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:29.772399 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94534b67-cb6c-4563-b75f-f624f79929c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:29.772890 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94534b67-cb6c-4563-b75f-f624f79929c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:29.773814 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94534b67-cb6c-4563-b75f-f624f79929c2 None admin] RBAC: Adding query filter params (role.id=e62613bfe0e143abbc25d60ea42a4416, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=c295a3063c3b45be96b406f586180142) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:29.774329 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94534b67-cb6c-4563-b75f-f624f79929c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:29.776372 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94534b67-cb6c-4563-b75f-f624f79929c2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:29.783540 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 346/698] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:07:29 2022] GET /identity/v3/role_assignments?user.id=c295a3063c3b45be96b406f586180142&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=e62613bfe0e143abbc25d60ea42a4416 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:29.811307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759c46a-a443-4a8c-887b-7e0286f651fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:29.813193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759c46a-a443-4a8c-887b-7e0286f651fb None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:29.833839 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf75c0-9186-46ff-8885-a3aa24c9cfbb None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:29.834181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf75c0-9186-46ff-8885-a3aa24c9cfbb None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:29.834405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf75c0-9186-46ff-8885-a3aa24c9cfbb None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:29.836162 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 347/699] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:07:29.842394 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9ea0f-2add-4dbf-a91e-fd9df947a449 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:29.842645 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9ea0f-2add-4dbf-a91e-fd9df947a449 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:29.842880 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9ea0f-2add-4dbf-a91e-fd9df947a449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:29.862873 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e5c9ea0f-2add-4dbf-a91e-fd9df947a449 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:29.864533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e5c9ea0f-2add-4dbf-a91e-fd9df947a449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:29.875277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:29.932755 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:29.978519 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 353/700] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:07:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:07:29.984576 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759c46a-a443-4a8c-887b-7e0286f651fb None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:30.010205 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 348/701] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:07:30.109360 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759c46a-a443-4a8c-887b-7e0286f651fb None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:30.146130 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ed9ef-d99a-4fdb-8499-0162540d2ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:30.146798 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ed9ef-d99a-4fdb-8499-0162540d2ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:30.147091 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ed9ef-d99a-4fdb-8499-0162540d2ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:30.147367 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ed9ef-d99a-4fdb-8499-0162540d2ac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:30.157972 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ed9ef-d99a-4fdb-8499-0162540d2ac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:30.159490 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ed9ef-d99a-4fdb-8499-0162540d2ac5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:30.175819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-740ed9ef-d99a-4fdb-8499-0162540d2ac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:30.175819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:30.175819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:30.175819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:30.175819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:30.175819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:30.175819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:30.175819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:30.175819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:30.175819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:30.175819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:30.175819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:30.175819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:30.175819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:30.175819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:30.175819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:30.176834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:30.176834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:30.176834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:30.176834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:30.176834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:30.176834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:30.176834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:30.176834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:30.176834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:30.176834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:30.176834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:30.176834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:30.176834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:30.176834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:30.176834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:30.176834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:30.176834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:30.178373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:30.178373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:30.178373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:30.178373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 354/702] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:30.185078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9ea0f-2add-4dbf-a91e-fd9df947a449 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:30.330114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9ea0f-2add-4dbf-a91e-fd9df947a449 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:30.366975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f7639-5c7a-451f-ada4-ee79ce863924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:30.367595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f7639-5c7a-451f-ada4-ee79ce863924 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:30.367879 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f7639-5c7a-451f-ada4-ee79ce863924 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:30.369865 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f7639-5c7a-451f-ada4-ee79ce863924 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:30.370558 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f7639-5c7a-451f-ada4-ee79ce863924 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:30.370898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f7639-5c7a-451f-ada4-ee79ce863924 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:30.372356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f7639-5c7a-451f-ada4-ee79ce863924 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:30.379019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ed9ef-d99a-4fdb-8499-0162540d2ac5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:30.386480 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 349/703] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:30.388060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf88e0-b6f7-4adb-a0e2-c790de053771 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:30.388549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf88e0-b6f7-4adb-a0e2-c790de053771 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:30.389039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf88e0-b6f7-4adb-a0e2-c790de053771 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:30.390657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 350/704] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:30.397190 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf88e0-b6f7-4adb-a0e2-c790de053771 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:30.400090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:30.437938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:30.529360 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf88e0-b6f7-4adb-a0e2-c790de053771 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:30.534469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ed9ef-d99a-4fdb-8499-0162540d2ac5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:30.571377 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f3960-2b64-457d-9025-0b9c33553e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:30.572497 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f3960-2b64-457d-9025-0b9c33553e4b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:30.573124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f3960-2b64-457d-9025-0b9c33553e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:30.573657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f3960-2b64-457d-9025-0b9c33553e4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:30.574365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21941d0-2d27-4236-a8be-58e6b50b06fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:30.575082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21941d0-2d27-4236-a8be-58e6b50b06fa None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:30.575437 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21941d0-2d27-4236-a8be-58e6b50b06fa None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:30.575793 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21941d0-2d27-4236-a8be-58e6b50b06fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:30.585574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21941d0-2d27-4236-a8be-58e6b50b06fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:30.587412 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21941d0-2d27-4236-a8be-58e6b50b06fa None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:30.587653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f3960-2b64-457d-9025-0b9c33553e4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:30.589512 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f3960-2b64-457d-9025-0b9c33553e4b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:30.602217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-c21941d0-2d27-4236-a8be-58e6b50b06fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:30.602217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:30.602217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:30.602217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:30.602217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:30.602217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:30.602217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:30.602217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:30.602217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:30.602217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:30.602217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:30.602217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:30.602217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:30.602217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:30.602217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:30.603649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:30.603649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:30.603649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:30.603649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:30.603649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:30.603649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:30.603649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:30.603649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:30.603649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:30.603649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:30.603649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:30.603649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:30.603649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:30.603649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:30.603649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:30.603649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:30.603649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:30.604744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:30.604744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:30.604744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:30.604744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:30.604744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:30.604744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:30.604744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:30.604744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:30.610056 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 351/705] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:07:30.610056 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbbe7f-e8e1-44e6-b82a-71e3490a19db None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:30.610056 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbbe7f-e8e1-44e6-b82a-71e3490a19db None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:30.610056 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbbe7f-e8e1-44e6-b82a-71e3490a19db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:30.614810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-f69f3960-2b64-457d-9025-0b9c33553e4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:30.614810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:30.614810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:30.614810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:30.614810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:30.614810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:30.614810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:30.614810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:30.614810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:30.614810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:30.614810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:30.614810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:30.614810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:30.614810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:30.614810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:30.614810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:30.615764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:30.615764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:30.615764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:30.615764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:30.615764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:30.615764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:30.615764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:30.615764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:30.615764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:30.615764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:30.615764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:30.615764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:30.615764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:30.615764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:30.615764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:30.615764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:30.615764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:30.616661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:30.616661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:30.616661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:30.618451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 355/706] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:07:30.618451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f3960-2b64-457d-9025-0b9c33553e4b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:30.627039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f8dbbe7f-e8e1-44e6-b82a-71e3490a19db None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:30.628252 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f8dbbe7f-e8e1-44e6-b82a-71e3490a19db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:30.688868 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:30.710778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 352/707] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:30.710778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e72221-9d96-4abe-bc21-18d14ab488b8 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:30.710778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e72221-9d96-4abe-bc21-18d14ab488b8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:30.710778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e72221-9d96-4abe-bc21-18d14ab488b8 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:30.710778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 353/708] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:30.710778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e72221-9d96-4abe-bc21-18d14ab488b8 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:30.717017 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:30.734433 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f3960-2b64-457d-9025-0b9c33553e4b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:30.769768 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898b59a-934f-42f8-930c-c7ee6869694f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:30.770480 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898b59a-934f-42f8-930c-c7ee6869694f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:30.770856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898b59a-934f-42f8-930c-c7ee6869694f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:30.771935 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898b59a-934f-42f8-930c-c7ee6869694f None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:30.772845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898b59a-934f-42f8-930c-c7ee6869694f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:30.773224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898b59a-934f-42f8-930c-c7ee6869694f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:30.774777 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898b59a-934f-42f8-930c-c7ee6869694f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:30.789027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 356/709] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:30.794119 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499079b-7c96-44b0-bdfd-25d7740aad7e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:30.794405 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499079b-7c96-44b0-bdfd-25d7740aad7e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:30.795770 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499079b-7c96-44b0-bdfd-25d7740aad7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:30.815915 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5499079b-7c96-44b0-bdfd-25d7740aad7e None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:30.826352 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5499079b-7c96-44b0-bdfd-25d7740aad7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:30.839084 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e72221-9d96-4abe-bc21-18d14ab488b8 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:30.889006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0477cf-82a9-4373-bf7e-751fc9f4fade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:30.889762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0477cf-82a9-4373-bf7e-751fc9f4fade None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:30.890111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0477cf-82a9-4373-bf7e-751fc9f4fade None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:30.890495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0477cf-82a9-4373-bf7e-751fc9f4fade None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:30.891698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0477cf-82a9-4373-bf7e-751fc9f4fade None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:30.892118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0477cf-82a9-4373-bf7e-751fc9f4fade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:30.893959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0477cf-82a9-4373-bf7e-751fc9f4fade None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:30.911071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 357/710] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:30.912911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 354/711] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:30.913156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499079b-7c96-44b0-bdfd-25d7740aad7e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:30.913787 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0477cf-82a9-4373-bf7e-751fc9f4fade None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:31.024585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:31.031013 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:31.053799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499079b-7c96-44b0-bdfd-25d7740aad7e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:31.083395 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0477cf-82a9-4373-bf7e-751fc9f4fade None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:31.100203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451caaf-149f-4039-9c06-5aee866a32f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:31.100781 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451caaf-149f-4039-9c06-5aee866a32f2 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:31.101061 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451caaf-149f-4039-9c06-5aee866a32f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:31.101330 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451caaf-149f-4039-9c06-5aee866a32f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:31.102186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451caaf-149f-4039-9c06-5aee866a32f2 None admin] RBAC: Adding query filter params (role.id=2613cf4a98d44744a094c7782b19b4b5, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=3960d52dee8443cf9ec8930a389a7b60) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:31.102502 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451caaf-149f-4039-9c06-5aee866a32f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:31.104356 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451caaf-149f-4039-9c06-5aee866a32f2 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:31.111433 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 358/712] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:07:30 2022] GET /identity/v3/role_assignments?user.id=3960d52dee8443cf9ec8930a389a7b60&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:31.113431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451caaf-149f-4039-9c06-5aee866a32f2 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:31.142495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7674c17-15e1-4d30-99b1-eeb7d6157e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:31.143545 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7674c17-15e1-4d30-99b1-eeb7d6157e8b None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:31.144063 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7674c17-15e1-4d30-99b1-eeb7d6157e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:31.144532 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7674c17-15e1-4d30-99b1-eeb7d6157e8b None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:31.146285 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7674c17-15e1-4d30-99b1-eeb7d6157e8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:31.148924 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7674c17-15e1-4d30-99b1-eeb7d6157e8b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:31.197055 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 355/713] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 27 04:07:30 2022] POST /identity/v3/users => generated 254 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:07:31.204089 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7674c17-15e1-4d30-99b1-eeb7d6157e8b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:31.369041 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451caaf-149f-4039-9c06-5aee866a32f2 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:31.383097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7674c17-15e1-4d30-99b1-eeb7d6157e8b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:31.394335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:31.448085 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabe107-b1c2-49d0-8bda-976b66dabaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:31.449051 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cd290-9a2c-42d2-bbaa-772d5e712f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:31.449367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabe107-b1c2-49d0-8bda-976b66dabaa7 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:31.449690 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cd290-9a2c-42d2-bbaa-772d5e712f54 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:31.450443 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cd290-9a2c-42d2-bbaa-772d5e712f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:31.450443 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cd290-9a2c-42d2-bbaa-772d5e712f54 None admin] PATH_INFO: `/v3/services/network` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:31.450863 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cd290-9a2c-42d2-bbaa-772d5e712f54 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:31.451129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabe107-b1c2-49d0-8bda-976b66dabaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:31.451603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabe107-b1c2-49d0-8bda-976b66dabaa7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:31.452232 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cd290-9a2c-42d2-bbaa-772d5e712f54 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:31.452631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabe107-b1c2-49d0-8bda-976b66dabaa7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:31.454467 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabe107-b1c2-49d0-8bda-976b66dabaa7 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:31.465010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-e06cd290-9a2c-42d2-bbaa-772d5e712f54 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 04:07:31.465010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:31.465010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:07:31.465010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:07:31.465010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:07:31.465010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:07:31.465010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:07:31.465010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:31.465010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 04:07:31.465010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:31.465010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:07:31.465010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:31.465010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:31.465010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:31.465010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:31.465010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:31.465010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:31.466190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:31.466190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:31.466190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:31.466190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:31.466190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:31.466190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:31.466190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:07:31.466190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:07:31.466190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:07:31.466190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:07:31.466190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:31.466190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:31.466190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:31.466190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:31.466190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:31.466190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:31.467185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:31.467185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:31.467185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:31.467185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:31.467185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:31.467185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:31.467185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:31.467185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:31.467185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:31.467185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:31.467185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:07:31.467185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:31.467185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 04:07:31.467185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:31.467185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 359/714] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:31 2022] GET /identity/v3/services/network => generated 88 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:31.471844 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cd290-9a2c-42d2-bbaa-772d5e712f54 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:31.472161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-2cabe107-b1c2-49d0-8bda-976b66dabaa7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 04:07:31.472161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:31.472161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:07:31.472161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:07:31.472161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:07:31.472161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:07:31.472161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:07:31.472161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:31.472161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 04:07:31.472161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:31.472161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:07:31.472161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:31.472161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:31.472161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:31.472161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:31.472161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:31.472161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:31.473165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:31.473165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:31.473165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:31.473165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:31.473165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:31.473165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:31.473165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:07:31.473165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:07:31.473165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:07:31.473165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:07:31.473165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:31.473165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:31.473165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:31.473165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:31.473165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:31.473165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:31.474034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:31.474034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:31.474034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:31.474034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:31.474034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:31.474034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:31.474034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:31.474034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:31.474034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:31.474034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:31.474034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:07:31.474034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:31.474034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 04:07:31.474034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:31.476954 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:31.477097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 356/715] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Sep 27 04:07:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:07:31.483004 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabe107-b1c2-49d0-8bda-976b66dabaa7 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:31.602684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cd290-9a2c-42d2-bbaa-772d5e712f54 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:31.640107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabe107-b1c2-49d0-8bda-976b66dabaa7 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:31.642267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79fcda-9a56-41b5-8833-65c7fd47ba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:31.643190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79fcda-9a56-41b5-8833-65c7fd47ba72 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:31.643609 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79fcda-9a56-41b5-8833-65c7fd47ba72 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:31.644026 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79fcda-9a56-41b5-8833-65c7fd47ba72 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:31.644806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79fcda-9a56-41b5-8833-65c7fd47ba72 None admin] RBAC: Adding query filter params (name=network) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:31.645268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79fcda-9a56-41b5-8833-65c7fd47ba72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:31.647564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79fcda-9a56-41b5-8833-65c7fd47ba72 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:31.654235 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 360/716] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 27 04:07:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:31.660367 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79fcda-9a56-41b5-8833-65c7fd47ba72 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:31.685728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ddb72-9624-47d7-8a44-8b614061edac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:31.686451 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ddb72-9624-47d7-8a44-8b614061edac None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:31.686841 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ddb72-9624-47d7-8a44-8b614061edac None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:31.687725 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ddb72-9624-47d7-8a44-8b614061edac None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:31.688460 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ddb72-9624-47d7-8a44-8b614061edac None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:31.688861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ddb72-9624-47d7-8a44-8b614061edac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:31.690894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ddb72-9624-47d7-8a44-8b614061edac None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:31.698390 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 357/717] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Sep 27 04:07:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:31.703638 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ddb72-9624-47d7-8a44-8b614061edac None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:31.743768 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:31.752658 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:31.781834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79fcda-9a56-41b5-8833-65c7fd47ba72 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:31.842885 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6739166-f26a-4fd6-b15d-656fe03192aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:31.844651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6739166-f26a-4fd6-b15d-656fe03192aa None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:31.847319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6739166-f26a-4fd6-b15d-656fe03192aa None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:31.848002 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6739166-f26a-4fd6-b15d-656fe03192aa None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:31.849968 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6739166-f26a-4fd6-b15d-656fe03192aa None admin] RBAC: Adding query filter params (type=network) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:31.851172 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6739166-f26a-4fd6-b15d-656fe03192aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:31.854619 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6739166-f26a-4fd6-b15d-656fe03192aa None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:31.861686 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ddb72-9624-47d7-8a44-8b614061edac None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:31.867149 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 361/718] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 27 04:07:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:07:31.921841 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93960a-a155-4f40-a794-6ac734bd1f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:31.922931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93960a-a155-4f40-a794-6ac734bd1f71 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:31.923417 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93960a-a155-4f40-a794-6ac734bd1f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:31.923889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93960a-a155-4f40-a794-6ac734bd1f71 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:31.924757 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93960a-a155-4f40-a794-6ac734bd1f71 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:31.925288 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93960a-a155-4f40-a794-6ac734bd1f71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:31.926946 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93960a-a155-4f40-a794-6ac734bd1f71 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:31.938361 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 358/719] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Sep 27 04:07:31 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:07:32.593382 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00186bb0-7df5-4b0f-8cee-1d11b0c91092 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:32.594394 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00186bb0-7df5-4b0f-8cee-1d11b0c91092 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:32.594946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00186bb0-7df5-4b0f-8cee-1d11b0c91092 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:32.596786 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 362/720] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:32.602403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a90b2-a799-4205-93ab-a0e3ae37d9e4 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:32.603271 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a90b2-a799-4205-93ab-a0e3ae37d9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:32.604034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a90b2-a799-4205-93ab-a0e3ae37d9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:32.632459 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-ea3a90b2-a799-4205-93ab-a0e3ae37d9e4 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:32.634074 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ea3a90b2-a799-4205-93ab-a0e3ae37d9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:32.705781 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 359/721] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:33.137618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00186bb0-7df5-4b0f-8cee-1d11b0c91092 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:33.300268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00186bb0-7df5-4b0f-8cee-1d11b0c91092 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:33.342777 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:33.348435 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa481c3-1e11-476d-97b1-99ebcb5488bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:33.349114 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa481c3-1e11-476d-97b1-99ebcb5488bd None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:33.350011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa481c3-1e11-476d-97b1-99ebcb5488bd None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:33.355084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa481c3-1e11-476d-97b1-99ebcb5488bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:33.367514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa481c3-1e11-476d-97b1-99ebcb5488bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:33.372286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-cfa481c3-1e11-476d-97b1-99ebcb5488bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:07:33.372286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:33.372286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:33.372286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:33.372286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:33.372286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:33.372286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:33.372286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:33.372286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:33.372286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:33.372286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:33.372286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:33.372286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:33.372286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:33.372286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:33.372286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:33.373200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:33.373200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:33.373200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:33.373200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:33.373200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:33.373200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:33.373200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:33.373200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:33.373200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:33.373200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:33.373200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:33.373200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:33.373200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:33.373200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:33.373200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:33.373200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:33.374054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:33.374054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:33.374054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:33.374054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:33.374054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:33.374054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:33.374054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:33.374054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:33.374054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:33.374054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:33.374054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:07:33.374054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:33.374054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 363/722] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:07:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:33.379429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a90b2-a799-4205-93ab-a0e3ae37d9e4 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:33.424926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:33.527528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a90b2-a799-4205-93ab-a0e3ae37d9e4 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:33.579608 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c80bc-b280-486a-8d61-fde282ebbcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:33.580253 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c80bc-b280-486a-8d61-fde282ebbcc3 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:33.580538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c80bc-b280-486a-8d61-fde282ebbcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:33.580818 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c80bc-b280-486a-8d61-fde282ebbcc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:33.581525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c80bc-b280-486a-8d61-fde282ebbcc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:33.581909 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c80bc-b280-486a-8d61-fde282ebbcc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:33.583430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c80bc-b280-486a-8d61-fde282ebbcc3 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:33.593984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 360/723] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:07:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:33.600717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa481c3-1e11-476d-97b1-99ebcb5488bd None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:33.720677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa481c3-1e11-476d-97b1-99ebcb5488bd None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:33.742278 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32d82e-772d-45e9-a015-0af226ead93e None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:33.743277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32d82e-772d-45e9-a015-0af226ead93e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:33.743756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32d82e-772d-45e9-a015-0af226ead93e None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:33.745550 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 361/724] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:33.750653 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7162bd-d5b5-4d87-9fb4-c934d1a08e99 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:33.751203 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7162bd-d5b5-4d87-9fb4-c934d1a08e99 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:33.751696 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7162bd-d5b5-4d87-9fb4-c934d1a08e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:33.761475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b31c9b-ab9b-452b-bcba-eeddc83847c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:33.762121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b31c9b-ab9b-452b-bcba-eeddc83847c3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:33.762406 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b31c9b-ab9b-452b-bcba-eeddc83847c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:33.762684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b31c9b-ab9b-452b-bcba-eeddc83847c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:33.772009 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-ae7162bd-d5b5-4d87-9fb4-c934d1a08e99 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:33.773476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ae7162bd-d5b5-4d87-9fb4-c934d1a08e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:33.777432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b31c9b-ab9b-452b-bcba-eeddc83847c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:33.778918 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b31c9b-ab9b-452b-bcba-eeddc83847c3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:33.801596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-64b31c9b-ab9b-452b-bcba-eeddc83847c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:33.801596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:33.801596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:33.801596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:33.801596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:33.801596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:33.801596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:33.801596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:33.801596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:33.801596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:33.801596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:33.801596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:33.801596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:33.801596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:33.801596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:33.801596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:33.802620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:33.802620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:33.802620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:33.802620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:33.802620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:33.802620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:33.802620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:33.802620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:33.802620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:33.802620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:33.802620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:33.802620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:33.802620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:33.802620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:33.802620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:33.802620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:33.802620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:33.803564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:33.803564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:33.803564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:33.805733 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 364/725] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:33.814891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b31c9b-ab9b-452b-bcba-eeddc83847c3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:33.883923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 362/726] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:07:33.899511 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:33.955101 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b31c9b-ab9b-452b-bcba-eeddc83847c3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:33.994249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60208c9d-a901-4fe9-8265-2d09b262295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:33.994805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60208c9d-a901-4fe9-8265-2d09b262295e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:33.995095 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60208c9d-a901-4fe9-8265-2d09b262295e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:33.995375 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60208c9d-a901-4fe9-8265-2d09b262295e None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:33.996027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60208c9d-a901-4fe9-8265-2d09b262295e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:33.996335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60208c9d-a901-4fe9-8265-2d09b262295e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:33.997717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60208c9d-a901-4fe9-8265-2d09b262295e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:34.010191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 365/727] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:34.015985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7162bd-d5b5-4d87-9fb4-c934d1a08e99 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:34.061442 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:34.167588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7162bd-d5b5-4d87-9fb4-c934d1a08e99 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:34.225282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744ad4a-2f61-4318-861c-2d8439565fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:34.225864 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60208c9d-a901-4fe9-8265-2d09b262295e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:34.225976 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744ad4a-2f61-4318-861c-2d8439565fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:34.226573 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744ad4a-2f61-4318-861c-2d8439565fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:34.226957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744ad4a-2f61-4318-861c-2d8439565fb3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:34.239525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744ad4a-2f61-4318-861c-2d8439565fb3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:34.241192 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744ad4a-2f61-4318-861c-2d8439565fb3 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:34.263060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-7744ad4a-2f61-4318-861c-2d8439565fb3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 04:07:34.263060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:34.263060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:34.263060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:34.263060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:34.263060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:34.263060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:34.263060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:34.263060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:34.263060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:34.263060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:34.263060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:34.263060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:34.263060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:34.263060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:34.263060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:34.264039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:34.264039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:34.264039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:34.264039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:34.264039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:34.264039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:34.264039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:34.264039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:34.264039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:34.264039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:34.264039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:34.264039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:34.264039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:34.264039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:34.264039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:34.264039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:34.264039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:34.264039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:34.264980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:34.264980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:34.264980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:34.264980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:34.264980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:34.264980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:34.264980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:34.264980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:34.264980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 27 04:07:34.264980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:34.264980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 363/728] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:07:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:34.269924 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744ad4a-2f61-4318-861c-2d8439565fb3 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:34.334253 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60208c9d-a901-4fe9-8265-2d09b262295e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:34.336700 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:34.370695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a73da-7faa-43b2-8cd1-87b0c71b1858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:34.371363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a73da-7faa-43b2-8cd1-87b0c71b1858 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:34.371651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a73da-7faa-43b2-8cd1-87b0c71b1858 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:34.371932 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a73da-7faa-43b2-8cd1-87b0c71b1858 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:34.387130 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a73da-7faa-43b2-8cd1-87b0c71b1858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:34.392004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-858a73da-7faa-43b2-8cd1-87b0c71b1858 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:07:34.392004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:34.392004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:34.392004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:34.392004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:34.392004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:34.392004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:34.392004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:34.392004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:34.392004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:34.392004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:34.392004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:34.392004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:34.392004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:34.392004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:34.392004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:34.392934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:34.392934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:34.392934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:34.392934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:34.392934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:34.392934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:34.392934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:34.392934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:34.392934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:34.392934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:34.392934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:34.392934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:34.392934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:34.392934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:34.392934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:34.392934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:34.393788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:34.393788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:34.393788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:34.393788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:34.393788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:34.393788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:34.393788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:34.393788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:34.393788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:34.393788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:34.393788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:07:34.393788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:34.394966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 366/729] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:07:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:34.405061 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a73da-7faa-43b2-8cd1-87b0c71b1858 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:34.448955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:34.471469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744ad4a-2f61-4318-861c-2d8439565fb3 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:34.518518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a86d7-f0d8-4248-b0e0-0de138140529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:34.519452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a86d7-f0d8-4248-b0e0-0de138140529 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:34.519752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a86d7-f0d8-4248-b0e0-0de138140529 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:34.520031 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a86d7-f0d8-4248-b0e0-0de138140529 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:34.521052 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a86d7-f0d8-4248-b0e0-0de138140529 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:34.521973 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a86d7-f0d8-4248-b0e0-0de138140529 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:34.523966 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a86d7-f0d8-4248-b0e0-0de138140529 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:34.539937 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a73da-7faa-43b2-8cd1-87b0c71b1858 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:34.545898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 364/730] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Sep 27 04:07:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:07:34.547179 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73cad1-7ecb-4449-a68f-86646e8f16bf None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:34.547474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73cad1-7ecb-4449-a68f-86646e8f16bf None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:34.547756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73cad1-7ecb-4449-a68f-86646e8f16bf None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:34.549202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 365/731] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:34.556397 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73cad1-7ecb-4449-a68f-86646e8f16bf None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:34.587407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a27f6-bc52-418d-a819-3b2e58e727e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:34.588130 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a27f6-bc52-418d-a819-3b2e58e727e3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:34.588415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a27f6-bc52-418d-a819-3b2e58e727e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:34.588692 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a27f6-bc52-418d-a819-3b2e58e727e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:34.589554 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a27f6-bc52-418d-a819-3b2e58e727e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:34.589870 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a27f6-bc52-418d-a819-3b2e58e727e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:34.591622 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a27f6-bc52-418d-a819-3b2e58e727e3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:34.600435 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 367/732] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:07:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:34.601924 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56573a-66c8-4386-b307-e25ac6ec659e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:34.602919 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56573a-66c8-4386-b307-e25ac6ec659e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:34.603679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56573a-66c8-4386-b307-e25ac6ec659e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:34.621877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5d56573a-66c8-4386-b307-e25ac6ec659e None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:34.623364 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5d56573a-66c8-4386-b307-e25ac6ec659e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:34.647432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:34.684228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73cad1-7ecb-4449-a68f-86646e8f16bf None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:34.703011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 368/733] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:34.704236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dde36-3804-49dd-b4e4-584aa33cfc32 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:34.704765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dde36-3804-49dd-b4e4-584aa33cfc32 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:34.705176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dde36-3804-49dd-b4e4-584aa33cfc32 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:34.710858 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 369/734] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:34.712326 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dde36-3804-49dd-b4e4-584aa33cfc32 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:34.734935 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69055ec-9a8d-45d2-8366-e44169c53403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:34.735894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69055ec-9a8d-45d2-8366-e44169c53403 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:34.736943 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69055ec-9a8d-45d2-8366-e44169c53403 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:34.737428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69055ec-9a8d-45d2-8366-e44169c53403 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:34.753486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:34.814589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69055ec-9a8d-45d2-8366-e44169c53403 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:34.815992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69055ec-9a8d-45d2-8366-e44169c53403 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:34.823399 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dde36-3804-49dd-b4e4-584aa33cfc32 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:34.859698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56da3b-6487-4143-9628-b09274a5203b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:34.860574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56da3b-6487-4143-9628-b09274a5203b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:34.861050 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56da3b-6487-4143-9628-b09274a5203b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:34.861617 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56da3b-6487-4143-9628-b09274a5203b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:34.872697 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56da3b-6487-4143-9628-b09274a5203b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:34.874336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56da3b-6487-4143-9628-b09274a5203b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:34.889674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-be56da3b-6487-4143-9628-b09274a5203b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:34.889674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:34.889674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:34.889674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:34.889674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:34.889674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:34.889674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:34.889674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:34.889674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:34.889674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:34.889674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:34.889674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:34.889674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:34.889674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:34.889674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:34.889674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:34.890636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:34.890636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:34.890636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:34.890636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:34.890636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:34.890636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:34.890636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:34.890636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:34.890636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:34.890636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:34.890636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:34.890636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:34.890636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:34.890636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:34.890636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:34.890636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:34.890636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:34.891966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:34.891966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:34.891966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:34.891966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 370/735] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:34.892661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cb05f-5987-4a56-a646-72b4736e2fe3 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:34.892661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cb05f-5987-4a56-a646-72b4736e2fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:34.892895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cb05f-5987-4a56-a646-72b4736e2fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:34.911361 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e64cb05f-5987-4a56-a646-72b4736e2fe3 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:34.912782 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e64cb05f-5987-4a56-a646-72b4736e2fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:34.914708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:34.916242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 366/736] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:07:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:07:34.917673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be89fb-a014-4e68-a0fc-c0b7886e6012 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:34.917957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be89fb-a014-4e68-a0fc-c0b7886e6012 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:34.918230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be89fb-a014-4e68-a0fc-c0b7886e6012 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:34.922846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 367/737] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:34.922846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be89fb-a014-4e68-a0fc-c0b7886e6012 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:34.970873 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:34.992463 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 371/738] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:34.993309 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cb05f-5987-4a56-a646-72b4736e2fe3 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:35.030068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be89fb-a014-4e68-a0fc-c0b7886e6012 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:35.066706 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c432aa9-dff9-498c-a820-d4c3bb2365ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:35.067267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c432aa9-dff9-498c-a820-d4c3bb2365ac None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:35.067547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c432aa9-dff9-498c-a820-d4c3bb2365ac None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:35.067821 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c432aa9-dff9-498c-a820-d4c3bb2365ac None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:35.069009 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c432aa9-dff9-498c-a820-d4c3bb2365ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:35.069317 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c432aa9-dff9-498c-a820-d4c3bb2365ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:35.070670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c432aa9-dff9-498c-a820-d4c3bb2365ac None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:35.087034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 368/739] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:35.088157 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1e71a-8482-458c-9511-cd8bf83859c0 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:35.088498 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1e71a-8482-458c-9511-cd8bf83859c0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:35.088718 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1e71a-8482-458c-9511-cd8bf83859c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:35.099058 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cb05f-5987-4a56-a646-72b4736e2fe3 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:35.107860 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-14c1e71a-8482-458c-9511-cd8bf83859c0 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:35.109026 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-14c1e71a-8482-458c-9511-cd8bf83859c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:35.135381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924bb72-2f9f-4bf8-af4a-122e56389673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:35.136002 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924bb72-2f9f-4bf8-af4a-122e56389673 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:35.136279 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924bb72-2f9f-4bf8-af4a-122e56389673 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:35.136554 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924bb72-2f9f-4bf8-af4a-122e56389673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:35.143541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:35.148796 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924bb72-2f9f-4bf8-af4a-122e56389673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:35.150236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924bb72-2f9f-4bf8-af4a-122e56389673 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:35.166109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-9924bb72-2f9f-4bf8-af4a-122e56389673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:35.166109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:35.166109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:35.166109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:35.166109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:35.166109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:35.166109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:35.166109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:35.166109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:35.166109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:35.166109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:35.166109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:35.166109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:35.166109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:35.166109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:35.166109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:35.167111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:35.167111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:35.167111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:35.167111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:35.167111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:35.167111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:35.167111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:35.167111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:35.167111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:35.167111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:35.167111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:35.167111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:35.167111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:35.167111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:35.167111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:35.167111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:35.167111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:35.168009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:35.168009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:35.168009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:35.168009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 372/740] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:35.168782 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924bb72-2f9f-4bf8-af4a-122e56389673 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:35.190948 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 369/741] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:07:35.190948 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1e71a-8482-458c-9511-cd8bf83859c0 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:35.225677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:35.298601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1e71a-8482-458c-9511-cd8bf83859c0 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:35.309773 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924bb72-2f9f-4bf8-af4a-122e56389673 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:35.335389 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826e534-713b-4b0a-850a-eae0253d415d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:35.336364 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826e534-713b-4b0a-850a-eae0253d415d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:35.336936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826e534-713b-4b0a-850a-eae0253d415d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:35.337367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826e534-713b-4b0a-850a-eae0253d415d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:35.344753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826e534-713b-4b0a-850a-eae0253d415d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:35.346198 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826e534-713b-4b0a-850a-eae0253d415d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:35.346913 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebbfb8-5654-41f6-8ca8-4bc5845be1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:35.347717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebbfb8-5654-41f6-8ca8-4bc5845be1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:35.348150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebbfb8-5654-41f6-8ca8-4bc5845be1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:35.348587 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebbfb8-5654-41f6-8ca8-4bc5845be1a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:35.358062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-5826e534-713b-4b0a-850a-eae0253d415d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:07:35.358062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:35.358062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:35.358062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:35.358062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:35.358062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:35.358062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:35.358062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:35.358062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:35.358062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:35.358062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:35.358062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:35.358062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:35.358062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:35.358062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:35.358062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:35.359044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:35.359044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:35.359044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:35.359044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:35.359044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:35.359044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:35.359044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:35.359044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:35.359044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:35.359044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:35.359044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:35.359044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:35.359044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:35.359044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:35.359044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:35.359044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:35.359044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:35.359044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:35.360021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:35.360021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:35.360021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:35.360021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:35.360021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:35.360021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:35.360021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:35.360021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:35.360021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:07:35.360021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:35.360021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 370/742] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 27 04:07:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:35.360021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826e534-713b-4b0a-850a-eae0253d415d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:35.363709 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebbfb8-5654-41f6-8ca8-4bc5845be1a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:35.369976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-cdebbfb8-5654-41f6-8ca8-4bc5845be1a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:35.369976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:35.369976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:35.369976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:35.369976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:35.369976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:35.369976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:35.369976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:35.369976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:35.369976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:35.369976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:35.369976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:35.369976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:35.369976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:35.369976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:35.369976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:35.371175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:35.371175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:35.371175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:35.371175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:35.371175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:35.371175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:35.371175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:35.371175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:35.371175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:35.371175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:35.371175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:35.371175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:35.371175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:35.371175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:35.371175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:35.371175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:35.372052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:35.372052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:35.372052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:35.372052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:35.372052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:35.372052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:35.372052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:35.372052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:35.372052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:35.372052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:35.372052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:35.372052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:35.372052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 373/743] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:35.372745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebbfb8-5654-41f6-8ca8-4bc5845be1a1 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:35.430959 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:35.458642 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:35.469334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826e534-713b-4b0a-850a-eae0253d415d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:35.485230 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebbfb8-5654-41f6-8ca8-4bc5845be1a1 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:35.501871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05d46b-bbe3-455a-a99a-6859fdf37eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:35.502464 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05d46b-bbe3-455a-a99a-6859fdf37eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:35.502764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05d46b-bbe3-455a-a99a-6859fdf37eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:35.503038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05d46b-bbe3-455a-a99a-6859fdf37eb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:35.503677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05d46b-bbe3-455a-a99a-6859fdf37eb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:35.503980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05d46b-bbe3-455a-a99a-6859fdf37eb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:35.505347 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05d46b-bbe3-455a-a99a-6859fdf37eb1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:35.518279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 371/744] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:35.518279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05d46b-bbe3-455a-a99a-6859fdf37eb1 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:35.523623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3b0e2-3806-4718-9cf0-200700bd2300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:35.524223 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3b0e2-3806-4718-9cf0-200700bd2300 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:35.524525 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3b0e2-3806-4718-9cf0-200700bd2300 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:35.524783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3b0e2-3806-4718-9cf0-200700bd2300 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:35.525436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3b0e2-3806-4718-9cf0-200700bd2300 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:35.526833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3b0e2-3806-4718-9cf0-200700bd2300 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:35.542415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 374/745] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 27 04:07:35 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:07:35.543386 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3b0e2-3806-4718-9cf0-200700bd2300 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:35.635486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05d46b-bbe3-455a-a99a-6859fdf37eb1 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:35.678735 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3b0e2-3806-4718-9cf0-200700bd2300 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:35.679301 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f360047-dd62-4ec6-9307-03e26aba42b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:35.679890 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f360047-dd62-4ec6-9307-03e26aba42b4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:35.680275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f360047-dd62-4ec6-9307-03e26aba42b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:35.680653 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f360047-dd62-4ec6-9307-03e26aba42b4 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:35.681491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f360047-dd62-4ec6-9307-03e26aba42b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:35.681878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f360047-dd62-4ec6-9307-03e26aba42b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:35.683458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f360047-dd62-4ec6-9307-03e26aba42b4 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:35.688352 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:35.704456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 372/746] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 27 04:07:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:35.705214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f360047-dd62-4ec6-9307-03e26aba42b4 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:35.709058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:35.731362 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b40de-4a2c-43bd-8767-185e07f4094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:35.732031 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b40de-4a2c-43bd-8767-185e07f4094d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:35.732319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b40de-4a2c-43bd-8767-185e07f4094d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:35.732595 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b40de-4a2c-43bd-8767-185e07f4094d None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:35.733272 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b40de-4a2c-43bd-8767-185e07f4094d None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:35.733580 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b40de-4a2c-43bd-8767-185e07f4094d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:35.734996 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b40de-4a2c-43bd-8767-185e07f4094d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:35.744512 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 375/747] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:07:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:35.745657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b40de-4a2c-43bd-8767-185e07f4094d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:35.821443 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f360047-dd62-4ec6-9307-03e26aba42b4 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:35.852556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b40de-4a2c-43bd-8767-185e07f4094d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:35.858570 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19dfa-acff-49a1-a416-c24119a59ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:35.859370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19dfa-acff-49a1-a416-c24119a59ef7 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:35.859884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19dfa-acff-49a1-a416-c24119a59ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:35.860309 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19dfa-acff-49a1-a416-c24119a59ef7 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:35.861113 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf19dfa-acff-49a1-a416-c24119a59ef7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:35.862838 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf19dfa-acff-49a1-a416-c24119a59ef7 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:35.880309 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 373/748] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 27 04:07:35 2022] POST /identity/v3/services => generated 240 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:07:35.881216 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19dfa-acff-49a1-a416-c24119a59ef7 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:35.902831 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f245f-e59b-4db7-948f-c6455558840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:35.902831 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f245f-e59b-4db7-948f-c6455558840f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:35.902831 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f245f-e59b-4db7-948f-c6455558840f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:35.902831 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f245f-e59b-4db7-948f-c6455558840f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:35.910560 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f245f-e59b-4db7-948f-c6455558840f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:35.913543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f245f-e59b-4db7-948f-c6455558840f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:35.929389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-b70f245f-e59b-4db7-948f-c6455558840f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:35.929389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:35.929389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:35.929389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:35.929389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:35.929389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:35.929389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:35.929389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:35.929389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:35.929389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:35.929389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:35.929389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:35.929389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:35.929389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:35.929389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:35.930397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:35.930397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:35.930397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:35.930397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:35.930397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:35.930397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:35.930397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:35.930397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:35.930397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:35.930397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:35.930397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:35.930397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:35.930397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:35.930397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:35.930397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:35.930397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:35.930397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:35.931332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:35.931332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:35.931332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:35.931332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:35.931332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:35.931332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:35.931332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:35.931332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:35.931332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 376/749] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:35.933032 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f245f-e59b-4db7-948f-c6455558840f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:35.966876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:35.974651 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:36.025799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19dfa-acff-49a1-a416-c24119a59ef7 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:36.060735 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f245f-e59b-4db7-948f-c6455558840f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:36.070639 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de56cc5-096a-4e05-96e1-2ec7c5ed1ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:36.071751 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de56cc5-096a-4e05-96e1-2ec7c5ed1ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:36.072269 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de56cc5-096a-4e05-96e1-2ec7c5ed1ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:36.072874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de56cc5-096a-4e05-96e1-2ec7c5ed1ef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:36.084533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de56cc5-096a-4e05-96e1-2ec7c5ed1ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:36.086261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de56cc5-096a-4e05-96e1-2ec7c5ed1ef8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:36.099928 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f5ef4-9599-4c9f-bbe9-86047c8b393f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:36.100815 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f5ef4-9599-4c9f-bbe9-86047c8b393f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:36.101248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f5ef4-9599-4c9f-bbe9-86047c8b393f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:36.101673 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f5ef4-9599-4c9f-bbe9-86047c8b393f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:36.104745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-0de56cc5-096a-4e05-96e1-2ec7c5ed1ef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:36.104745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:36.104745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:36.104745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:36.104745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:36.104745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:36.104745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:36.104745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:36.104745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:36.104745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:36.104745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:36.104745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:36.104745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:36.104745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:36.104745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:36.104745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:36.105894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:36.105894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:36.105894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:36.105894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:36.105894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:36.105894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:36.105894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:36.105894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:36.105894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:36.105894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:36.105894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:36.105894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:36.105894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:36.105894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:36.105894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:36.105894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:36.105894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:36.107053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:36.107053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:36.107053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:36.107872 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 374/750] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:36.108628 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de56cc5-096a-4e05-96e1-2ec7c5ed1ef8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:36.117109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f5ef4-9599-4c9f-bbe9-86047c8b393f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:36.118601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f5ef4-9599-4c9f-bbe9-86047c8b393f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:36.136792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-0a6f5ef4-9599-4c9f-bbe9-86047c8b393f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:36.136792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:36.136792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:36.136792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:36.136792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:36.136792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:36.136792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:36.136792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:36.136792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:36.136792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:36.136792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:36.136792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:36.136792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:36.136792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:36.136792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:36.136792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:36.137986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:36.137986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:36.137986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:36.137986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:36.137986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:36.137986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:36.137986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:36.137986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:36.137986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:36.137986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:36.137986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:36.137986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:36.137986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:36.137986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:36.137986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:36.137986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:36.137986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:36.139159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:36.139159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:36.139159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:36.140470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 377/751] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:36.141349 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f5ef4-9599-4c9f-bbe9-86047c8b393f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:36.235204 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de56cc5-096a-4e05-96e1-2ec7c5ed1ef8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:36.254913 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:36.284494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ac0ff-1e0d-48d6-ac3f-ed858ddcb8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:36.285124 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ac0ff-1e0d-48d6-ac3f-ed858ddcb8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:36.285406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ac0ff-1e0d-48d6-ac3f-ed858ddcb8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:36.285676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ac0ff-1e0d-48d6-ac3f-ed858ddcb8b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:36.286400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ac0ff-1e0d-48d6-ac3f-ed858ddcb8b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:36.286852 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ac0ff-1e0d-48d6-ac3f-ed858ddcb8b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:36.288876 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ac0ff-1e0d-48d6-ac3f-ed858ddcb8b1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:36.303158 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 375/752] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:36.304058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ac0ff-1e0d-48d6-ac3f-ed858ddcb8b1 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:36.367081 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:36.395714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f5ef4-9599-4c9f-bbe9-86047c8b393f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:36.429082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ac0ff-1e0d-48d6-ac3f-ed858ddcb8b1 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:36.449215 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caed66a-c263-4924-9ac8-336c2da5374f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:36.449988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caed66a-c263-4924-9ac8-336c2da5374f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:36.450375 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caed66a-c263-4924-9ac8-336c2da5374f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:36.450800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caed66a-c263-4924-9ac8-336c2da5374f None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:36.452141 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caed66a-c263-4924-9ac8-336c2da5374f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:36.452598 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caed66a-c263-4924-9ac8-336c2da5374f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:36.454460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caed66a-c263-4924-9ac8-336c2da5374f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:36.469542 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 378/753] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:36.471950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caed66a-c263-4924-9ac8-336c2da5374f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:36.481723 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7347f8d-4a4e-4dc8-8e6c-75ace2645c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:36.482356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7347f8d-4a4e-4dc8-8e6c-75ace2645c81 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:36.482687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7347f8d-4a4e-4dc8-8e6c-75ace2645c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:36.483058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7347f8d-4a4e-4dc8-8e6c-75ace2645c81 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:36.483747 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7347f8d-4a4e-4dc8-8e6c-75ace2645c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:36.484063 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7347f8d-4a4e-4dc8-8e6c-75ace2645c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:36.485685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7347f8d-4a4e-4dc8-8e6c-75ace2645c81 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:36.503181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 376/754] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:36.504052 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7347f8d-4a4e-4dc8-8e6c-75ace2645c81 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:36.551588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:36.592022 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caed66a-c263-4924-9ac8-336c2da5374f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:36.634330 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14511ed5-4f14-4f7a-9970-9a895d3c81c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:36.635638 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14511ed5-4f14-4f7a-9970-9a895d3c81c2 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:36.636105 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14511ed5-4f14-4f7a-9970-9a895d3c81c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:36.636486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14511ed5-4f14-4f7a-9970-9a895d3c81c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:36.637424 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14511ed5-4f14-4f7a-9970-9a895d3c81c2 None admin] RBAC: Adding query filter params (role.id=2613cf4a98d44744a094c7782b19b4b5, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=c295a3063c3b45be96b406f586180142) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:36.637841 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14511ed5-4f14-4f7a-9970-9a895d3c81c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:36.639495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14511ed5-4f14-4f7a-9970-9a895d3c81c2 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:36.643063 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:36.645791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7347f8d-4a4e-4dc8-8e6c-75ace2645c81 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:36.656085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 379/755] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:07:36 2022] GET /identity/v3/role_assignments?user.id=c295a3063c3b45be96b406f586180142&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:36.657191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14511ed5-4f14-4f7a-9970-9a895d3c81c2 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:36.688942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ad789-cfa1-44bc-8305-61228035bfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:36.689881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ad789-cfa1-44bc-8305-61228035bfcc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:36.690316 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ad789-cfa1-44bc-8305-61228035bfcc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:36.690827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ad789-cfa1-44bc-8305-61228035bfcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:36.700265 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ad789-cfa1-44bc-8305-61228035bfcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:36.702178 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ad789-cfa1-44bc-8305-61228035bfcc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:36.717044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-a97ad789-cfa1-44bc-8305-61228035bfcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:36.717044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:36.717044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:36.717044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:36.717044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:36.717044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:36.717044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:36.717044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:36.717044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:36.717044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:36.717044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:36.717044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:36.717044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:36.717044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:36.717044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:36.718120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:36.718120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:36.718120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:36.718120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:36.718120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:36.718120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:36.718120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:36.718120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:36.718120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:36.718120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:36.718120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:36.718120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:36.718120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:36.718120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:36.718120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:36.718120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:36.718120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:36.719282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:36.719282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:36.719282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:36.719282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:36.719282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:36.719282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:36.719282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:36.719282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:36.721436 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 377/756] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:36.728242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ad789-cfa1-44bc-8305-61228035bfcc None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:36.846775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:36.872088 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ad789-cfa1-44bc-8305-61228035bfcc None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:36.930828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14511ed5-4f14-4f7a-9970-9a895d3c81c2 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:36.970114 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17c8fe-29db-4d7c-a769-9ef403fa4898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:36.971258 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17c8fe-29db-4d7c-a769-9ef403fa4898 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:36.971747 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17c8fe-29db-4d7c-a769-9ef403fa4898 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:36.971929 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a636a-4d09-4b74-9f25-600d376d41a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:36.972423 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17c8fe-29db-4d7c-a769-9ef403fa4898 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:36.972557 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a636a-4d09-4b74-9f25-600d376d41a9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:36.972842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a636a-4d09-4b74-9f25-600d376d41a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:36.973210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a636a-4d09-4b74-9f25-600d376d41a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:36.973931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a636a-4d09-4b74-9f25-600d376d41a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:36.974307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a636a-4d09-4b74-9f25-600d376d41a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:36.976332 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a636a-4d09-4b74-9f25-600d376d41a9 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:36.982313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17c8fe-29db-4d7c-a769-9ef403fa4898 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:36.984038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17c8fe-29db-4d7c-a769-9ef403fa4898 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:36.996057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-8d17c8fe-29db-4d7c-a769-9ef403fa4898 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 04:07:36.996057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:36.996057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:36.996057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:36.996057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:36.996057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:36.996057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:36.996057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:36.996057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:36.996057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:36.996057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:36.996057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:36.996057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:36.996057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:36.996057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:36.996057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:36.997040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:36.997040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:36.997040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:36.997040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:36.997040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:36.997040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:36.997040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:36.997040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:36.997040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:36.997040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:36.997040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:36.997040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:36.997040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:36.997040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:36.997040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:36.997040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:36.997040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:36.997040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:36.997984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:36.997984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:36.997984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:36.997984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:36.997984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:36.997984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:36.997984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:36.997984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:36.997984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 04:07:36.997984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:37.000483 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 380/757] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 27 04:07:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:37.006216 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 378/758] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:37.007124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17c8fe-29db-4d7c-a769-9ef403fa4898 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:37.022851 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a636a-4d09-4b74-9f25-600d376d41a9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:37.120515 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:37.207830 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17c8fe-29db-4d7c-a769-9ef403fa4898 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:37.222702 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a636a-4d09-4b74-9f25-600d376d41a9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:37.279312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1813c-ff39-48ac-8067-383ccf85cee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:37.281490 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1813c-ff39-48ac-8067-383ccf85cee3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:37.282955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1813c-ff39-48ac-8067-383ccf85cee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:37.284088 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1813c-ff39-48ac-8067-383ccf85cee3 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:37.285039 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1813c-ff39-48ac-8067-383ccf85cee3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:37.286659 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1813c-ff39-48ac-8067-383ccf85cee3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:37.289488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1813c-ff39-48ac-8067-383ccf85cee3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:37.292131 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c2cd2-02eb-45c3-ae7a-cd6d3765bbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:37.293062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c2cd2-02eb-45c3-ae7a-cd6d3765bbf7 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:37.293779 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c2cd2-02eb-45c3-ae7a-cd6d3765bbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:37.294261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c2cd2-02eb-45c3-ae7a-cd6d3765bbf7 None admin] PATH_INFO: `/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/3960d52dee8443cf9ec8930a389a7b60/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:37.296438 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c2cd2-02eb-45c3-ae7a-cd6d3765bbf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=37e7a8d1446d4cdea0ba00124411cd93, user_id=3960d52dee8443cf9ec8930a389a7b60, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:37.298095 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c2cd2-02eb-45c3-ae7a-cd6d3765bbf7 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:37.325483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 379/759] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:07:37 2022] PUT /identity/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/3960d52dee8443cf9ec8930a389a7b60/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:07:37.329920 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 381/760] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Sep 27 04:07:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:37.335820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c2cd2-02eb-45c3-ae7a-cd6d3765bbf7 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:37.370408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:37.487764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c2cd2-02eb-45c3-ae7a-cd6d3765bbf7 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:37.525395 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b0bd3-76c3-488a-940c-9a7ba2d424f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:37.526075 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b0bd3-76c3-488a-940c-9a7ba2d424f2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:37.526359 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b0bd3-76c3-488a-940c-9a7ba2d424f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:37.526686 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b0bd3-76c3-488a-940c-9a7ba2d424f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:37.606540 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b0bd3-76c3-488a-940c-9a7ba2d424f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:37.608047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b0bd3-76c3-488a-940c-9a7ba2d424f2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:37.626710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:37.730269 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 380/761] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:07:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:07:37.736106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1813c-ff39-48ac-8067-383ccf85cee3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:37.873198 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1813c-ff39-48ac-8067-383ccf85cee3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:37.892259 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:37.913392 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29968ae1-e85d-427f-b922-8f0a185a8853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:37.914026 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29968ae1-e85d-427f-b922-8f0a185a8853 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:37.914312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29968ae1-e85d-427f-b922-8f0a185a8853 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:37.914585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29968ae1-e85d-427f-b922-8f0a185a8853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:37.925797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29968ae1-e85d-427f-b922-8f0a185a8853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:37.927305 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29968ae1-e85d-427f-b922-8f0a185a8853 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:37.943584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-29968ae1-e85d-427f-b922-8f0a185a8853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:37.943584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:37.943584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:37.943584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:37.943584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:37.943584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:37.943584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:37.943584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:37.943584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:37.943584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:37.943584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:37.943584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:37.943584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:37.943584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:37.943584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:37.943584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:37.946221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:37.946221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:37.946221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:37.946221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:37.946221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:37.946221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:37.946221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:37.946221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:37.946221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:37.946221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:37.946221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:37.946221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:37.946221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:37.946221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:37.946221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:37.946221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:37.946221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:37.947481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:37.947481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:37.947481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:37.947481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 382/762] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:37.951971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b0bd3-76c3-488a-940c-9a7ba2d424f2 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:38.034874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254925a-1753-417f-837d-d84715ace917 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:38.035170 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254925a-1753-417f-837d-d84715ace917 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:38.035329 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254925a-1753-417f-837d-d84715ace917 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:38.036642 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 383/763] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:38.050132 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d161b-7ed3-4a03-82ab-f31e51d7a323 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:38.050416 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d161b-7ed3-4a03-82ab-f31e51d7a323 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:38.050696 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d161b-7ed3-4a03-82ab-f31e51d7a323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:38.071555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e44d161b-7ed3-4a03-82ab-f31e51d7a323 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:38.072838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e44d161b-7ed3-4a03-82ab-f31e51d7a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:38.119160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b0bd3-76c3-488a-940c-9a7ba2d424f2 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:38.146289 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 384/764] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:07:38.152776 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:38.173011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdfe13-d215-452b-b75e-5c6b7b8cc3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:38.173857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdfe13-d215-452b-b75e-5c6b7b8cc3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:38.174322 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdfe13-d215-452b-b75e-5c6b7b8cc3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:38.174780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdfe13-d215-452b-b75e-5c6b7b8cc3d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:38.175578 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdfe13-d215-452b-b75e-5c6b7b8cc3d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:38.176044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdfe13-d215-452b-b75e-5c6b7b8cc3d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:38.178101 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdfe13-d215-452b-b75e-5c6b7b8cc3d6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:38.193937 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 381/765] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:38.199156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d161b-7ed3-4a03-82ab-f31e51d7a323 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:38.302682 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:38.305534 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d161b-7ed3-4a03-82ab-f31e51d7a323 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:38.329756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1afe87-2283-4d86-b190-a83bbbc41cda None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:38.330056 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1afe87-2283-4d86-b190-a83bbbc41cda None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:38.330314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1afe87-2283-4d86-b190-a83bbbc41cda None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:38.333066 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 382/766] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:38.337554 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a11fb-ac2b-4547-837a-917841894f53 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:38.337836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a11fb-ac2b-4547-837a-917841894f53 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:38.338116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a11fb-ac2b-4547-837a-917841894f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:38.341491 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4dc18-2f62-443b-8f18-f50129a61cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:38.342232 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4dc18-2f62-443b-8f18-f50129a61cab None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:38.342513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4dc18-2f62-443b-8f18-f50129a61cab None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:38.342822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4dc18-2f62-443b-8f18-f50129a61cab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:38.349978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4dc18-2f62-443b-8f18-f50129a61cab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:38.351462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4dc18-2f62-443b-8f18-f50129a61cab None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:38.356587 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-377a11fb-ac2b-4547-837a-917841894f53 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:38.357764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-377a11fb-ac2b-4547-837a-917841894f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:38.363269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-4bd4dc18-2f62-443b-8f18-f50129a61cab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:38.363269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:38.363269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:38.363269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:38.363269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:38.363269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:38.363269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:38.363269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:38.363269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:38.363269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:38.363269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:38.363269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:38.363269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:38.363269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:38.363269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:38.364529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:38.364529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:38.364529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:38.364529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:38.364529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:38.364529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:38.364529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:38.364529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:38.364529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:38.364529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:38.364529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:38.364529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:38.364529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:38.364529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:38.364529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:38.364529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:38.364529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:38.366465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:38.366465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:38.366465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:38.366465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:38.366465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:38.366465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:38.366465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:38.366465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:38.366465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 385/767] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:38.370379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4dc18-2f62-443b-8f18-f50129a61cab None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:38.480333 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 383/768] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:07:38.481822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4dc18-2f62-443b-8f18-f50129a61cab None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:38.500125 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a11fb-ac2b-4547-837a-917841894f53 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:38.538547 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642e3f8-0f1f-4ae2-be08-faef03b98b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:38.539241 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642e3f8-0f1f-4ae2-be08-faef03b98b33 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:38.539528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642e3f8-0f1f-4ae2-be08-faef03b98b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:38.539803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642e3f8-0f1f-4ae2-be08-faef03b98b33 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:38.540506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642e3f8-0f1f-4ae2-be08-faef03b98b33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:38.540814 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642e3f8-0f1f-4ae2-be08-faef03b98b33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:38.542254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642e3f8-0f1f-4ae2-be08-faef03b98b33 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:38.573868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 386/769] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:07:38.580621 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642e3f8-0f1f-4ae2-be08-faef03b98b33 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:38.623941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:38.720898 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642e3f8-0f1f-4ae2-be08-faef03b98b33 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:38.770743 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab3100-9cba-456f-aa4c-4bbed41e53a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:38.770743 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab3100-9cba-456f-aa4c-4bbed41e53a4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:38.770743 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab3100-9cba-456f-aa4c-4bbed41e53a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:38.770743 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab3100-9cba-456f-aa4c-4bbed41e53a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:38.771681 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab3100-9cba-456f-aa4c-4bbed41e53a4 None admin] RBAC: Adding query filter params (role.id=e62613bfe0e143abbc25d60ea42a4416, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=71c7a54c598642a4b9219ae21c34f0b0) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:38.771681 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab3100-9cba-456f-aa4c-4bbed41e53a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:38.771681 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab3100-9cba-456f-aa4c-4bbed41e53a4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:38.774469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 387/770] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:07:38 2022] GET /identity/v3/role_assignments?user.id=71c7a54c598642a4b9219ae21c34f0b0&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=e62613bfe0e143abbc25d60ea42a4416 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:38.790409 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a11fb-ac2b-4547-837a-917841894f53 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:38.798880 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:38.842844 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab3100-9cba-456f-aa4c-4bbed41e53a4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:38.846405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146fee4-4707-413d-9cbf-0234a5490710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:38.847338 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146fee4-4707-413d-9cbf-0234a5490710 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:38.847775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146fee4-4707-413d-9cbf-0234a5490710 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:38.848194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146fee4-4707-413d-9cbf-0234a5490710 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:38.848998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146fee4-4707-413d-9cbf-0234a5490710 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:38.851180 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146fee4-4707-413d-9cbf-0234a5490710 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:38.864137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-e146fee4-4707-413d-9cbf-0234a5490710 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 04:07:38.864137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:38.864137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:07:38.864137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:07:38.864137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:07:38.864137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:07:38.864137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:07:38.864137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:38.864137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 04:07:38.864137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:38.864137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:07:38.864137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:38.864137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:38.864137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:38.864137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:38.864137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:38.864137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:38.866006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:38.866006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:38.866006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:38.866006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:38.866006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:38.866006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:38.866006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:07:38.866006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:07:38.866006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:07:38.866006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:07:38.866006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:38.866006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:38.866006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:38.866006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:38.866006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:38.866006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:38.867092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:38.867092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:38.867092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:38.867092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:38.867092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:38.867092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:38.867092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:38.867092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:38.867092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:38.867092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:38.867092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:07:38.867092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:38.867092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 04:07:38.867092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:38.869705 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 384/771] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Sep 27 04:07:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:38.876728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146fee4-4707-413d-9cbf-0234a5490710 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:38.970744 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:38.987172 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab3100-9cba-456f-aa4c-4bbed41e53a4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:39.028898 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80726f55-9ab2-4a81-a692-dfda5ca316f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:39.029535 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80726f55-9ab2-4a81-a692-dfda5ca316f8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:39.029813 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80726f55-9ab2-4a81-a692-dfda5ca316f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:39.030083 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80726f55-9ab2-4a81-a692-dfda5ca316f8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:39.030675 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80726f55-9ab2-4a81-a692-dfda5ca316f8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:39.032087 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80726f55-9ab2-4a81-a692-dfda5ca316f8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:39.046482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-80726f55-9ab2-4a81-a692-dfda5ca316f8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 04:07:39.046482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:39.046482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:07:39.046482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:07:39.046482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:07:39.046482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:07:39.046482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:07:39.046482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:39.046482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 04:07:39.046482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:39.046482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:07:39.046482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:39.046482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:39.046482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:39.046482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:39.046482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:39.046482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:39.047569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:39.047569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:39.047569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:39.047569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:39.047569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:39.047569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:39.047569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:07:39.047569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:07:39.047569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:07:39.047569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:07:39.047569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:39.047569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:39.047569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:39.047569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:39.047569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:39.047569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:39.048436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:39.048436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:39.048436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:39.048436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:39.048436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:39.048436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:39.048436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:39.048436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:39.048436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:39.048436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:39.048436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:07:39.048436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:39.048436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 04:07:39.048436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:39.050637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 388/772] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:38 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:07:39.061916 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80726f55-9ab2-4a81-a692-dfda5ca316f8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:39.066172 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146fee4-4707-413d-9cbf-0234a5490710 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:39.117768 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb3e49-8497-4a2d-9ba4-ae4ff69284f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:39.118362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb3e49-8497-4a2d-9ba4-ae4ff69284f0 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:39.118646 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb3e49-8497-4a2d-9ba4-ae4ff69284f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:39.118942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb3e49-8497-4a2d-9ba4-ae4ff69284f0 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:39.119586 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb3e49-8497-4a2d-9ba4-ae4ff69284f0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:39.119890 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb3e49-8497-4a2d-9ba4-ae4ff69284f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:39.121260 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb3e49-8497-4a2d-9ba4-ae4ff69284f0 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:39.139521 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 385/773] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Sep 27 04:07:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:07:39.148323 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb3e49-8497-4a2d-9ba4-ae4ff69284f0 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:39.203063 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:39.238851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80726f55-9ab2-4a81-a692-dfda5ca316f8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:39.276333 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc62a3-57c2-4cba-b83c-350be6ff081b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:39.276939 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc62a3-57c2-4cba-b83c-350be6ff081b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:39.277221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc62a3-57c2-4cba-b83c-350be6ff081b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:39.277495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc62a3-57c2-4cba-b83c-350be6ff081b None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:39.278130 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc62a3-57c2-4cba-b83c-350be6ff081b None admin] RBAC: Adding query filter params (name=network) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:39.278436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc62a3-57c2-4cba-b83c-350be6ff081b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:39.279911 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc62a3-57c2-4cba-b83c-350be6ff081b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:39.284715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 389/774] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 27 04:07:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:39.295821 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc62a3-57c2-4cba-b83c-350be6ff081b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:39.313929 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb3e49-8497-4a2d-9ba4-ae4ff69284f0 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:39.324788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:39.353701 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede1966-0867-42cf-bfcc-6be0d8e527b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:39.354385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede1966-0867-42cf-bfcc-6be0d8e527b4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:39.354754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede1966-0867-42cf-bfcc-6be0d8e527b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:39.355038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede1966-0867-42cf-bfcc-6be0d8e527b4 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:39.355678 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede1966-0867-42cf-bfcc-6be0d8e527b4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:39.355981 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede1966-0867-42cf-bfcc-6be0d8e527b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:39.357349 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede1966-0867-42cf-bfcc-6be0d8e527b4 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:39.362508 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 386/775] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Sep 27 04:07:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:39.368382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede1966-0867-42cf-bfcc-6be0d8e527b4 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:39.466514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc62a3-57c2-4cba-b83c-350be6ff081b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:39.518991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dbc4f-0de5-482d-8391-07be322211e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:39.519615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dbc4f-0de5-482d-8391-07be322211e9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:39.519895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dbc4f-0de5-482d-8391-07be322211e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:39.520165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dbc4f-0de5-482d-8391-07be322211e9 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:39.520817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dbc4f-0de5-482d-8391-07be322211e9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:39.524916 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dbc4f-0de5-482d-8391-07be322211e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:39.526400 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dbc4f-0de5-482d-8391-07be322211e9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:39.539416 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 390/776] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 27 04:07:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:39.553918 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dbc4f-0de5-482d-8391-07be322211e9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:39.582533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:39.588265 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede1966-0867-42cf-bfcc-6be0d8e527b4 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:39.634826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d9873-fbc7-44b1-9def-bbe8bf194814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:39.634826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d9873-fbc7-44b1-9def-bbe8bf194814 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:39.634826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d9873-fbc7-44b1-9def-bbe8bf194814 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:39.634826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d9873-fbc7-44b1-9def-bbe8bf194814 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:39.635215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d9873-fbc7-44b1-9def-bbe8bf194814 None admin] RBAC: Adding query filter params (interface=public, service_id=5965db7abb2f4f02aeb802997f867037, region_id=RegionOne) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:39.635215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d9873-fbc7-44b1-9def-bbe8bf194814 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:39.635215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d9873-fbc7-44b1-9def-bbe8bf194814 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:39.645083 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 387/777] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 27 04:07:39 2022] GET /identity/v3/endpoints?service_id=5965db7abb2f4f02aeb802997f867037&interface=public®ion_id=RegionOne => generated 194 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:39.651905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d9873-fbc7-44b1-9def-bbe8bf194814 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:39.688039 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:39.720220 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dbc4f-0de5-482d-8391-07be322211e9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:39.769511 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2224d-68df-4d5a-974d-bb613dcf713d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:39.770175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2224d-68df-4d5a-974d-bb613dcf713d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:39.770871 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2224d-68df-4d5a-974d-bb613dcf713d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:39.771694 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2224d-68df-4d5a-974d-bb613dcf713d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:39.772955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2224d-68df-4d5a-974d-bb613dcf713d None admin] RBAC: Adding query filter params (interface=public, service_id=607d14f0b126473d996e1ce6e5eb5340, region_id=RegionOne) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:39.773273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2224d-68df-4d5a-974d-bb613dcf713d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:39.774943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2224d-68df-4d5a-974d-bb613dcf713d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:39.778390 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d9873-fbc7-44b1-9def-bbe8bf194814 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:39.786796 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 391/778] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 27 04:07:39 2022] GET /identity/v3/endpoints?service_id=607d14f0b126473d996e1ce6e5eb5340&interface=public®ion_id=RegionOne => generated 194 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:39.788317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442220b-7a5d-4fa4-8d97-158b8c237514 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:39.788810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442220b-7a5d-4fa4-8d97-158b8c237514 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:39.789314 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442220b-7a5d-4fa4-8d97-158b8c237514 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:39.790793 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 392/779] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:39.793298 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442220b-7a5d-4fa4-8d97-158b8c237514 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:39.819861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ce487-6430-46bc-af3c-76f05a8d2d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:39.820809 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ce487-6430-46bc-af3c-76f05a8d2d7a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:39.821320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ce487-6430-46bc-af3c-76f05a8d2d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:39.821809 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ce487-6430-46bc-af3c-76f05a8d2d7a None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:39.822622 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ce487-6430-46bc-af3c-76f05a8d2d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:39.824246 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ce487-6430-46bc-af3c-76f05a8d2d7a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:39.830073 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 388/780] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 27 04:07:39 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:39.831544 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce2b4b-eb92-4b47-a814-0aef426a9245 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:39.832043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce2b4b-eb92-4b47-a814-0aef426a9245 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:39.832528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce2b4b-eb92-4b47-a814-0aef426a9245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:39.851845 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-84ce2b4b-eb92-4b47-a814-0aef426a9245 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:39.853695 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-84ce2b4b-eb92-4b47-a814-0aef426a9245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:39.902494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:39.943638 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442220b-7a5d-4fa4-8d97-158b8c237514 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:39.986178 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030589c5-b52e-4ffd-a4d6-abcae665d5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:39.987591 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030589c5-b52e-4ffd-a4d6-abcae665d5cc None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:39.988075 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030589c5-b52e-4ffd-a4d6-abcae665d5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:39.988534 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030589c5-b52e-4ffd-a4d6-abcae665d5cc None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:39.990633 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030589c5-b52e-4ffd-a4d6-abcae665d5cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:39.992906 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030589c5-b52e-4ffd-a4d6-abcae665d5cc None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:40.000023 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 393/781] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 27 04:07:39 2022] GET /identity/v3/services => generated 772 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:40.044345 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 389/782] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:07:40.119615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89210d-5275-47cd-96b2-dabc44a9a89b None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:40.119897 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89210d-5275-47cd-96b2-dabc44a9a89b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:40.120179 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89210d-5275-47cd-96b2-dabc44a9a89b None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:40.121924 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 394/783] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:40.127780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf4e45-643d-472b-afaf-3f103233b837 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:40.128329 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf4e45-643d-472b-afaf-3f103233b837 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:40.128329 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf4e45-643d-472b-afaf-3f103233b837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:40.148560 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e7bf4e45-643d-472b-afaf-3f103233b837 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:40.149773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e7bf4e45-643d-472b-afaf-3f103233b837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:40.231406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 390/784] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:07:40.381153 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89210d-5275-47cd-96b2-dabc44a9a89b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:40.385199 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:40.497552 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89210d-5275-47cd-96b2-dabc44a9a89b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:40.532578 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9ed96-9160-4d0f-9e16-5bd7c661b2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:40.533203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9ed96-9160-4d0f-9e16-5bd7c661b2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:40.533486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9ed96-9160-4d0f-9e16-5bd7c661b2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:40.533762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9ed96-9160-4d0f-9e16-5bd7c661b2e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:40.538034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf4e45-643d-472b-afaf-3f103233b837 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:40.546855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9ed96-9160-4d0f-9e16-5bd7c661b2e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:40.552335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-bfa9ed96-9160-4d0f-9e16-5bd7c661b2e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:07:40.552335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:40.552335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:40.552335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:40.552335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:40.552335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:40.552335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:40.552335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:40.552335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:40.552335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:40.552335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:40.552335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:40.552335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:40.552335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:40.552335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:40.552335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:40.553851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:40.553851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:40.553851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:40.553851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:40.553851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:40.553851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:40.553851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:40.553851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:40.553851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:40.553851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:40.553851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:40.553851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:40.553851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:40.553851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:40.553851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:40.553851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:40.554703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:40.554703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:40.554703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:40.554703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:40.554703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:40.554703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:40.554703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:40.554703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:40.554703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:40.554703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:40.554703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:07:40.554703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:40.554703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 395/785] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:07:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:40.560561 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9ed96-9160-4d0f-9e16-5bd7c661b2e7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:40.634231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:40.679515 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9ed96-9160-4d0f-9e16-5bd7c661b2e7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:40.721486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5db86-27e1-4899-bd2d-49e4db28808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:40.722101 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5db86-27e1-4899-bd2d-49e4db28808f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:40.722381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5db86-27e1-4899-bd2d-49e4db28808f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:40.722656 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5db86-27e1-4899-bd2d-49e4db28808f None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:40.723362 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5db86-27e1-4899-bd2d-49e4db28808f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:40.723666 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5db86-27e1-4899-bd2d-49e4db28808f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:40.725596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5db86-27e1-4899-bd2d-49e4db28808f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:40.742843 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 396/786] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:07:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:40.747435 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:40.749948 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5db86-27e1-4899-bd2d-49e4db28808f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:40.779606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf4e45-643d-472b-afaf-3f103233b837 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:40.823714 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5d4e5-5b43-45f4-a55a-fb9bb0b1c9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:40.824262 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5d4e5-5b43-45f4-a55a-fb9bb0b1c9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:40.824541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5d4e5-5b43-45f4-a55a-fb9bb0b1c9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:40.824817 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5d4e5-5b43-45f4-a55a-fb9bb0b1c9a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:40.838086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5d4e5-5b43-45f4-a55a-fb9bb0b1c9a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:40.849780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-d3a5d4e5-5b43-45f4-a55a-fb9bb0b1c9a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:07:40.849780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:40.849780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:40.849780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:40.849780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:40.849780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:40.849780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:40.849780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:40.849780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:40.849780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:40.849780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:40.849780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:40.849780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:40.849780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:40.849780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:40.849780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:40.850936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:40.850936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:40.850936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:40.850936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:40.850936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:40.850936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:40.850936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:40.850936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:40.850936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:40.850936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:40.850936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:40.850936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:40.850936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:40.850936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:40.850936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:40.850936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:40.851984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:40.851984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:40.851984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:40.851984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:40.851984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:40.851984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:40.851984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:40.851984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:40.851984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:40.851984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:40.851984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:07:40.851984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:40.851984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 391/787] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:07:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:40.854256 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5d4e5-5b43-45f4-a55a-fb9bb0b1c9a8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:40.903904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5db86-27e1-4899-bd2d-49e4db28808f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:40.959262 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:40.970530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5d4e5-5b43-45f4-a55a-fb9bb0b1c9a8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:40.982519 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe927e-6ad1-4eb3-94eb-df053dbe1a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:40.983471 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe927e-6ad1-4eb3-94eb-df053dbe1a58 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:40.984018 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe927e-6ad1-4eb3-94eb-df053dbe1a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:40.987584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe927e-6ad1-4eb3-94eb-df053dbe1a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:41.014028 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe927e-6ad1-4eb3-94eb-df053dbe1a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:41.015552 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe927e-6ad1-4eb3-94eb-df053dbe1a58 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:41.016578 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb709c8-7db3-4e4a-9c63-ea3a3a174828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:41.017182 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb709c8-7db3-4e4a-9c63-ea3a3a174828 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:41.017457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb709c8-7db3-4e4a-9c63-ea3a3a174828 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:41.017805 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb709c8-7db3-4e4a-9c63-ea3a3a174828 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:41.018473 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb709c8-7db3-4e4a-9c63-ea3a3a174828 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:41.018789 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb709c8-7db3-4e4a-9c63-ea3a3a174828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:41.020368 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb709c8-7db3-4e4a-9c63-ea3a3a174828 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:41.036163 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 392/788] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:07:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:07:41.043879 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb709c8-7db3-4e4a-9c63-ea3a3a174828 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:41.049446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-fefe927e-6ad1-4eb3-94eb-df053dbe1a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:41.049446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:41.049446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:41.049446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:41.049446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:41.049446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:41.049446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:41.049446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:41.049446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:41.049446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:41.049446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:41.049446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:41.049446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:41.049446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:41.049446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:41.049446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:41.050469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:41.050469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:41.050469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:41.050469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:41.050469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:41.050469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:41.050469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:41.050469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:41.050469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:41.050469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:41.050469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:41.050469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:41.050469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:41.050469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:41.050469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:41.050469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:41.050469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:41.051443 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:41.051443 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:41.051443 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:41.052150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 397/789] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:41.063968 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe927e-6ad1-4eb3-94eb-df053dbe1a58 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:41.077516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:41.207407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe927e-6ad1-4eb3-94eb-df053dbe1a58 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:41.232353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb709c8-7db3-4e4a-9c63-ea3a3a174828 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:41.247348 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5c2b5-324e-4015-90da-ae2465f037ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:41.247959 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5c2b5-324e-4015-90da-ae2465f037ee None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:41.248238 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5c2b5-324e-4015-90da-ae2465f037ee None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:41.248509 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5c2b5-324e-4015-90da-ae2465f037ee None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:41.249370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5c2b5-324e-4015-90da-ae2465f037ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:41.249481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5c2b5-324e-4015-90da-ae2465f037ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:41.250833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5c2b5-324e-4015-90da-ae2465f037ee None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:41.270121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 398/790] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:41.270121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a57e0-f443-4034-b588-9f8fdc0f473a None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:41.270121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a57e0-f443-4034-b588-9f8fdc0f473a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:41.270121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a57e0-f443-4034-b588-9f8fdc0f473a None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:41.270121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 399/791] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:41.270121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a57e0-f443-4034-b588-9f8fdc0f473a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:41.280698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2b134-dc0c-4290-9ff6-bca4c43f6703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:41.281794 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2b134-dc0c-4290-9ff6-bca4c43f6703 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:41.282448 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2b134-dc0c-4290-9ff6-bca4c43f6703 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:41.282975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2b134-dc0c-4290-9ff6-bca4c43f6703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:41.295900 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2b134-dc0c-4290-9ff6-bca4c43f6703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:41.297803 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2b134-dc0c-4290-9ff6-bca4c43f6703 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:41.313535 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:41.314970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-98e2b134-dc0c-4290-9ff6-bca4c43f6703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:41.314970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:41.314970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:41.314970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:41.314970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:41.314970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:41.314970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:41.314970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:41.314970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:41.314970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:41.314970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:41.314970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:41.314970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:41.314970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:41.314970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:41.314970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:41.315971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:41.315971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:41.315971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:41.315971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:41.315971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:41.315971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:41.315971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:41.315971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:41.315971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:41.315971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:41.315971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:41.315971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:41.315971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:41.315971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:41.315971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:41.315971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:41.315971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:41.316917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:41.316917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:41.316917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:41.319791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 393/792] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:41.321313 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fdba2-72a0-4fce-89a4-ada42924ce62 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:41.321866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fdba2-72a0-4fce-89a4-ada42924ce62 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:41.322351 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fdba2-72a0-4fce-89a4-ada42924ce62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:41.342781 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a07fdba2-72a0-4fce-89a4-ada42924ce62 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:41.344523 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a07fdba2-72a0-4fce-89a4-ada42924ce62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:41.385092 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a57e0-f443-4034-b588-9f8fdc0f473a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:41.410954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:41.423398 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d0e77-7836-41e2-8e9a-f7ec5409c5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:41.424027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d0e77-7836-41e2-8e9a-f7ec5409c5ec None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:41.424306 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d0e77-7836-41e2-8e9a-f7ec5409c5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:41.424580 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d0e77-7836-41e2-8e9a-f7ec5409c5ec None admin] PATH_INFO: `/v3/users/swift` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:41.432711 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d0e77-7836-41e2-8e9a-f7ec5409c5ec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:41.433262 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 394/793] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:07:41.434208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d0e77-7836-41e2-8e9a-f7ec5409c5ec None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:41.434613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fdba2-72a0-4fce-89a4-ada42924ce62 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:41.450783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-4b7d0e77-7836-41e2-8e9a-f7ec5409c5ec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 04:07:41.450783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:41.450783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:41.450783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:41.450783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:41.450783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:41.450783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:41.450783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:41.450783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:41.450783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:41.450783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:41.450783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:41.450783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:41.450783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:41.450783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:41.450783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:41.451762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:41.451762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:41.451762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:41.451762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:41.451762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:41.451762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:41.451762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:41.451762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:41.451762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:41.451762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:41.451762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:41.451762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:41.451762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:41.451762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:41.451762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:41.451762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:41.451762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:41.451762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:41.452741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:41.452741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:41.452741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:41.452741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:41.452741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:41.452741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:41.452741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:41.452741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:41.452741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 27 04:07:41.452741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:41.453883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 400/794] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:07:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:07:41.455464 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d0e77-7836-41e2-8e9a-f7ec5409c5ec None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:41.598473 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:41.605319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d0e77-7836-41e2-8e9a-f7ec5409c5ec None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:41.645407 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fdba2-72a0-4fce-89a4-ada42924ce62 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:41.672156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddddc9-749a-42bd-9611-06c48f6e7dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:41.673032 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddddc9-749a-42bd-9611-06c48f6e7dab None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:41.673498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddddc9-749a-42bd-9611-06c48f6e7dab None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:41.673955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddddc9-749a-42bd-9611-06c48f6e7dab None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:41.674892 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddddc9-749a-42bd-9611-06c48f6e7dab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:41.676755 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddddc9-749a-42bd-9611-06c48f6e7dab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:41.678922 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddddc9-749a-42bd-9611-06c48f6e7dab None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:41.704262 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 401/795] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Sep 27 04:07:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:07:41.709749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddddc9-749a-42bd-9611-06c48f6e7dab None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:41.716148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76caae7-a27b-4509-91ee-af4158c8147e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:41.716775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76caae7-a27b-4509-91ee-af4158c8147e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:41.717058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76caae7-a27b-4509-91ee-af4158c8147e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:41.717333 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76caae7-a27b-4509-91ee-af4158c8147e None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:41.718008 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76caae7-a27b-4509-91ee-af4158c8147e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:41.718324 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76caae7-a27b-4509-91ee-af4158c8147e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:41.719730 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76caae7-a27b-4509-91ee-af4158c8147e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:41.743193 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 395/796] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:41.750218 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76caae7-a27b-4509-91ee-af4158c8147e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:41.807894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:41.863456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76caae7-a27b-4509-91ee-af4158c8147e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:41.863647 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddddc9-749a-42bd-9611-06c48f6e7dab None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:41.905884 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d323b-c6d4-441d-87aa-f4f37757ea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:41.906302 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fe259-af64-497e-9685-3dca7262e393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:41.906781 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d323b-c6d4-441d-87aa-f4f37757ea4f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:41.906955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fe259-af64-497e-9685-3dca7262e393 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:41.907242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fe259-af64-497e-9685-3dca7262e393 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:41.907356 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d323b-c6d4-441d-87aa-f4f37757ea4f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:41.907520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fe259-af64-497e-9685-3dca7262e393 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:41.907772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d323b-c6d4-441d-87aa-f4f37757ea4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:41.918703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d323b-c6d4-441d-87aa-f4f37757ea4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:41.919232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fe259-af64-497e-9685-3dca7262e393 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:41.920573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d323b-c6d4-441d-87aa-f4f37757ea4f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:41.920760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fe259-af64-497e-9685-3dca7262e393 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:41.936470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-586fe259-af64-497e-9685-3dca7262e393 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:07:41.936470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:41.936470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:41.936470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:41.936470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:41.936470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:41.936470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:41.936470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:41.936470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:41.936470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:41.936470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:41.936470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:41.936470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:41.936470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:41.936470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:41.936470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:41.937692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:41.937692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:41.937692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:41.937692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:41.937692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:41.937692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:41.937692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:41.937692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:41.937692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:41.937692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:41.937692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:41.937692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:41.937692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:41.937692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:41.937692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:41.937692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:41.937692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:41.937692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:41.939067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:41.939067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:41.939067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:41.939067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:41.939067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:41.939067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:41.939067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:41.939067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:41.939067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:07:41.939067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:41.946776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-eb1d323b-c6d4-441d-87aa-f4f37757ea4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:41.946776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:41.946776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:41.946776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:41.946776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:41.946776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:41.946776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:41.946776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:41.946776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:41.946776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:41.946776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:41.946776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:41.946776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:41.946776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:41.946776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:41.946776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:41.948668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:41.948668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:41.948668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:41.948668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:41.948668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:41.948668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:41.948668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:41.948668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:41.948668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:41.948668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:41.948668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:41.948668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:41.948668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:41.948668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:41.948668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:41.948668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:41.948668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:41.950607 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:41.950607 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:41.950607 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:41.950950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 396/798] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 27 04:07:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:41.950950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fe259-af64-497e-9685-3dca7262e393 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:41.951209 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 402/798] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:07:41.951209 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d323b-c6d4-441d-87aa-f4f37757ea4f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:41.960641 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:42.058304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fe259-af64-497e-9685-3dca7262e393 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:42.059274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d323b-c6d4-441d-87aa-f4f37757ea4f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:42.069461 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:42.102244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b12e33-2647-4472-a0ab-8dd6f1f5557c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:42.102984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b12e33-2647-4472-a0ab-8dd6f1f5557c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:42.103230 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd3658-4cbd-4dd0-a97b-2f5a82ec23a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:42.103373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b12e33-2647-4472-a0ab-8dd6f1f5557c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:42.103777 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b12e33-2647-4472-a0ab-8dd6f1f5557c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:42.104347 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd3658-4cbd-4dd0-a97b-2f5a82ec23a2 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:42.104780 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd3658-4cbd-4dd0-a97b-2f5a82ec23a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:42.105141 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd3658-4cbd-4dd0-a97b-2f5a82ec23a2 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:42.106178 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd3658-4cbd-4dd0-a97b-2f5a82ec23a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:42.106912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd3658-4cbd-4dd0-a97b-2f5a82ec23a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:42.108443 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd3658-4cbd-4dd0-a97b-2f5a82ec23a2 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:42.114938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b12e33-2647-4472-a0ab-8dd6f1f5557c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:42.120975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-e3b12e33-2647-4472-a0ab-8dd6f1f5557c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:42.120975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:42.120975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:42.120975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:42.120975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:42.120975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:42.120975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:42.120975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:42.120975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:42.120975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:42.120975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:42.120975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:42.120975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:42.120975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:42.120975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:42.120975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:42.122703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:42.122703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:42.122703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:42.122703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:42.122703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:42.122703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:42.122703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:42.122703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:42.122703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:42.122703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:42.122703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:42.122703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:42.122703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:42.122703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:42.122703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:42.122703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:42.124506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:42.124506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:42.124506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:42.124506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:42.124506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:42.124506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:42.124506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:42.124506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:42.124506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:42.124506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:42.124506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:42.124506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:42.134742 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 397/799] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:42.134742 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b12e33-2647-4472-a0ab-8dd6f1f5557c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:42.135109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 403/800] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 27 04:07:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:42.135109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd3658-4cbd-4dd0-a97b-2f5a82ec23a2 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:42.214942 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:42.247874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b12e33-2647-4472-a0ab-8dd6f1f5557c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:42.256093 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd3658-4cbd-4dd0-a97b-2f5a82ec23a2 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:42.284936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b8325-5bc2-4024-b2ee-ddb1289d36d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:42.285709 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b8325-5bc2-4024-b2ee-ddb1289d36d9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:42.285992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b8325-5bc2-4024-b2ee-ddb1289d36d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:42.286265 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b8325-5bc2-4024-b2ee-ddb1289d36d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:42.287597 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b8325-5bc2-4024-b2ee-ddb1289d36d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:42.288001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b8325-5bc2-4024-b2ee-ddb1289d36d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:42.289485 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b8325-5bc2-4024-b2ee-ddb1289d36d9 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:42.293472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa58359-ebef-4ca7-923d-5925ec1938bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:42.294087 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa58359-ebef-4ca7-923d-5925ec1938bb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:42.294367 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa58359-ebef-4ca7-923d-5925ec1938bb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:42.294637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa58359-ebef-4ca7-923d-5925ec1938bb None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:42.295332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa58359-ebef-4ca7-923d-5925ec1938bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:42.295635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa58359-ebef-4ca7-923d-5925ec1938bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:42.296980 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa58359-ebef-4ca7-923d-5925ec1938bb None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:42.303310 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 398/801] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:42.304175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b8325-5bc2-4024-b2ee-ddb1289d36d9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:42.310287 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 404/802] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:07:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:42.311157 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa58359-ebef-4ca7-923d-5925ec1938bb None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:42.343892 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:42.420418 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b8325-5bc2-4024-b2ee-ddb1289d36d9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:42.432339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa58359-ebef-4ca7-923d-5925ec1938bb None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:42.459085 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bd8a1-0d42-4316-88e5-dc91e6ac54eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:42.459705 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bd8a1-0d42-4316-88e5-dc91e6ac54eb None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:42.459991 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bd8a1-0d42-4316-88e5-dc91e6ac54eb None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:42.460267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bd8a1-0d42-4316-88e5-dc91e6ac54eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:42.464201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:42.474828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c09793-a0a2-4cd0-a391-e3f7c00abd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:42.475467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c09793-a0a2-4cd0-a391-e3f7c00abd2f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:42.475775 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c09793-a0a2-4cd0-a391-e3f7c00abd2f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:42.476134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c09793-a0a2-4cd0-a391-e3f7c00abd2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:42.484087 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c09793-a0a2-4cd0-a391-e3f7c00abd2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:42.485541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c09793-a0a2-4cd0-a391-e3f7c00abd2f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:42.498129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-b6c09793-a0a2-4cd0-a391-e3f7c00abd2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:42.498129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:42.498129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:42.498129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:42.498129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:42.498129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:42.498129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:42.498129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:42.498129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:42.498129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:42.498129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:42.498129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:42.498129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:42.498129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:42.498129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:42.499046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:42.499046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:42.499046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:42.499046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:42.499046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:42.499046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:42.499046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:42.499046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:42.499046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:42.499046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:42.499046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:42.499046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:42.499046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:42.499046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:42.499046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:42.499046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:42.499046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:42.504891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:42.504891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:42.504891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:42.504891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:42.504891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:42.504891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:42.504891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:42.504891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:42.504891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 405/803] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:42.504891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c09793-a0a2-4cd0-a391-e3f7c00abd2f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:42.536257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bd8a1-0d42-4316-88e5-dc91e6ac54eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:42.538048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bd8a1-0d42-4316-88e5-dc91e6ac54eb None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:42.572364 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:42.609070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c09793-a0a2-4cd0-a391-e3f7c00abd2f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:42.649876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2e160-872a-4c5f-a3fa-f4035a5b70b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:42.650841 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2e160-872a-4c5f-a3fa-f4035a5b70b2 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:42.651131 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2e160-872a-4c5f-a3fa-f4035a5b70b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:42.651413 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2e160-872a-4c5f-a3fa-f4035a5b70b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:42.657919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 399/804] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:07:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:07:42.657919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92b529-e785-4f3e-ab47-153f73c55ffc None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:42.657919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92b529-e785-4f3e-ab47-153f73c55ffc None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:42.657919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92b529-e785-4f3e-ab47-153f73c55ffc None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:42.657919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 400/805] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:42.657919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92b529-e785-4f3e-ab47-153f73c55ffc None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:42.671073 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2e160-872a-4c5f-a3fa-f4035a5b70b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:42.673201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2e160-872a-4c5f-a3fa-f4035a5b70b2 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:42.689260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-c9e2e160-872a-4c5f-a3fa-f4035a5b70b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:42.689260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:42.689260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:42.689260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:42.689260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:42.689260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:42.689260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:42.689260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:42.689260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:42.689260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:42.689260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:42.689260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:42.689260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:42.689260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:42.689260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:42.689260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:42.690201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:42.690201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:42.690201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:42.690201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:42.690201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:42.690201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:42.690201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:42.690201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:42.690201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:42.690201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:42.690201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:42.690201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:42.690201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:42.690201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:42.690201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:42.690201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:42.690201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:42.691663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:42.691663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:42.691663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:42.691663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 406/806] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:42.691663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2e160-872a-4c5f-a3fa-f4035a5b70b2 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:42.738264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:42.768886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92b529-e785-4f3e-ab47-153f73c55ffc None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:42.796000 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2e160-872a-4c5f-a3fa-f4035a5b70b2 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:42.797828 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:42.804672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc60fcf-07df-467a-875c-2514365d71d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:42.805288 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc60fcf-07df-467a-875c-2514365d71d7 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:42.805574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc60fcf-07df-467a-875c-2514365d71d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:42.805852 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc60fcf-07df-467a-875c-2514365d71d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:42.806586 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc60fcf-07df-467a-875c-2514365d71d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:42.806920 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc60fcf-07df-467a-875c-2514365d71d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:42.808363 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc60fcf-07df-467a-875c-2514365d71d7 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:42.819663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 401/807] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:42.820809 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d117543-7fed-4368-b707-f45086afa3c2 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:42.821101 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d117543-7fed-4368-b707-f45086afa3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:42.821385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d117543-7fed-4368-b707-f45086afa3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:42.829140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e4af0-6e16-45a5-b845-516a3775ed2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:42.829771 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e4af0-6e16-45a5-b845-516a3775ed2c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:42.830052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e4af0-6e16-45a5-b845-516a3775ed2c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:42.830327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e4af0-6e16-45a5-b845-516a3775ed2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:42.839401 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-0d117543-7fed-4368-b707-f45086afa3c2 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:42.840590 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0d117543-7fed-4368-b707-f45086afa3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:42.840762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e4af0-6e16-45a5-b845-516a3775ed2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:42.842198 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e4af0-6e16-45a5-b845-516a3775ed2c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:42.856988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-5a2e4af0-6e16-45a5-b845-516a3775ed2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:42.856988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:42.856988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:42.856988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:42.856988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:42.856988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:42.856988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:42.856988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:42.856988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:42.856988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:42.856988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:42.856988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:42.856988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:42.856988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:42.856988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:42.856988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:42.858160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:42.858160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:42.858160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:42.858160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:42.858160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:42.858160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:42.858160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:42.858160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:42.858160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:42.858160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:42.858160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:42.858160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:42.858160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:42.858160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:42.858160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:42.858160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:42.858160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:42.859408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:42.859408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:42.859408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:42.859408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 407/808] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:42.859408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e4af0-6e16-45a5-b845-516a3775ed2c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:42.908694 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 402/809] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:07:42.909853 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b6a3e-3837-4a19-83c6-eed005ad50bb None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:42.910140 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b6a3e-3837-4a19-83c6-eed005ad50bb None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:42.910413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b6a3e-3837-4a19-83c6-eed005ad50bb None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:42.914769 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 403/810] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:42.914769 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b6a3e-3837-4a19-83c6-eed005ad50bb None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:42.956834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:42.968340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e4af0-6e16-45a5-b845-516a3775ed2c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:43.005411 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c30f2b-f7e9-49d8-bfe4-c90f586d8b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:43.006023 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c30f2b-f7e9-49d8-bfe4-c90f586d8b4e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:43.006326 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c30f2b-f7e9-49d8-bfe4-c90f586d8b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:43.006571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c30f2b-f7e9-49d8-bfe4-c90f586d8b4e None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:43.007244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c30f2b-f7e9-49d8-bfe4-c90f586d8b4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:43.007594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c30f2b-f7e9-49d8-bfe4-c90f586d8b4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:43.008962 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c30f2b-f7e9-49d8-bfe4-c90f586d8b4e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:43.014969 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b6a3e-3837-4a19-83c6-eed005ad50bb None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:43.021718 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 408/811] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:43.022320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c30f2b-f7e9-49d8-bfe4-c90f586d8b4e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:43.041639 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:43.056058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e55576-30ff-42eb-b8e2-476d75ebce14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:43.056707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e55576-30ff-42eb-b8e2-476d75ebce14 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:43.056984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e55576-30ff-42eb-b8e2-476d75ebce14 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:43.057306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e55576-30ff-42eb-b8e2-476d75ebce14 None admin] PATH_INFO: `/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/c295a3063c3b45be96b406f586180142/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:43.059276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e55576-30ff-42eb-b8e2-476d75ebce14 None admin] RBAC: Authorizing `identity:create_grant(project_id=37e7a8d1446d4cdea0ba00124411cd93, user_id=c295a3063c3b45be96b406f586180142, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:43.060827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e55576-30ff-42eb-b8e2-476d75ebce14 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:43.074164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 404/812] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:07:42 2022] PUT /identity/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/c295a3063c3b45be96b406f586180142/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:07:43.075440 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b3fb4-44ca-430d-a16c-ab966a0f29dd None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:43.075728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b3fb4-44ca-430d-a16c-ab966a0f29dd None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:43.076001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b3fb4-44ca-430d-a16c-ab966a0f29dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:43.104994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a61b3fb4-44ca-430d-a16c-ab966a0f29dd None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:43.106905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a61b3fb4-44ca-430d-a16c-ab966a0f29dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:43.134929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c30f2b-f7e9-49d8-bfe4-c90f586d8b4e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:43.180419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43479c14-2a26-4900-9e57-40dae0df8a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:43.181573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43479c14-2a26-4900-9e57-40dae0df8a07 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:43.182117 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43479c14-2a26-4900-9e57-40dae0df8a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:43.182610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43479c14-2a26-4900-9e57-40dae0df8a07 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:43.183639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43479c14-2a26-4900-9e57-40dae0df8a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:43.184369 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43479c14-2a26-4900-9e57-40dae0df8a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:43.185907 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43479c14-2a26-4900-9e57-40dae0df8a07 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:43.210837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 405/813] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:07:43.210837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b3fb4-44ca-430d-a16c-ab966a0f29dd None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:43.211160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 409/814] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:43.211160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43479c14-2a26-4900-9e57-40dae0df8a07 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:43.237460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:43.329026 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b3fb4-44ca-430d-a16c-ab966a0f29dd None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:43.340449 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:43.352107 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43479c14-2a26-4900-9e57-40dae0df8a07 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:43.371428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da767bd-a8aa-4b8e-86ce-b191b04b54a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:43.372386 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da767bd-a8aa-4b8e-86ce-b191b04b54a5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:43.372820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da767bd-a8aa-4b8e-86ce-b191b04b54a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:43.373333 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da767bd-a8aa-4b8e-86ce-b191b04b54a5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:43.381704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da767bd-a8aa-4b8e-86ce-b191b04b54a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:43.383593 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da767bd-a8aa-4b8e-86ce-b191b04b54a5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:43.391115 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0fcca-05ab-4175-8e0c-07f4cb192305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:43.391788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0fcca-05ab-4175-8e0c-07f4cb192305 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:43.392019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0fcca-05ab-4175-8e0c-07f4cb192305 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:43.392293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0fcca-05ab-4175-8e0c-07f4cb192305 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:43.392932 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0fcca-05ab-4175-8e0c-07f4cb192305 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:43.394286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0fcca-05ab-4175-8e0c-07f4cb192305 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:43.398603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-7da767bd-a8aa-4b8e-86ce-b191b04b54a5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 04:07:43.398603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:43.398603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:43.398603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:43.398603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:43.398603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:43.398603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:43.398603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:43.398603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:43.398603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:43.398603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:43.398603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:43.398603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:43.398603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:43.398603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:43.398603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:43.399614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:43.399614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:43.399614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:43.399614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:43.399614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:43.399614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:43.399614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:43.399614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:43.399614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:43.399614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:43.399614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:43.399614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:43.399614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:43.399614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:43.399614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:43.399614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:43.399614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:43.399614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:43.400577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:43.400577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:43.400577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:43.400577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:43.400577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:43.400577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:43.400577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:43.400577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:43.400577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 04:07:43.400577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:43.403111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 406/815] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 27 04:07:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:43.404154 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da767bd-a8aa-4b8e-86ce-b191b04b54a5 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:43.413752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-2bc0fcca-05ab-4175-8e0c-07f4cb192305 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 04:07:43.413752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:43.413752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:07:43.413752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:07:43.413752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:07:43.413752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:07:43.413752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:07:43.413752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:43.413752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 04:07:43.413752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:43.413752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:07:43.413752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:43.413752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:43.413752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:43.413752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:43.413752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:43.413752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:43.414790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:43.414790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:43.414790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:43.414790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:43.414790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:43.414790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:43.414790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:07:43.414790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:07:43.414790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:07:43.414790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:07:43.414790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:43.414790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:43.414790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:43.414790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:43.414790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:43.414790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:43.415687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:43.415687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:43.415687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:43.415687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:43.415687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:43.415687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:43.415687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:43.415687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:43.415687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:43.415687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:43.415687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:07:43.415687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:43.415687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 04:07:43.415687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:43.415687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 410/816] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Sep 27 04:07:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:43.416496 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0fcca-05ab-4175-8e0c-07f4cb192305 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:43.502379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:43.526110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0fcca-05ab-4175-8e0c-07f4cb192305 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:43.538483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da767bd-a8aa-4b8e-86ce-b191b04b54a5 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:43.562398 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6da076-ae8c-4aa8-b678-1211f758d914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:43.563034 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6da076-ae8c-4aa8-b678-1211f758d914 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:43.563318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6da076-ae8c-4aa8-b678-1211f758d914 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:43.563593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6da076-ae8c-4aa8-b678-1211f758d914 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:43.564332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6da076-ae8c-4aa8-b678-1211f758d914 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:43.564643 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6da076-ae8c-4aa8-b678-1211f758d914 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:43.566080 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6da076-ae8c-4aa8-b678-1211f758d914 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:43.582873 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbe3e9-43df-4b36-ad29-6b4eb21f298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:43.583775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbe3e9-43df-4b36-ad29-6b4eb21f298b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:43.584068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbe3e9-43df-4b36-ad29-6b4eb21f298b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:43.584424 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbe3e9-43df-4b36-ad29-6b4eb21f298b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:43.590818 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 411/817] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Sep 27 04:07:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:43.590818 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6da076-ae8c-4aa8-b678-1211f758d914 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:43.598130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbe3e9-43df-4b36-ad29-6b4eb21f298b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:43.600239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbe3e9-43df-4b36-ad29-6b4eb21f298b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:43.612011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-0fbbe3e9-43df-4b36-ad29-6b4eb21f298b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:43.612011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:43.612011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:43.612011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:43.612011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:43.612011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:43.612011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:43.612011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:43.612011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:43.612011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:43.612011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:43.612011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:43.612011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:43.612011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:43.612011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:43.612938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:43.612938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:43.612938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:43.612938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:43.612938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:43.612938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:43.612938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:43.612938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:43.612938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:43.612938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:43.612938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:43.612938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:43.612938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:43.612938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:43.612938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:43.612938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:43.612938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:43.613842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:43.613842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:43.613842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:43.613842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:43.613842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:43.613842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:43.613842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:43.613842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:43.613842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 407/818] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:43.614337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbe3e9-43df-4b36-ad29-6b4eb21f298b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:43.647213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:43.699137 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6da076-ae8c-4aa8-b678-1211f758d914 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:43.725593 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbe3e9-43df-4b36-ad29-6b4eb21f298b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:43.735921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de88ca-b408-472b-bb85-67b08f76b335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:43.736516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de88ca-b408-472b-bb85-67b08f76b335 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:43.737114 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de88ca-b408-472b-bb85-67b08f76b335 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:43.737457 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de88ca-b408-472b-bb85-67b08f76b335 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:43.738090 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de88ca-b408-472b-bb85-67b08f76b335 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:43.738396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de88ca-b408-472b-bb85-67b08f76b335 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:43.739829 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de88ca-b408-472b-bb85-67b08f76b335 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:43.740908 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:43.747422 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 412/819] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Sep 27 04:07:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:43.748211 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de88ca-b408-472b-bb85-67b08f76b335 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:43.766146 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db09d42-798f-4e09-8475-1b650338c236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:43.766701 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db09d42-798f-4e09-8475-1b650338c236 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:43.767008 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db09d42-798f-4e09-8475-1b650338c236 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:43.767595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db09d42-798f-4e09-8475-1b650338c236 None admin] PATH_INFO: `/v3/services/network` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:43.768110 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db09d42-798f-4e09-8475-1b650338c236 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:43.769476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db09d42-798f-4e09-8475-1b650338c236 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:43.778657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-2db09d42-798f-4e09-8475-1b650338c236 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 04:07:43.778657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:43.778657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:07:43.778657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:07:43.778657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:07:43.778657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:07:43.778657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:07:43.778657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:43.778657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 04:07:43.778657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:43.778657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:07:43.778657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:43.778657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:43.778657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:43.778657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:43.778657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:43.778657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:43.779683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:43.779683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:43.779683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:43.779683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:43.779683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:43.779683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:43.779683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:07:43.779683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:07:43.779683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:07:43.779683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:07:43.779683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:43.779683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:43.779683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:43.779683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:43.779683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:43.779683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:43.780552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:43.780552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:43.780552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:43.780552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:43.780552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:43.780552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:43.780552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:43.780552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:43.780552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:43.780552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:43.780552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:07:43.780552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:43.780552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 04:07:43.780552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:43.780552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 408/820] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:43 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:43.781384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db09d42-798f-4e09-8475-1b650338c236 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:43.858352 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de88ca-b408-472b-bb85-67b08f76b335 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:43.883373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:43.891652 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db09d42-798f-4e09-8475-1b650338c236 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:43.893141 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae859c-8ba0-4aff-b4b5-3d3e55252d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:43.893774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae859c-8ba0-4aff-b4b5-3d3e55252d8b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:43.894059 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae859c-8ba0-4aff-b4b5-3d3e55252d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:43.894332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae859c-8ba0-4aff-b4b5-3d3e55252d8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:43.904884 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae859c-8ba0-4aff-b4b5-3d3e55252d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:43.906319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae859c-8ba0-4aff-b4b5-3d3e55252d8b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:43.920351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-0fae859c-8ba0-4aff-b4b5-3d3e55252d8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:43.920351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:43.920351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:43.920351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:43.920351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:43.920351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:43.920351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:43.920351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:43.920351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:43.920351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:43.920351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:43.920351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:43.920351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:43.920351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:43.920351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:43.920351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:43.921303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:43.921303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:43.921303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:43.921303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:43.921303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:43.921303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:43.921303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:43.921303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:43.921303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:43.921303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:43.921303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:43.921303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:43.921303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:43.921303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:43.921303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:43.921303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:43.921303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:43.922189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:43.922189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:43.922189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:43.922189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 413/821] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:43.922189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae859c-8ba0-4aff-b4b5-3d3e55252d8b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:43.932538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432bc56-3b8a-4e15-a6c7-0ed03fa3544d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:43.933402 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432bc56-3b8a-4e15-a6c7-0ed03fa3544d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:43.933880 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432bc56-3b8a-4e15-a6c7-0ed03fa3544d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:43.934326 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432bc56-3b8a-4e15-a6c7-0ed03fa3544d None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:43.935369 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432bc56-3b8a-4e15-a6c7-0ed03fa3544d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:43.935853 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432bc56-3b8a-4e15-a6c7-0ed03fa3544d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:43.937569 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432bc56-3b8a-4e15-a6c7-0ed03fa3544d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:43.950787 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 409/822] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:43.951858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432bc56-3b8a-4e15-a6c7-0ed03fa3544d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:43.981948 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:44.034065 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae859c-8ba0-4aff-b4b5-3d3e55252d8b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:44.061575 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432bc56-3b8a-4e15-a6c7-0ed03fa3544d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:44.069694 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30d368-c53c-4074-96c4-a2bf620d824f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:44.070299 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30d368-c53c-4074-96c4-a2bf620d824f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:44.070618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30d368-c53c-4074-96c4-a2bf620d824f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:44.070885 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30d368-c53c-4074-96c4-a2bf620d824f None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:44.071521 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30d368-c53c-4074-96c4-a2bf620d824f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:44.071834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30d368-c53c-4074-96c4-a2bf620d824f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:44.073197 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30d368-c53c-4074-96c4-a2bf620d824f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:44.077858 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 414/823] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Sep 27 04:07:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:44.078699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30d368-c53c-4074-96c4-a2bf620d824f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:44.101672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fc7a5-b9bd-41d9-8082-72e5d1d722cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:44.102278 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fc7a5-b9bd-41d9-8082-72e5d1d722cf None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:44.102564 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fc7a5-b9bd-41d9-8082-72e5d1d722cf None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:44.102878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fc7a5-b9bd-41d9-8082-72e5d1d722cf None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:44.103785 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96fc7a5-b9bd-41d9-8082-72e5d1d722cf None admin] RBAC: Adding query filter params (name=network) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:44.104091 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96fc7a5-b9bd-41d9-8082-72e5d1d722cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:44.105448 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96fc7a5-b9bd-41d9-8082-72e5d1d722cf None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:44.109755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 410/824] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 27 04:07:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:44.110525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fc7a5-b9bd-41d9-8082-72e5d1d722cf None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:44.133113 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:44.190626 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30d368-c53c-4074-96c4-a2bf620d824f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:44.206094 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:44.221799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fc7a5-b9bd-41d9-8082-72e5d1d722cf None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:44.230529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922cadd-689e-4fd3-8b53-657a0c42b25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:44.231194 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922cadd-689e-4fd3-8b53-657a0c42b25e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:44.231484 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922cadd-689e-4fd3-8b53-657a0c42b25e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:44.231766 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922cadd-689e-4fd3-8b53-657a0c42b25e None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:44.232475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922cadd-689e-4fd3-8b53-657a0c42b25e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:44.232787 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922cadd-689e-4fd3-8b53-657a0c42b25e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:44.235249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922cadd-689e-4fd3-8b53-657a0c42b25e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:44.250263 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 415/825] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:44.251609 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922cadd-689e-4fd3-8b53-657a0c42b25e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:44.269134 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe91ea4-8a01-4444-859e-be0f115f6cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:44.270685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe91ea4-8a01-4444-859e-be0f115f6cfd None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:44.271436 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe91ea4-8a01-4444-859e-be0f115f6cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:44.272215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe91ea4-8a01-4444-859e-be0f115f6cfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:44.273588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe91ea4-8a01-4444-859e-be0f115f6cfd None admin] RBAC: Adding query filter params (role.id=2613cf4a98d44744a094c7782b19b4b5, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=3960d52dee8443cf9ec8930a389a7b60) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:44.274089 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe91ea4-8a01-4444-859e-be0f115f6cfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:44.276686 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe91ea4-8a01-4444-859e-be0f115f6cfd None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:44.286058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 411/826] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:07:44 2022] GET /identity/v3/role_assignments?user.id=3960d52dee8443cf9ec8930a389a7b60&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:44.287799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe91ea4-8a01-4444-859e-be0f115f6cfd None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:44.377317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922cadd-689e-4fd3-8b53-657a0c42b25e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:44.421320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9112e93-d805-4fb5-bc3f-c8cc60dd0107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:44.422053 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9112e93-d805-4fb5-bc3f-c8cc60dd0107 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:44.422425 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9112e93-d805-4fb5-bc3f-c8cc60dd0107 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:44.422804 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9112e93-d805-4fb5-bc3f-c8cc60dd0107 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:44.423555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9112e93-d805-4fb5-bc3f-c8cc60dd0107 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:44.425024 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9112e93-d805-4fb5-bc3f-c8cc60dd0107 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:44.429316 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:44.457355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe91ea4-8a01-4444-859e-be0f115f6cfd None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:44.457612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 416/827] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:07:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:07:44.459245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9112e93-d805-4fb5-bc3f-c8cc60dd0107 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:44.496315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:44.533913 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee46d42-d3e1-4a7d-96bf-0fcd78322f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:44.534775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee46d42-d3e1-4a7d-96bf-0fcd78322f0f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:44.534968 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee46d42-d3e1-4a7d-96bf-0fcd78322f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:44.535251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee46d42-d3e1-4a7d-96bf-0fcd78322f0f None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:44.535984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee46d42-d3e1-4a7d-96bf-0fcd78322f0f None admin] RBAC: Adding query filter params (type=network) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:44.536264 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee46d42-d3e1-4a7d-96bf-0fcd78322f0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:44.538375 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee46d42-d3e1-4a7d-96bf-0fcd78322f0f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:44.546494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 412/828] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 27 04:07:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:44.553088 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee46d42-d3e1-4a7d-96bf-0fcd78322f0f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:44.586492 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9112e93-d805-4fb5-bc3f-c8cc60dd0107 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:44.633077 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a3b3a-fc03-4ca1-8df4-b5b8a00e43f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:44.634485 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a3b3a-fc03-4ca1-8df4-b5b8a00e43f3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:44.635220 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a3b3a-fc03-4ca1-8df4-b5b8a00e43f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:44.635658 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a3b3a-fc03-4ca1-8df4-b5b8a00e43f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:44.644957 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a3b3a-fc03-4ca1-8df4-b5b8a00e43f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:44.647297 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a3b3a-fc03-4ca1-8df4-b5b8a00e43f3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:44.663029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-bb6a3b3a-fc03-4ca1-8df4-b5b8a00e43f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:44.663029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:44.663029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:44.663029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:44.663029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:44.663029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:44.663029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:44.663029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:44.663029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:44.663029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:44.663029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:44.663029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:44.663029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:44.663029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:44.663029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:44.664186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:44.664186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:44.664186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:44.664186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:44.664186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:44.664186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:44.664186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:44.664186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:44.664186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:44.664186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:44.664186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:44.664186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:44.664186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:44.664186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:44.664186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:44.664186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:44.664186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:44.665378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:44.665378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:44.665378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:44.665378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:44.665378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:44.665378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:44.665378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:44.665378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:44.667989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 417/829] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:44.675357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a3b3a-fc03-4ca1-8df4-b5b8a00e43f3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:44.689639 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee46d42-d3e1-4a7d-96bf-0fcd78322f0f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:44.730497 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9e690-7e27-497b-88ec-1a55ff6f13b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:44.730497 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9e690-7e27-497b-88ec-1a55ff6f13b6 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:44.730801 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9e690-7e27-497b-88ec-1a55ff6f13b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:44.730995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9e690-7e27-497b-88ec-1a55ff6f13b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:44.731842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9e690-7e27-497b-88ec-1a55ff6f13b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:44.733305 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9e690-7e27-497b-88ec-1a55ff6f13b6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:44.759296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:44.772618 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 413/830] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:07:44 2022] POST /identity/v3/endpoints => generated 337 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:07:44.800154 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:44.812318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a3b3a-fc03-4ca1-8df4-b5b8a00e43f3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:44.863463 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4b381-cdb1-494a-ad11-5c7f3d9fcf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:44.864529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4b381-cdb1-494a-ad11-5c7f3d9fcf63 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:44.865056 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4b381-cdb1-494a-ad11-5c7f3d9fcf63 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:44.865544 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4b381-cdb1-494a-ad11-5c7f3d9fcf63 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:44.866484 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4b381-cdb1-494a-ad11-5c7f3d9fcf63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:44.867039 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4b381-cdb1-494a-ad11-5c7f3d9fcf63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:44.868761 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4b381-cdb1-494a-ad11-5c7f3d9fcf63 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:44.893085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 418/831] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:07:44.899589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9e690-7e27-497b-88ec-1a55ff6f13b6 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:45.055630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9e690-7e27-497b-88ec-1a55ff6f13b6 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:45.093786 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ea968-1e08-42ed-9e17-5398365a5fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:45.094926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ea968-1e08-42ed-9e17-5398365a5fc7 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:45.095437 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ea968-1e08-42ed-9e17-5398365a5fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:45.095917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ea968-1e08-42ed-9e17-5398365a5fc7 None admin] PATH_INFO: `/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/71c7a54c598642a4b9219ae21c34f0b0/roles/e62613bfe0e143abbc25d60ea42a4416` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:45.112049 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ea968-1e08-42ed-9e17-5398365a5fc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=37e7a8d1446d4cdea0ba00124411cd93, user_id=71c7a54c598642a4b9219ae21c34f0b0, role_id=e62613bfe0e143abbc25d60ea42a4416)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:45.113848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ea968-1e08-42ed-9e17-5398365a5fc7 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:45.129695 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 414/832] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:07:44 2022] PUT /identity/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/71c7a54c598642a4b9219ae21c34f0b0/roles/e62613bfe0e143abbc25d60ea42a4416 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:07:45.379759 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c73673-e9db-47d0-b96c-4dbef8677ca1 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:45.381189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c73673-e9db-47d0-b96c-4dbef8677ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:45.381472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c73673-e9db-47d0-b96c-4dbef8677ca1 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:45.383520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 419/833] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:45.388605 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f2c1d-d229-4d0d-a385-20acac2aca97 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:45.389149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f2c1d-d229-4d0d-a385-20acac2aca97 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:45.389631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f2c1d-d229-4d0d-a385-20acac2aca97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:45.411135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1c2f2c1d-d229-4d0d-a385-20acac2aca97 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:45.412625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1c2f2c1d-d229-4d0d-a385-20acac2aca97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:45.457783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:45.484512 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 415/834] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:07:45.751932 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c73673-e9db-47d0-b96c-4dbef8677ca1 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:45.855045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c73673-e9db-47d0-b96c-4dbef8677ca1 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:45.890236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9fe63-8808-40d0-88e3-c8bf54ef4eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:45.890974 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9fe63-8808-40d0-88e3-c8bf54ef4eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:45.891256 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9fe63-8808-40d0-88e3-c8bf54ef4eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:45.891568 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9fe63-8808-40d0-88e3-c8bf54ef4eb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:45.905196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9fe63-8808-40d0-88e3-c8bf54ef4eb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:45.910190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-66d9fe63-8808-40d0-88e3-c8bf54ef4eb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:07:45.910190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:45.910190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:45.910190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:45.910190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:45.910190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:45.910190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:45.910190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:45.910190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:45.910190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:45.910190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:45.910190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:45.910190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:45.910190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:45.910190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:45.910190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:45.911191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:45.911191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:45.911191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:45.911191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:45.911191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:45.911191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:45.911191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:45.911191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:45.911191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:45.911191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:45.911191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:45.911191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:45.911191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:45.911191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:45.911191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:45.911191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:45.912593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:45.912593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:45.912593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:45.912593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:45.912593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:45.912593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:45.912593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:45.912593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:45.912593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:45.912593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:45.912593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:07:45.912593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:45.912593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 420/835] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:07:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:45.917817 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f2c1d-d229-4d0d-a385-20acac2aca97 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:46.017966 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f2c1d-d229-4d0d-a385-20acac2aca97 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:46.053087 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b091fa-e6bd-410e-8b9e-62ca5d7df163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:46.053699 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b091fa-e6bd-410e-8b9e-62ca5d7df163 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:46.053979 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b091fa-e6bd-410e-8b9e-62ca5d7df163 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:46.054253 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b091fa-e6bd-410e-8b9e-62ca5d7df163 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:46.054951 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b091fa-e6bd-410e-8b9e-62ca5d7df163 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:46.055259 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b091fa-e6bd-410e-8b9e-62ca5d7df163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:46.056694 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b091fa-e6bd-410e-8b9e-62ca5d7df163 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:46.065395 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 416/836] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:07:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:46.071236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9fe63-8808-40d0-88e3-c8bf54ef4eb3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:46.080711 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:46.179790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9fe63-8808-40d0-88e3-c8bf54ef4eb3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:46.218653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6e3f1-5ae0-4f0f-95aa-ed07082be464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:46.219498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6e3f1-5ae0-4f0f-95aa-ed07082be464 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:46.219777 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6e3f1-5ae0-4f0f-95aa-ed07082be464 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:46.220046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6e3f1-5ae0-4f0f-95aa-ed07082be464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:46.231688 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6e3f1-5ae0-4f0f-95aa-ed07082be464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:46.233136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6e3f1-5ae0-4f0f-95aa-ed07082be464 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:46.247874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-7bd6e3f1-5ae0-4f0f-95aa-ed07082be464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:46.247874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:46.247874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:46.247874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:46.247874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:46.247874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:46.247874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:46.247874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:46.247874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:46.247874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:46.247874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:46.247874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:46.247874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:46.247874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:46.247874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:46.247874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:46.248847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:46.248847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:46.248847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:46.248847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:46.248847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:46.248847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:46.248847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:46.248847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:46.248847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:46.248847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:46.248847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:46.248847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:46.248847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:46.248847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:46.248847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:46.248847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:46.248847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:46.249758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:46.249758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:46.249758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:46.249758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 421/837] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:46.254729 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b091fa-e6bd-410e-8b9e-62ca5d7df163 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:46.297464 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:46.360392 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b091fa-e6bd-410e-8b9e-62ca5d7df163 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:46.407219 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464c16b-d43e-4396-a7b2-131ac465c85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:46.408054 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464c16b-d43e-4396-a7b2-131ac465c85b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:46.408493 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464c16b-d43e-4396-a7b2-131ac465c85b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:46.408919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464c16b-d43e-4396-a7b2-131ac465c85b None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:46.409728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464c16b-d43e-4396-a7b2-131ac465c85b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:46.410187 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464c16b-d43e-4396-a7b2-131ac465c85b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:46.411786 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464c16b-d43e-4396-a7b2-131ac465c85b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:46.425044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 417/838] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:46.430753 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6e3f1-5ae0-4f0f-95aa-ed07082be464 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:46.494692 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:46.538914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6e3f1-5ae0-4f0f-95aa-ed07082be464 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:46.575609 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3918710-1302-47ef-afb8-ca96c1109f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:46.576134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3918710-1302-47ef-afb8-ca96c1109f93 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:46.576423 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3918710-1302-47ef-afb8-ca96c1109f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:46.576702 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3918710-1302-47ef-afb8-ca96c1109f93 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:46.585127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3918710-1302-47ef-afb8-ca96c1109f93 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:46.586572 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3918710-1302-47ef-afb8-ca96c1109f93 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:46.599817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-a3918710-1302-47ef-afb8-ca96c1109f93 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 04:07:46.599817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:46.599817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:46.599817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:46.599817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:46.599817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:46.599817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:46.599817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:46.599817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:46.599817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:46.599817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:46.599817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:46.599817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:46.599817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:46.599817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:46.599817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:46.600797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:46.600797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:46.600797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:46.600797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:46.600797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:46.600797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:46.600797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:46.600797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:46.600797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:46.600797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:46.600797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:46.600797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:46.600797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:46.600797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:46.600797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:46.600797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:46.600797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:46.600797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:46.602518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:46.602518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:46.602518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:46.602518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:46.602518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:46.602518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:46.602518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:46.602518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:46.602518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 27 04:07:46.602518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:46.602518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 422/839] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:07:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:46.607168 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464c16b-d43e-4396-a7b2-131ac465c85b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:46.707621 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:46.710955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464c16b-d43e-4396-a7b2-131ac465c85b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:46.748514 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7ecd5-680d-4f9d-9589-139f42401fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:46.749119 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7ecd5-680d-4f9d-9589-139f42401fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:46.749398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7ecd5-680d-4f9d-9589-139f42401fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:46.749671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7ecd5-680d-4f9d-9589-139f42401fd4 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:46.750400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7ecd5-680d-4f9d-9589-139f42401fd4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:46.750708 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7ecd5-680d-4f9d-9589-139f42401fd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:46.752156 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7ecd5-680d-4f9d-9589-139f42401fd4 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:46.769915 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 418/840] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Sep 27 04:07:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:46.776107 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3918710-1302-47ef-afb8-ca96c1109f93 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:46.885613 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3918710-1302-47ef-afb8-ca96c1109f93 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:46.903703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:46.928905 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5947780-92da-43c6-9453-4fa13482a8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:46.929533 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5947780-92da-43c6-9453-4fa13482a8bb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:46.929811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5947780-92da-43c6-9453-4fa13482a8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:46.930289 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5947780-92da-43c6-9453-4fa13482a8bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:46.948268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137714c-e52c-4f01-8ba0-9985c8e5af4e None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:46.948579 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137714c-e52c-4f01-8ba0-9985c8e5af4e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:46.948820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137714c-e52c-4f01-8ba0-9985c8e5af4e None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:46.951152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 419/841] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:46.956530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448b60c-1750-4ced-8a07-246e38f0b89d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:46.956825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448b60c-1750-4ced-8a07-246e38f0b89d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:46.957106 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448b60c-1750-4ced-8a07-246e38f0b89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:46.978187 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-7448b60c-1750-4ced-8a07-246e38f0b89d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:46.980324 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7448b60c-1750-4ced-8a07-246e38f0b89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:47.010261 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5947780-92da-43c6-9453-4fa13482a8bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:47.011837 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5947780-92da-43c6-9453-4fa13482a8bb None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:47.065278 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 420/842] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:07:47.065278 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2592d-155c-4c4d-adca-f62f1aee4b57 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:47.065278 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2592d-155c-4c4d-adca-f62f1aee4b57 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:47.065278 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2592d-155c-4c4d-adca-f62f1aee4b57 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:47.066393 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 421/843] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:47.067563 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f837ca2-9968-4c8f-9f41-50b13db4e603 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:47.068417 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f837ca2-9968-4c8f-9f41-50b13db4e603 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:47.068713 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f837ca2-9968-4c8f-9f41-50b13db4e603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:47.087613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-2f837ca2-9968-4c8f-9f41-50b13db4e603 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:47.088910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2f837ca2-9968-4c8f-9f41-50b13db4e603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:47.127634 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 423/844] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:07:46 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:07:47.134494 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5947780-92da-43c6-9453-4fa13482a8bb None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:47.154524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:47.170497 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 422/845] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:07:47.252076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5947780-92da-43c6-9453-4fa13482a8bb None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:47.288889 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf7637-c706-45f0-8a89-7aa390edc58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:47.289616 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf7637-c706-45f0-8a89-7aa390edc58b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:47.289898 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf7637-c706-45f0-8a89-7aa390edc58b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:47.290168 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf7637-c706-45f0-8a89-7aa390edc58b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:47.304610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf7637-c706-45f0-8a89-7aa390edc58b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:47.306061 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf7637-c706-45f0-8a89-7aa390edc58b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:47.321493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-ffaf7637-c706-45f0-8a89-7aa390edc58b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:47.321493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:47.321493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:47.321493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:47.321493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:47.321493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:47.321493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:47.321493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:47.321493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:47.321493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:47.321493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:47.321493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:47.321493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:47.321493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:47.321493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:47.321493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:47.322460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:47.322460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:47.322460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:47.322460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:47.322460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:47.322460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:47.322460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:47.322460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:47.322460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:47.322460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:47.322460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:47.322460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:47.322460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:47.322460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:47.322460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:47.322460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:47.322460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:47.323443 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:47.323443 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:47.323443 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:47.323443 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 424/846] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:47.328842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f837ca2-9968-4c8f-9f41-50b13db4e603 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:47.345204 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf7637-c706-45f0-8a89-7aa390edc58b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:47.353806 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:47.459569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf7637-c706-45f0-8a89-7aa390edc58b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:47.463052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:47.474264 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f837ca2-9968-4c8f-9f41-50b13db4e603 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:47.496250 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84ba7a-7251-441c-9b47-c067d0b0d6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:47.496884 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84ba7a-7251-441c-9b47-c067d0b0d6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:47.497164 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84ba7a-7251-441c-9b47-c067d0b0d6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:47.497438 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84ba7a-7251-441c-9b47-c067d0b0d6b7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:47.498023 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84ba7a-7251-441c-9b47-c067d0b0d6b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:47.499401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84ba7a-7251-441c-9b47-c067d0b0d6b7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:47.508645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-0a84ba7a-7251-441c-9b47-c067d0b0d6b7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 04:07:47.508645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:47.508645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:07:47.508645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:07:47.508645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:07:47.508645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:07:47.508645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:07:47.508645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:47.508645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 04:07:47.508645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:47.508645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:07:47.508645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:47.508645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:47.508645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:47.508645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:47.508645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:47.509800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:47.509800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:47.509800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:47.509800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:47.509800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:47.509800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:47.509800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:47.509800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:07:47.509800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:07:47.509800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:07:47.509800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:07:47.509800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:47.509800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:47.509800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:47.509800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:47.509800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:47.509800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:47.510707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:47.510707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:47.510707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:47.510707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:47.510707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:47.510707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:47.510707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:47.510707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:47.510707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:47.510707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:47.510707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:07:47.510707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:47.510707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 04:07:47.510707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:47.510707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 425/847] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Sep 27 04:07:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:07:47.511555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93fd2d-ec5a-4634-bec9-e3e5c73b33cd None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:47.511555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93fd2d-ec5a-4634-bec9-e3e5c73b33cd None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:47.511555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93fd2d-ec5a-4634-bec9-e3e5c73b33cd None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:47.512852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 426/848] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:47.513454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93fd2d-ec5a-4634-bec9-e3e5c73b33cd None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:47.515106 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801a1cd-6e84-4fa8-8db7-b0da3a59d5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:47.515744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801a1cd-6e84-4fa8-8db7-b0da3a59d5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:47.516222 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801a1cd-6e84-4fa8-8db7-b0da3a59d5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:47.516509 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801a1cd-6e84-4fa8-8db7-b0da3a59d5b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:47.518223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801a1cd-6e84-4fa8-8db7-b0da3a59d5b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:47.518540 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801a1cd-6e84-4fa8-8db7-b0da3a59d5b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:47.519964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801a1cd-6e84-4fa8-8db7-b0da3a59d5b6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:47.532456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 423/849] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:47.533255 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801a1cd-6e84-4fa8-8db7-b0da3a59d5b6 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:47.610748 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:47.626769 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93fd2d-ec5a-4634-bec9-e3e5c73b33cd None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:47.635475 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801a1cd-6e84-4fa8-8db7-b0da3a59d5b6 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:47.660620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9c3ea-1c62-4383-856f-7074d7141541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:47.661245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9c3ea-1c62-4383-856f-7074d7141541 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:47.661526 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9c3ea-1c62-4383-856f-7074d7141541 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:47.661805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9c3ea-1c62-4383-856f-7074d7141541 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:47.662389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9c3ea-1c62-4383-856f-7074d7141541 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:47.663787 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9c3ea-1c62-4383-856f-7074d7141541 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:47.665488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:47.668891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c0538-4c15-4512-9ab0-090fc7947c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:47.669495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c0538-4c15-4512-9ab0-090fc7947c5b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:47.669783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c0538-4c15-4512-9ab0-090fc7947c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:47.670062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c0538-4c15-4512-9ab0-090fc7947c5b None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:47.670701 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c0538-4c15-4512-9ab0-090fc7947c5b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:47.671040 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c0538-4c15-4512-9ab0-090fc7947c5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:47.672413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c0538-4c15-4512-9ab0-090fc7947c5b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:47.673699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-9ae9c3ea-1c62-4383-856f-7074d7141541 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 04:07:47.673699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:47.673699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:07:47.673699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:07:47.673699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:07:47.673699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:07:47.673699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:07:47.673699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:47.673699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 04:07:47.673699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:47.673699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:07:47.673699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:47.673699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:47.673699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:47.673699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:47.673699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:47.673699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:47.674900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:47.674900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:47.674900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:47.674900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:47.674900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:47.674900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:47.674900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:07:47.674900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:07:47.674900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:07:47.674900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:07:47.674900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:47.674900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:47.674900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:47.674900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:47.674900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:47.674900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:47.675950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:47.675950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:47.675950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:47.675950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:47.675950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:47.675950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:47.675950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:47.675950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:47.675950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:47.675950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:47.675950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:07:47.675950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:47.675950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 04:07:47.675950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:47.677636 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 424/850] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 27 04:07:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:47.678702 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6f5d2-5da7-4aa9-8b5c-210a672c1636 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:47.679013 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6f5d2-5da7-4aa9-8b5c-210a672c1636 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:47.679291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6f5d2-5da7-4aa9-8b5c-210a672c1636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:47.680419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 427/851] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:07:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:47.681313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9c3ea-1c62-4383-856f-7074d7141541 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:47.697026 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-bdf6f5d2-5da7-4aa9-8b5c-210a672c1636 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:47.698211 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-bdf6f5d2-5da7-4aa9-8b5c-210a672c1636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:47.763060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 425/852] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:07:47.763813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6f5d2-5da7-4aa9-8b5c-210a672c1636 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:47.780797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9c3ea-1c62-4383-856f-7074d7141541 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:47.815062 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76eafc7-d6a4-4f6e-9a6b-b8103a374cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:47.815690 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eafc7-d6a4-4f6e-9a6b-b8103a374cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:47.815974 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eafc7-d6a4-4f6e-9a6b-b8103a374cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:47.816253 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eafc7-d6a4-4f6e-9a6b-b8103a374cd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:47.823458 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76eafc7-d6a4-4f6e-9a6b-b8103a374cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:47.824901 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76eafc7-d6a4-4f6e-9a6b-b8103a374cd3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:47.834931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:47.835979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-a76eafc7-d6a4-4f6e-9a6b-b8103a374cd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:47.835979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:47.835979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:47.835979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:47.835979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:47.835979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:47.835979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:47.835979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:47.835979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:47.835979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:47.835979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:47.835979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:47.835979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:47.835979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:47.835979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:47.836872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:47.836872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:47.836872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:47.836872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:47.836872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:47.836872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:47.836872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:47.836872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:47.836872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:47.836872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:47.836872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:47.836872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:47.836872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:47.836872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:47.836872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:47.836872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:47.836872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:47.837754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:47.837754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:47.837754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:47.837754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:47.837754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:47.837754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:47.837754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:47.837754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:47.837754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 428/853] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:47.838241 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76eafc7-d6a4-4f6e-9a6b-b8103a374cd3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:47.870550 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6f5d2-5da7-4aa9-8b5c-210a672c1636 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:47.905395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:47.908692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cafc8-8522-4102-9ecb-91f87fa44911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:47.909315 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cafc8-8522-4102-9ecb-91f87fa44911 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:47.909591 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cafc8-8522-4102-9ecb-91f87fa44911 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:47.909867 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cafc8-8522-4102-9ecb-91f87fa44911 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:47.910512 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cafc8-8522-4102-9ecb-91f87fa44911 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:47.910847 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cafc8-8522-4102-9ecb-91f87fa44911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:47.912734 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cafc8-8522-4102-9ecb-91f87fa44911 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:47.918011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 426/854] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:07:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:47.918860 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cafc8-8522-4102-9ecb-91f87fa44911 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:47.960411 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76eafc7-d6a4-4f6e-9a6b-b8103a374cd3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:47.997701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5ab00-a43c-422c-82e6-10729537206a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:47.998300 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5ab00-a43c-422c-82e6-10729537206a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:47.999029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5ab00-a43c-422c-82e6-10729537206a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:47.999319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5ab00-a43c-422c-82e6-10729537206a None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:47.999954 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5ab00-a43c-422c-82e6-10729537206a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:48.000601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5ab00-a43c-422c-82e6-10729537206a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:48.002287 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5ab00-a43c-422c-82e6-10729537206a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:48.007452 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 429/855] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 27 04:07:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:48.008227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5ab00-a43c-422c-82e6-10729537206a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:48.044347 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cafc8-8522-4102-9ecb-91f87fa44911 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:48.081723 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965c440-c1bd-4f34-9bd6-2f71bdbce468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:48.082349 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965c440-c1bd-4f34-9bd6-2f71bdbce468 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:48.082635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965c440-c1bd-4f34-9bd6-2f71bdbce468 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:48.083058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965c440-c1bd-4f34-9bd6-2f71bdbce468 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:48.083818 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965c440-c1bd-4f34-9bd6-2f71bdbce468 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:48.084133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965c440-c1bd-4f34-9bd6-2f71bdbce468 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:48.085609 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965c440-c1bd-4f34-9bd6-2f71bdbce468 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:48.089947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:48.102289 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 427/856] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:48.103240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965c440-c1bd-4f34-9bd6-2f71bdbce468 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:48.130370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5ab00-a43c-422c-82e6-10729537206a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:48.155784 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:48.171054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca39a7d-93de-478a-b62c-4f5c24b6f41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:48.171681 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca39a7d-93de-478a-b62c-4f5c24b6f41d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:48.171957 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca39a7d-93de-478a-b62c-4f5c24b6f41d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:48.172231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca39a7d-93de-478a-b62c-4f5c24b6f41d None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:48.172873 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca39a7d-93de-478a-b62c-4f5c24b6f41d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:48.173176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca39a7d-93de-478a-b62c-4f5c24b6f41d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:48.174544 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca39a7d-93de-478a-b62c-4f5c24b6f41d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:48.180359 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 430/857] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:07:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:48.181161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca39a7d-93de-478a-b62c-4f5c24b6f41d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:48.239681 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965c440-c1bd-4f34-9bd6-2f71bdbce468 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:48.288494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885387a-0af2-4c46-bbde-884feb8a5f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:48.289504 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885387a-0af2-4c46-bbde-884feb8a5f94 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:48.290055 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885387a-0af2-4c46-bbde-884feb8a5f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:48.290612 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885387a-0af2-4c46-bbde-884feb8a5f94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:48.303469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885387a-0af2-4c46-bbde-884feb8a5f94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:48.309039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-9885387a-0af2-4c46-bbde-884feb8a5f94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:48.309039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:48.309039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:48.309039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:48.309039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:48.309039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:48.309039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:48.309039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:48.309039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:48.309039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:48.309039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:48.309039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:48.309039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:48.309039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:48.309039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:48.309039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:48.310035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:48.310035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:48.310035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:48.310035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:48.310035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:48.310035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:48.310035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:48.310035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:48.310035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:48.310035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:48.310035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:48.310035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:48.310035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:48.310035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:48.310035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:48.310035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:48.310902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:48.310902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:48.310902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:48.310902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:48.310902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:48.310902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:48.310902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:48.310902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:48.310902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:48.310902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:48.310902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:07:48.310902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:48.318523 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 428/858] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:07:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:48.320278 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885387a-0af2-4c46-bbde-884feb8a5f94 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:48.324175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca39a7d-93de-478a-b62c-4f5c24b6f41d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:48.364490 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee61df-f20b-45fa-b849-c2fe5f05a41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:48.365138 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee61df-f20b-45fa-b849-c2fe5f05a41c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:48.365418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee61df-f20b-45fa-b849-c2fe5f05a41c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:48.365691 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee61df-f20b-45fa-b849-c2fe5f05a41c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:48.366429 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee61df-f20b-45fa-b849-c2fe5f05a41c None admin] RBAC: Adding query filter params (role.id=2613cf4a98d44744a094c7782b19b4b5, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=c295a3063c3b45be96b406f586180142) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:48.366768 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee61df-f20b-45fa-b849-c2fe5f05a41c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:48.368205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee61df-f20b-45fa-b849-c2fe5f05a41c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:48.375943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 431/859] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:07:48 2022] GET /identity/v3/role_assignments?user.id=c295a3063c3b45be96b406f586180142&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:48.388774 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:48.442434 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885387a-0af2-4c46-bbde-884feb8a5f94 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:48.483952 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd737bcc-cd55-4ad4-a00c-047cc20c50f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:48.484585 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd737bcc-cd55-4ad4-a00c-047cc20c50f0 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:48.484865 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd737bcc-cd55-4ad4-a00c-047cc20c50f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:48.485144 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd737bcc-cd55-4ad4-a00c-047cc20c50f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:48.485826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd737bcc-cd55-4ad4-a00c-047cc20c50f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:48.486131 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd737bcc-cd55-4ad4-a00c-047cc20c50f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:48.487620 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd737bcc-cd55-4ad4-a00c-047cc20c50f0 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:48.502162 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 429/860] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:07:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:07:48.503622 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee61df-f20b-45fa-b849-c2fe5f05a41c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:48.563684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:48.628116 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee61df-f20b-45fa-b849-c2fe5f05a41c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:48.664324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1d4c9-9a79-4453-b843-8d70012aef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:48.665332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1d4c9-9a79-4453-b843-8d70012aef8f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:48.665831 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1d4c9-9a79-4453-b843-8d70012aef8f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:48.666303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1d4c9-9a79-4453-b843-8d70012aef8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:48.677265 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1d4c9-9a79-4453-b843-8d70012aef8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:48.679010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1d4c9-9a79-4453-b843-8d70012aef8f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:48.694295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-49d1d4c9-9a79-4453-b843-8d70012aef8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:48.694295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:48.694295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:48.694295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:48.694295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:48.694295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:48.694295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:48.694295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:48.694295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:48.694295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:48.694295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:48.694295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:48.694295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:48.694295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:48.694295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:48.694295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:48.695321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:48.695321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:48.695321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:48.695321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:48.695321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:48.695321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:48.695321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:48.695321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:48.695321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:48.695321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:48.695321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:48.695321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:48.695321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:48.695321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:48.695321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:48.695321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:48.695321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:48.696237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:48.696237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:48.696237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:48.698289 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 432/861] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:48.703819 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd737bcc-cd55-4ad4-a00c-047cc20c50f0 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:48.809726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd737bcc-cd55-4ad4-a00c-047cc20c50f0 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:48.827940 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:48.850769 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4766f-14d5-4a03-868c-13c9a49a5324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:48.851734 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4766f-14d5-4a03-868c-13c9a49a5324 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:48.852235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4766f-14d5-4a03-868c-13c9a49a5324 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:48.852829 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4766f-14d5-4a03-868c-13c9a49a5324 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:48.853959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4766f-14d5-4a03-868c-13c9a49a5324 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:48.854474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4766f-14d5-4a03-868c-13c9a49a5324 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:48.856066 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4766f-14d5-4a03-868c-13c9a49a5324 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:48.870503 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 430/862] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:48.876298 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1d4c9-9a79-4453-b843-8d70012aef8f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:48.990359 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1d4c9-9a79-4453-b843-8d70012aef8f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:48.992275 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:49.026583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554bfaa-823d-48f5-a674-02bf5f070334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:49.027615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554bfaa-823d-48f5-a674-02bf5f070334 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:49.028206 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554bfaa-823d-48f5-a674-02bf5f070334 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:49.028688 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554bfaa-823d-48f5-a674-02bf5f070334 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:49.036224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554bfaa-823d-48f5-a674-02bf5f070334 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:49.037921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554bfaa-823d-48f5-a674-02bf5f070334 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:49.049695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-e554bfaa-823d-48f5-a674-02bf5f070334 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 04:07:49.049695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:49.049695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:49.049695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:49.049695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:49.049695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:49.049695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:49.049695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:49.049695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:49.049695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:49.049695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:49.049695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:49.049695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:49.049695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:49.049695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:49.049695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:49.050652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:49.050652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:49.050652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:49.050652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:49.050652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:49.050652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:49.050652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:49.050652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:49.050652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:49.050652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:49.050652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:49.050652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:49.050652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:49.050652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:49.050652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:49.050652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:49.050652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:49.050652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:49.051654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:49.051654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:49.051654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:49.051654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:49.051654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:49.051654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:49.051654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:49.051654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:49.051654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 04:07:49.051654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:49.054626 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 433/863] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 27 04:07:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:49.063817 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4766f-14d5-4a03-868c-13c9a49a5324 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:49.167408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4766f-14d5-4a03-868c-13c9a49a5324 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:49.206628 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826025dd-d3ff-4171-8054-e71ef08b1407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:49.207344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826025dd-d3ff-4171-8054-e71ef08b1407 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:49.207627 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826025dd-d3ff-4171-8054-e71ef08b1407 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:49.207901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826025dd-d3ff-4171-8054-e71ef08b1407 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:49.208682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826025dd-d3ff-4171-8054-e71ef08b1407 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:49.208990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826025dd-d3ff-4171-8054-e71ef08b1407 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:49.210437 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826025dd-d3ff-4171-8054-e71ef08b1407 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:49.229142 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 431/864] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Sep 27 04:07:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:49.234490 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554bfaa-823d-48f5-a674-02bf5f070334 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:49.339224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554bfaa-823d-48f5-a674-02bf5f070334 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:49.377041 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79842610-99e4-4605-905e-0877ee6e104a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:49.378082 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79842610-99e4-4605-905e-0877ee6e104a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:49.378587 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79842610-99e4-4605-905e-0877ee6e104a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:49.379127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79842610-99e4-4605-905e-0877ee6e104a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:49.411368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:49.449684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79842610-99e4-4605-905e-0877ee6e104a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:49.451209 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79842610-99e4-4605-905e-0877ee6e104a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:49.550769 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 434/865] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:07:49 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:07:49.556802 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826025dd-d3ff-4171-8054-e71ef08b1407 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:49.591883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:49.659362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826025dd-d3ff-4171-8054-e71ef08b1407 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:49.697949 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25751b-219b-438f-83ff-a3fae283779b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:49.699030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25751b-219b-438f-83ff-a3fae283779b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:49.699536 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25751b-219b-438f-83ff-a3fae283779b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:49.700070 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25751b-219b-438f-83ff-a3fae283779b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:49.711079 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25751b-219b-438f-83ff-a3fae283779b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:49.713210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25751b-219b-438f-83ff-a3fae283779b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:49.729431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-1d25751b-219b-438f-83ff-a3fae283779b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:49.729431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:49.729431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:49.729431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:49.729431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:49.729431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:49.729431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:49.729431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:49.729431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:49.729431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:49.729431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:49.729431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:49.729431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:49.729431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:49.729431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:49.729431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:49.730421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:49.730421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:49.730421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:49.730421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:49.730421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:49.730421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:49.730421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:49.730421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:49.730421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:49.730421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:49.730421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:49.730421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:49.730421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:49.730421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:49.730421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:49.730421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:49.730421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:49.731362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:49.731362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:49.731362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:49.733526 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 432/866] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:49.738936 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79842610-99e4-4605-905e-0877ee6e104a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:49.800653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:49.840773 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79842610-99e4-4605-905e-0877ee6e104a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:49.875097 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedb8ff-f54a-47e0-be2d-dca21500089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:49.875757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedb8ff-f54a-47e0-be2d-dca21500089b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:49.876033 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedb8ff-f54a-47e0-be2d-dca21500089b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:49.876303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedb8ff-f54a-47e0-be2d-dca21500089b None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:49.876947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedb8ff-f54a-47e0-be2d-dca21500089b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:49.877249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedb8ff-f54a-47e0-be2d-dca21500089b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:49.878601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedb8ff-f54a-47e0-be2d-dca21500089b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:49.896621 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 435/867] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:49.899808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25751b-219b-438f-83ff-a3fae283779b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:49.989358 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:50.001929 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25751b-219b-438f-83ff-a3fae283779b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:50.037176 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9a31b-91c1-4b47-a080-4d9e6a7863c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:50.037808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9a31b-91c1-4b47-a080-4d9e6a7863c5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:50.038090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9a31b-91c1-4b47-a080-4d9e6a7863c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:50.038360 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9a31b-91c1-4b47-a080-4d9e6a7863c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:50.045124 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9a31b-91c1-4b47-a080-4d9e6a7863c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:50.046561 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9a31b-91c1-4b47-a080-4d9e6a7863c5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:50.057836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-26e9a31b-91c1-4b47-a080-4d9e6a7863c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:50.057836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:50.057836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:50.057836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:50.057836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:50.057836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:50.057836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:50.057836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:50.057836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:50.057836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:50.057836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:50.057836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:50.057836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:50.057836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:50.057836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:50.058761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:50.058761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:50.058761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:50.058761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:50.058761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:50.058761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:50.058761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:50.058761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:50.058761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:50.058761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:50.058761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:50.058761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:50.058761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:50.058761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:50.058761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:50.058761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:50.058761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:50.059690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:50.059690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:50.059690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:50.059690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:50.059690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:50.059690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:50.059690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:50.059690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:50.059690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 433/868] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:50.064727 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedb8ff-f54a-47e0-be2d-dca21500089b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:50.170823 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedb8ff-f54a-47e0-be2d-dca21500089b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:50.203621 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:50.210396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe6493-b033-4669-9b0d-2e6a07f530d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:50.211120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe6493-b033-4669-9b0d-2e6a07f530d1 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:50.211457 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe6493-b033-4669-9b0d-2e6a07f530d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:50.211929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe6493-b033-4669-9b0d-2e6a07f530d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:50.212685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe6493-b033-4669-9b0d-2e6a07f530d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:50.213133 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe6493-b033-4669-9b0d-2e6a07f530d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:50.214745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe6493-b033-4669-9b0d-2e6a07f530d1 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:50.230763 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 436/869] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:50.233363 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9a31b-91c1-4b47-a080-4d9e6a7863c5 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:50.292844 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916f2f4-2c02-4ce5-8bab-fb9dc7006bf8 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:50.293143 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916f2f4-2c02-4ce5-8bab-fb9dc7006bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:50.293611 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916f2f4-2c02-4ce5-8bab-fb9dc7006bf8 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:50.295278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 437/870] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:07:50.300944 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca917a-f2b7-4dd1-8555-863a62f54979 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:50.301230 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca917a-f2b7-4dd1-8555-863a62f54979 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:50.301506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca917a-f2b7-4dd1-8555-863a62f54979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:50.322569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5fca917a-f2b7-4dd1-8555-863a62f54979 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:50.323808 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5fca917a-f2b7-4dd1-8555-863a62f54979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:50.344225 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9a31b-91c1-4b47-a080-4d9e6a7863c5 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:50.384846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42b412-9a28-486d-9ffc-b6b9713ba67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:50.385889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42b412-9a28-486d-9ffc-b6b9713ba67c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:50.386385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42b412-9a28-486d-9ffc-b6b9713ba67c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:50.386938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42b412-9a28-486d-9ffc-b6b9713ba67c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:50.387958 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42b412-9a28-486d-9ffc-b6b9713ba67c None admin] RBAC: Adding query filter params (role.id=e62613bfe0e143abbc25d60ea42a4416, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=71c7a54c598642a4b9219ae21c34f0b0) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:50.388494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42b412-9a28-486d-9ffc-b6b9713ba67c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:50.390390 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42b412-9a28-486d-9ffc-b6b9713ba67c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:50.409448 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 434/871] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:07:50 2022] GET /identity/v3/role_assignments?user.id=71c7a54c598642a4b9219ae21c34f0b0&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=e62613bfe0e143abbc25d60ea42a4416 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:50.410167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 438/872] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:07:50.523023 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fc587-0d7e-4acf-a600-5fd800c23dfa None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:50.523354 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fc587-0d7e-4acf-a600-5fd800c23dfa None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:50.523587 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fc587-0d7e-4acf-a600-5fd800c23dfa None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:50.525211 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 435/873] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:50.530824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce76afd-7fe7-4f35-b87d-53e9b9f13ffe None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:50.531117 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce76afd-7fe7-4f35-b87d-53e9b9f13ffe None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:50.531403 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce76afd-7fe7-4f35-b87d-53e9b9f13ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:50.552902 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-cce76afd-7fe7-4f35-b87d-53e9b9f13ffe None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:50.554128 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-cce76afd-7fe7-4f35-b87d-53e9b9f13ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:50.628475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 439/874] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:07:50.696931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fc587-0d7e-4acf-a600-5fd800c23dfa None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:50.713251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:50.770972 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cb5b1-0519-4045-b8ff-47cb4d6497b3 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:50.771302 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cb5b1-0519-4045-b8ff-47cb4d6497b3 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:50.771536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cb5b1-0519-4045-b8ff-47cb4d6497b3 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:50.773109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 440/875] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:50.778071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6950ff5-14d9-4a0e-b055-19b270193e5a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:50.778353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6950ff5-14d9-4a0e-b055-19b270193e5a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:50.778625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6950ff5-14d9-4a0e-b055-19b270193e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:50.798554 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e6950ff5-14d9-4a0e-b055-19b270193e5a None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:50.800791 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e6950ff5-14d9-4a0e-b055-19b270193e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:50.805626 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fc587-0d7e-4acf-a600-5fd800c23dfa None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:50.843072 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:50.847318 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fe016-60cd-424f-9b24-a120c8bf1595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:50.848046 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fe016-60cd-424f-9b24-a120c8bf1595 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:50.848427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fe016-60cd-424f-9b24-a120c8bf1595 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:50.848799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fe016-60cd-424f-9b24-a120c8bf1595 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:50.850073 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7fe016-60cd-424f-9b24-a120c8bf1595 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:50.851587 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7fe016-60cd-424f-9b24-a120c8bf1595 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:50.873404 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 436/876] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 27 04:07:50 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:07:50.892581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 441/877] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:50 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:07:50.903478 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fe016-60cd-424f-9b24-a120c8bf1595 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:50.986063 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:51.023201 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fe016-60cd-424f-9b24-a120c8bf1595 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:51.064280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cccad-ec27-481d-b6de-5b697ed6e5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:51.064822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cccad-ec27-481d-b6de-5b697ed6e5c4 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:51.065102 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cccad-ec27-481d-b6de-5b697ed6e5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:51.066303 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cccad-ec27-481d-b6de-5b697ed6e5c4 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:51.066303 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cccad-ec27-481d-b6de-5b697ed6e5c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:51.067488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cccad-ec27-481d-b6de-5b697ed6e5c4 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:51.087495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 437/878] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 27 04:07:50 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:07:51.162756 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6950ff5-14d9-4a0e-b055-19b270193e5a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:51.279702 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6950ff5-14d9-4a0e-b055-19b270193e5a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:51.323997 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc1b86-d34a-425c-9298-ed5101293737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:51.324870 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc1b86-d34a-425c-9298-ed5101293737 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:51.325315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc1b86-d34a-425c-9298-ed5101293737 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:51.325752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc1b86-d34a-425c-9298-ed5101293737 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:51.326484 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc1b86-d34a-425c-9298-ed5101293737 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:51.328023 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc1b86-d34a-425c-9298-ed5101293737 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:51.337396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-a8dc1b86-d34a-425c-9298-ed5101293737 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:07:51.337396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:51.337396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:07:51.337396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:07:51.337396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:07:51.337396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:07:51.337396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:07:51.337396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:51.337396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:07:51.337396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:51.337396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:07:51.337396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:51.337396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:51.337396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:51.337396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:51.337396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:51.337396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:51.338625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:51.338625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:51.338625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:51.338625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:51.338625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:51.338625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:51.338625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:07:51.338625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:07:51.338625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:07:51.338625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:07:51.338625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:51.338625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:51.338625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:51.338625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:51.338625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:51.338625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:51.339742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:51.339742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:51.339742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:51.339742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:51.339742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:51.339742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:51.339742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:51.339742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:51.339742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:51.339742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:51.339742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:07:51.339742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:51.339742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:07:51.339742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:51.342215 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 442/879] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 27 04:07:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:51.347776 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cccad-ec27-481d-b6de-5b697ed6e5c4 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:51.460876 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cccad-ec27-481d-b6de-5b697ed6e5c4 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:51.492399 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:51.497949 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7f779-7cc5-4feb-8892-30143508d23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:51.499066 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7f779-7cc5-4feb-8892-30143508d23e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:51.499552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7f779-7cc5-4feb-8892-30143508d23e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:51.500338 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7f779-7cc5-4feb-8892-30143508d23e None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:51.501336 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7f779-7cc5-4feb-8892-30143508d23e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:51.501641 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7f779-7cc5-4feb-8892-30143508d23e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:51.503150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7f779-7cc5-4feb-8892-30143508d23e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:51.509985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 438/880] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 27 04:07:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:51.515441 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc1b86-d34a-425c-9298-ed5101293737 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:51.544040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:51.619634 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc1b86-d34a-425c-9298-ed5101293737 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:51.657110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43bf92-9f91-4c3d-9c11-051ed18a1505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:51.657963 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43bf92-9f91-4c3d-9c11-051ed18a1505 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:51.658387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43bf92-9f91-4c3d-9c11-051ed18a1505 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:51.658857 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43bf92-9f91-4c3d-9c11-051ed18a1505 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:51.659643 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43bf92-9f91-4c3d-9c11-051ed18a1505 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:51.660107 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43bf92-9f91-4c3d-9c11-051ed18a1505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:51.661715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43bf92-9f91-4c3d-9c11-051ed18a1505 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:51.667009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 443/881] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 27 04:07:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:52.811367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d193df-db66-4666-9fab-d0e76ce8c190 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:52.812429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d193df-db66-4666-9fab-d0e76ce8c190 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:52.812929 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d193df-db66-4666-9fab-d0e76ce8c190 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:52.814732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 439/882] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:52.820717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5988b8-d47b-4093-8902-7c26771eb030 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:52.821595 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5988b8-d47b-4093-8902-7c26771eb030 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:52.822081 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5988b8-d47b-4093-8902-7c26771eb030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:52.840453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-fe5988b8-d47b-4093-8902-7c26771eb030 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:52.841959 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fe5988b8-d47b-4093-8902-7c26771eb030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:52.910179 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 444/883] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:07:53.105762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17299f4-23a2-4f88-8706-ca7255bebab5 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:53.105947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17299f4-23a2-4f88-8706-ca7255bebab5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:53.106270 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17299f4-23a2-4f88-8706-ca7255bebab5 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:53.107975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 440/884] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:53.113308 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75552da4-fc45-4535-997d-9f3974de932e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:53.113600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75552da4-fc45-4535-997d-9f3974de932e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:53.113876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75552da4-fc45-4535-997d-9f3974de932e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:53.132163 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-75552da4-fc45-4535-997d-9f3974de932e None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:53.133334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-75552da4-fc45-4535-997d-9f3974de932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:53.149776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:53.183479 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17299f4-23a2-4f88-8706-ca7255bebab5 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:53.205879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 445/885] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:07:53.305071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17299f4-23a2-4f88-8706-ca7255bebab5 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:53.341454 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd207c-417d-42be-8be1-035b46cdee51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:53.342081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd207c-417d-42be-8be1-035b46cdee51 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:53.342365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd207c-417d-42be-8be1-035b46cdee51 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:53.342641 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd207c-417d-42be-8be1-035b46cdee51 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:53.353337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd207c-417d-42be-8be1-035b46cdee51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:53.358463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-49dd207c-417d-42be-8be1-035b46cdee51 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 04:07:53.358463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:53.358463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:53.358463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:53.358463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:53.358463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:53.358463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:53.358463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:53.358463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:53.358463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:53.358463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:53.358463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:53.358463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:53.358463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:53.358463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:53.358463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:53.359486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:53.359486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:53.359486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:53.359486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:53.359486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:53.359486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:53.359486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:53.359486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:53.359486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:53.359486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:53.359486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:53.359486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:53.359486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:53.359486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:53.359486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:53.359486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:53.360405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:53.360405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:53.360405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:53.360405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:53.360405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:53.360405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:53.360405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:53.360405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:53.360405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:53.360405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:53.360405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 04:07:53.360405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:53.360405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 441/886] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Sep 27 04:07:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:07:53.365712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75552da4-fc45-4535-997d-9f3974de932e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:53.388893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d16067-8bde-4360-8cc9-b8cdc3547f22 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:53.389499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d16067-8bde-4360-8cc9-b8cdc3547f22 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:53.389993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d16067-8bde-4360-8cc9-b8cdc3547f22 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:53.391851 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 442/887] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:07:53.403442 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c146f20-59f1-4ca5-a538-8265b941ee5d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:53.403793 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c146f20-59f1-4ca5-a538-8265b941ee5d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:53.404147 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c146f20-59f1-4ca5-a538-8265b941ee5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:53.425185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8c146f20-59f1-4ca5-a538-8265b941ee5d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:53.426378 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8c146f20-59f1-4ca5-a538-8265b941ee5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:53.480726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:53.495912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75552da4-fc45-4535-997d-9f3974de932e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:53.498104 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 443/888] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:07:53.499049 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c146f20-59f1-4ca5-a538-8265b941ee5d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:53.537505 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24cb8c-00fa-4992-85af-a171b009b43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:53.538600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24cb8c-00fa-4992-85af-a171b009b43a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:53.539119 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24cb8c-00fa-4992-85af-a171b009b43a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:53.539657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24cb8c-00fa-4992-85af-a171b009b43a None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:53.540559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24cb8c-00fa-4992-85af-a171b009b43a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:53.541150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24cb8c-00fa-4992-85af-a171b009b43a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:53.542742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24cb8c-00fa-4992-85af-a171b009b43a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:53.557073 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 446/889] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 27 04:07:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:53.558227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24cb8c-00fa-4992-85af-a171b009b43a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:53.577826 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:53.617320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c146f20-59f1-4ca5-a538-8265b941ee5d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:53.655923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8377c-1c5a-4eff-b501-dd4ca562929e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:53.656957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8377c-1c5a-4eff-b501-dd4ca562929e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:53.657593 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8377c-1c5a-4eff-b501-dd4ca562929e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:53.658105 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8377c-1c5a-4eff-b501-dd4ca562929e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:53.658972 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8377c-1c5a-4eff-b501-dd4ca562929e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:53.660658 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8377c-1c5a-4eff-b501-dd4ca562929e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:53.670382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-e7a8377c-1c5a-4eff-b501-dd4ca562929e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 04:07:53.670382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:53.670382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:07:53.670382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:07:53.670382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:07:53.670382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:07:53.670382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:07:53.670382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:53.670382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 04:07:53.670382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:53.670382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:07:53.670382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:53.670382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:53.670382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:53.670382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:53.670382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:53.671414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:53.671414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:53.671414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:53.671414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:53.671414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:53.671414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:53.671414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:53.671414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:07:53.671414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:07:53.671414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:07:53.671414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:07:53.671414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:53.671414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:53.671414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:53.671414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:53.671414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:53.671414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:53.672350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:53.672350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:53.672350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:53.672350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:53.672350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:53.672350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:53.672350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:53.672350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:53.672350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:53.672350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:53.672350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:07:53.672350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:53.672350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 04:07:53.672350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:53.675188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 444/890] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Sep 27 04:07:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:53.680637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24cb8c-00fa-4992-85af-a171b009b43a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:53.682913 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8377c-1c5a-4eff-b501-dd4ca562929e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:53.723734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d600bf-43b4-4ef5-af7e-fddf44f4d0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:53.725092 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d600bf-43b4-4ef5-af7e-fddf44f4d0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:53.725573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d600bf-43b4-4ef5-af7e-fddf44f4d0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:53.726027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d600bf-43b4-4ef5-af7e-fddf44f4d0e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:53.734973 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:53.740743 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d600bf-43b4-4ef5-af7e-fddf44f4d0e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:53.742735 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d600bf-43b4-4ef5-af7e-fddf44f4d0e8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:53.763011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-34d600bf-43b4-4ef5-af7e-fddf44f4d0e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:53.763011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:53.763011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:53.763011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:53.763011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:53.763011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:53.763011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:53.763011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:53.763011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:53.763011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:53.763011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:53.763011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:53.763011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:53.763011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:53.763011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:53.763011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:53.764064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:53.764064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:53.764064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:53.764064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:53.764064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:53.764064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:53.764064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:53.764064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:53.764064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:53.764064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:53.764064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:53.764064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:53.764064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:53.764064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:53.764064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:53.764064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:53.764064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:53.764965 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:53.764965 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:53.764965 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:53.772019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 447/891] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:53.773580 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d600bf-43b4-4ef5-af7e-fddf44f4d0e8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:53.799035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8377c-1c5a-4eff-b501-dd4ca562929e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:53.835390 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4f160-8e73-41f2-b214-320154a65e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:53.836013 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4f160-8e73-41f2-b214-320154a65e3a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:53.836298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4f160-8e73-41f2-b214-320154a65e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:53.836970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4f160-8e73-41f2-b214-320154a65e3a None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:53.837624 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4f160-8e73-41f2-b214-320154a65e3a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:53.837921 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4f160-8e73-41f2-b214-320154a65e3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:53.839329 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4f160-8e73-41f2-b214-320154a65e3a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:53.844219 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 445/892] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 27 04:07:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:53.844852 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4f160-8e73-41f2-b214-320154a65e3a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:53.854146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:53.891914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d600bf-43b4-4ef5-af7e-fddf44f4d0e8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:53.925482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f0921-3609-4646-9bb6-e1303f9ebad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:53.926096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f0921-3609-4646-9bb6-e1303f9ebad4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:53.926377 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f0921-3609-4646-9bb6-e1303f9ebad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:53.926648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f0921-3609-4646-9bb6-e1303f9ebad4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:53.927831 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f0921-3609-4646-9bb6-e1303f9ebad4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:53.929185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f0921-3609-4646-9bb6-e1303f9ebad4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:53.937676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-175f0921-3609-4646-9bb6-e1303f9ebad4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 04:07:53.937676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:53.937676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:07:53.937676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:07:53.937676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:07:53.937676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:07:53.937676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:07:53.937676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:53.937676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 04:07:53.937676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:53.937676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:07:53.937676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:53.937676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:53.937676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:53.937676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:53.937676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:53.937676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:53.938899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:53.938899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:53.938899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:53.938899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:53.938899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:53.938899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:53.938899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:07:53.938899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:07:53.938899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:07:53.938899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:07:53.938899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:53.938899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:53.938899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:53.938899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:53.938899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:53.938899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:53.939866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:53.939866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:53.939866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:53.939866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:53.939866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:53.939866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:53.939866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:53.939866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:53.939866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:53.939866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:53.939866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:07:53.939866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:53.939866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 04:07:53.939866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:53.943654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 448/893] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:07:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:07:53.944477 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f0921-3609-4646-9bb6-e1303f9ebad4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:53.947732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4f160-8e73-41f2-b214-320154a65e3a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:53.961376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:53.987534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43d4fc-2f2d-4a46-bd22-d51560eeb46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:53.988139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43d4fc-2f2d-4a46-bd22-d51560eeb46a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:53.988424 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43d4fc-2f2d-4a46-bd22-d51560eeb46a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:53.988706 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43d4fc-2f2d-4a46-bd22-d51560eeb46a None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:53.989358 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43d4fc-2f2d-4a46-bd22-d51560eeb46a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:53.990223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43d4fc-2f2d-4a46-bd22-d51560eeb46a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:53.991642 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43d4fc-2f2d-4a46-bd22-d51560eeb46a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:54.003035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 446/894] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:54.004255 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5b1b2-c95b-48fc-a377-2c9e8fb921e9 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:54.004545 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5b1b2-c95b-48fc-a377-2c9e8fb921e9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:54.004822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5b1b2-c95b-48fc-a377-2c9e8fb921e9 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:54.006204 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 447/895] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:54.008838 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5b1b2-c95b-48fc-a377-2c9e8fb921e9 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:54.042855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f0921-3609-4646-9bb6-e1303f9ebad4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:54.071983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:54.078171 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c34c5-f1e6-4fdd-98bf-3499fef80c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:54.078798 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c34c5-f1e6-4fdd-98bf-3499fef80c14 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:54.079081 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c34c5-f1e6-4fdd-98bf-3499fef80c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:54.079357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c34c5-f1e6-4fdd-98bf-3499fef80c14 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:54.079992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c34c5-f1e6-4fdd-98bf-3499fef80c14 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:54.080303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c34c5-f1e6-4fdd-98bf-3499fef80c14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:54.081673 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c34c5-f1e6-4fdd-98bf-3499fef80c14 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:54.086377 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 449/896] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 27 04:07:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:54.087296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c34c5-f1e6-4fdd-98bf-3499fef80c14 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:54.110672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5b1b2-c95b-48fc-a377-2c9e8fb921e9 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:54.144665 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f626c-65f5-4b63-b07a-9a597b7d6db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:54.145200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f626c-65f5-4b63-b07a-9a597b7d6db0 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:54.145498 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f626c-65f5-4b63-b07a-9a597b7d6db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:54.145798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f626c-65f5-4b63-b07a-9a597b7d6db0 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:54.146433 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f626c-65f5-4b63-b07a-9a597b7d6db0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:54.146760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f626c-65f5-4b63-b07a-9a597b7d6db0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:54.148128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f626c-65f5-4b63-b07a-9a597b7d6db0 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:54.152594 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 448/897] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:07:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:54.153884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fb305-a679-416c-b5cc-eb7b85ede823 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:54.154173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fb305-a679-416c-b5cc-eb7b85ede823 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:54.154449 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fb305-a679-416c-b5cc-eb7b85ede823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:54.171949 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-be2fb305-a679-416c-b5cc-eb7b85ede823 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:54.173146 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-be2fb305-a679-416c-b5cc-eb7b85ede823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:54.184789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c34c5-f1e6-4fdd-98bf-3499fef80c14 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:54.202161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:54.222845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cd5a1-d9bf-4905-a7d1-1e3fbfb785ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:54.223482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cd5a1-d9bf-4905-a7d1-1e3fbfb785ea None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:54.223765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cd5a1-d9bf-4905-a7d1-1e3fbfb785ea None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:54.224641 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cd5a1-d9bf-4905-a7d1-1e3fbfb785ea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:54.233013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211cd5a1-d9bf-4905-a7d1-1e3fbfb785ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:54.234445 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211cd5a1-d9bf-4905-a7d1-1e3fbfb785ea None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:54.240732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 449/898] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:07:54.241579 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fb305-a679-416c-b5cc-eb7b85ede823 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:54.245193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-211cd5a1-d9bf-4905-a7d1-1e3fbfb785ea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 04:07:54.245193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:54.245193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:54.245193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:54.245193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:54.245193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:54.245193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:54.245193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:54.245193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:54.245193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:54.245193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:54.245193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:54.245193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:54.245193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:54.245193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:54.245193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:54.246285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:54.246285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:54.246285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:54.246285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:54.246285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:54.246285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:54.246285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:54.246285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:54.246285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:54.246285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:54.246285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:54.246285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:54.246285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:54.246285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:54.246285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:54.246285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:54.246285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:54.246285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:54.247316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:54.247316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:54.247316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:54.247316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:54.247316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:54.247316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:54.247316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:54.247316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:54.247316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 04:07:54.247316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:54.247316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 450/899] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 27 04:07:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:54.247316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cd5a1-d9bf-4905-a7d1-1e3fbfb785ea None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:54.314758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:54.348273 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fb305-a679-416c-b5cc-eb7b85ede823 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:54.364032 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cd5a1-d9bf-4905-a7d1-1e3fbfb785ea None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:54.384563 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460e272-af0d-4874-9ff6-93292beaff6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:54.385105 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460e272-af0d-4874-9ff6-93292beaff6b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:54.385388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460e272-af0d-4874-9ff6-93292beaff6b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:54.385727 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460e272-af0d-4874-9ff6-93292beaff6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:54.386439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460e272-af0d-4874-9ff6-93292beaff6b None admin] RBAC: Adding query filter params (interface=public, service_id=c9e752fc41b6480997e854062e9f5afe, region_id=RegionOne) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:54.386994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460e272-af0d-4874-9ff6-93292beaff6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:54.388221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460e272-af0d-4874-9ff6-93292beaff6b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:54.398313 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 450/900] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 27 04:07:54 2022] GET /identity/v3/endpoints?service_id=c9e752fc41b6480997e854062e9f5afe&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:54.398313 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460e272-af0d-4874-9ff6-93292beaff6b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:54.407040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3c3cb-48af-437a-a797-b77f4410da32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:54.407747 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3c3cb-48af-437a-a797-b77f4410da32 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:54.408098 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3c3cb-48af-437a-a797-b77f4410da32 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:54.408441 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3c3cb-48af-437a-a797-b77f4410da32 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:54.409545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3c3cb-48af-437a-a797-b77f4410da32 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:54.409866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3c3cb-48af-437a-a797-b77f4410da32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:54.411393 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3c3cb-48af-437a-a797-b77f4410da32 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:54.418199 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 451/901] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:07:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:54.418822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3c3cb-48af-437a-a797-b77f4410da32 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:54.438565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:54.511661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460e272-af0d-4874-9ff6-93292beaff6b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:54.528899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3c3cb-48af-437a-a797-b77f4410da32 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:54.545531 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8e164-fec1-4110-a6ec-778a1d57fa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:54.545822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:54.546359 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8e164-fec1-4110-a6ec-778a1d57fa3b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:54.546662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8e164-fec1-4110-a6ec-778a1d57fa3b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:54.546988 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8e164-fec1-4110-a6ec-778a1d57fa3b None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:54.547771 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8e164-fec1-4110-a6ec-778a1d57fa3b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:54.548102 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8e164-fec1-4110-a6ec-778a1d57fa3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:54.549588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8e164-fec1-4110-a6ec-778a1d57fa3b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:54.562636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e28630-7307-4e6e-9bba-13e39298ced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:54.563281 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e28630-7307-4e6e-9bba-13e39298ced1 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:54.563563 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e28630-7307-4e6e-9bba-13e39298ced1 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:54.563840 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e28630-7307-4e6e-9bba-13e39298ced1 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:54.564450 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e28630-7307-4e6e-9bba-13e39298ced1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:54.565806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e28630-7307-4e6e-9bba-13e39298ced1 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:54.566064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 451/902] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Sep 27 04:07:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:54.566892 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8e164-fec1-4110-a6ec-778a1d57fa3b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:54.578812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 452/903] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 27 04:07:54 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:07:54.578812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e28630-7307-4e6e-9bba-13e39298ced1 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:54.675436 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:54.686053 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e28630-7307-4e6e-9bba-13e39298ced1 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:54.688319 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8e164-fec1-4110-a6ec-778a1d57fa3b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:54.724550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0800fa-7293-4f9a-9e57-2d5e116988de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:54.725153 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0800fa-7293-4f9a-9e57-2d5e116988de None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:54.725432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0800fa-7293-4f9a-9e57-2d5e116988de None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:54.725702 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0800fa-7293-4f9a-9e57-2d5e116988de None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:54.726369 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0800fa-7293-4f9a-9e57-2d5e116988de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:54.727805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0800fa-7293-4f9a-9e57-2d5e116988de None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:54.731194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371c188-2fb0-4a00-bde9-ba4cced1651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:54.731809 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371c188-2fb0-4a00-bde9-ba4cced1651e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:54.732089 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371c188-2fb0-4a00-bde9-ba4cced1651e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:54.732364 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371c188-2fb0-4a00-bde9-ba4cced1651e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:54.733085 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371c188-2fb0-4a00-bde9-ba4cced1651e None admin] RBAC: Adding query filter params (interface=public, service_id=15fcdcd86dbf45338f7ee2233a250f8c, region_id=RegionOne) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:54.733415 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371c188-2fb0-4a00-bde9-ba4cced1651e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:54.735018 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371c188-2fb0-4a00-bde9-ba4cced1651e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:54.745894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 452/904] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 27 04:07:54 2022] GET /identity/v3/endpoints?service_id=15fcdcd86dbf45338f7ee2233a250f8c&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:54.745894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371c188-2fb0-4a00-bde9-ba4cced1651e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:54.746133 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 453/905] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 27 04:07:54 2022] POST /identity/v3/services => generated 241 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:07:54.746971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0800fa-7293-4f9a-9e57-2d5e116988de None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:54.813832 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:54.884843 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371c188-2fb0-4a00-bde9-ba4cced1651e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:54.896343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0800fa-7293-4f9a-9e57-2d5e116988de None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:54.931111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd48ec7-a8cd-4270-a7b1-601e8b6c3816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:54.931778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd48ec7-a8cd-4270-a7b1-601e8b6c3816 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:54.932152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd48ec7-a8cd-4270-a7b1-601e8b6c3816 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:54.932416 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd48ec7-a8cd-4270-a7b1-601e8b6c3816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:54.940615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfb72c-8a67-4645-b6b9-74e5e1902c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:54.941228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfb72c-8a67-4645-b6b9-74e5e1902c17 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:54.941507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfb72c-8a67-4645-b6b9-74e5e1902c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:54.941778 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfb72c-8a67-4645-b6b9-74e5e1902c17 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:54.942950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfb72c-8a67-4645-b6b9-74e5e1902c17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:54.944725 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfb72c-8a67-4645-b6b9-74e5e1902c17 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:54.951902 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 454/906] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 27 04:07:54 2022] GET /identity/v3/services => generated 1497 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:07:54.960209 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:55.022629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd48ec7-a8cd-4270-a7b1-601e8b6c3816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:55.024191 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd48ec7-a8cd-4270-a7b1-601e8b6c3816 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:55.140341 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 453/907] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:07:54 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:07:55.147089 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfb72c-8a67-4645-b6b9-74e5e1902c17 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:55.253255 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfb72c-8a67-4645-b6b9-74e5e1902c17 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:55.254784 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:55.295125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acb276-68a0-4237-b01b-0895c3c00900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:55.295819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acb276-68a0-4237-b01b-0895c3c00900 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:55.296157 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acb276-68a0-4237-b01b-0895c3c00900 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:55.296502 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acb276-68a0-4237-b01b-0895c3c00900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:55.307293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acb276-68a0-4237-b01b-0895c3c00900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:55.308761 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acb276-68a0-4237-b01b-0895c3c00900 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:55.324071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-76acb276-68a0-4237-b01b-0895c3c00900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:55.324071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:55.324071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:55.324071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:55.324071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:55.324071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:55.324071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:55.324071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:55.324071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:55.324071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:55.324071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:55.324071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:55.324071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:55.324071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:55.324071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:55.324071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:55.325045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:55.325045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:55.325045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:55.325045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:55.325045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:55.325045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:55.325045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:55.325045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:55.325045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:55.325045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:55.325045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:55.325045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:55.325045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:55.325045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:55.325045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:55.325045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:55.325045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:55.325921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:55.325921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:55.325921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:55.325921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 455/908] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:55.331269 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd48ec7-a8cd-4270-a7b1-601e8b6c3816 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:55.389188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:55.437707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd48ec7-a8cd-4270-a7b1-601e8b6c3816 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:55.473198 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e328b-c598-438a-a52a-3ad807fd408a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:55.473836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e328b-c598-438a-a52a-3ad807fd408a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:55.474122 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e328b-c598-438a-a52a-3ad807fd408a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:55.474396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e328b-c598-438a-a52a-3ad807fd408a None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:55.475074 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e328b-c598-438a-a52a-3ad807fd408a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:55.475381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e328b-c598-438a-a52a-3ad807fd408a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:55.476754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e328b-c598-438a-a52a-3ad807fd408a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:55.488844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 454/909] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:55.494214 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acb276-68a0-4237-b01b-0895c3c00900 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:55.606651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acb276-68a0-4237-b01b-0895c3c00900 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:55.642021 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889572c-e1ed-433c-b23a-ac94b9e59127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:55.642652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889572c-e1ed-433c-b23a-ac94b9e59127 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:55.642962 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889572c-e1ed-433c-b23a-ac94b9e59127 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:55.643238 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889572c-e1ed-433c-b23a-ac94b9e59127 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:55.650784 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889572c-e1ed-433c-b23a-ac94b9e59127 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:55.652237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889572c-e1ed-433c-b23a-ac94b9e59127 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:55.663628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-f889572c-e1ed-433c-b23a-ac94b9e59127 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:55.663628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:55.663628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:55.663628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:55.663628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:55.663628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:55.663628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:55.663628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:55.663628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:55.663628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:55.663628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:55.663628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:55.663628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:07:55.663628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:07:55.663628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:07:55.664516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:07:55.664516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:55.664516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:55.664516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:55.664516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:55.664516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:55.664516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:55.664516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:55.664516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:55.664516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:55.664516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:55.664516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:55.664516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:55.664516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:55.664516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:55.664516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:55.664516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:55.665507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:07:55.665507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:07:55.665507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:07:55.665507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:07:55.665507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:07:55.665507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:07:55.665507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:07:55.665507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:55.665507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 456/910] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:07:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:55.670795 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e328b-c598-438a-a52a-3ad807fd408a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:55.778061 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e328b-c598-438a-a52a-3ad807fd408a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:55.794609 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:55.818663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57535e47-451e-4eb9-b968-c3f481d35871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:55.819350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57535e47-451e-4eb9-b968-c3f481d35871 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:55.819641 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57535e47-451e-4eb9-b968-c3f481d35871 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:55.819923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57535e47-451e-4eb9-b968-c3f481d35871 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:55.820637 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57535e47-451e-4eb9-b968-c3f481d35871 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:55.820949 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57535e47-451e-4eb9-b968-c3f481d35871 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:55.822398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57535e47-451e-4eb9-b968-c3f481d35871 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:55.836258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 455/911] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:07:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:55.843794 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889572c-e1ed-433c-b23a-ac94b9e59127 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:55.861523 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:55.952039 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889572c-e1ed-433c-b23a-ac94b9e59127 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:55.994227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b227b-3b77-425b-81fb-01d8805afda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:55.995267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b227b-3b77-425b-81fb-01d8805afda8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:55.995751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b227b-3b77-425b-81fb-01d8805afda8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:55.996224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b227b-3b77-425b-81fb-01d8805afda8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:55.997173 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b227b-3b77-425b-81fb-01d8805afda8 None admin] RBAC: Adding query filter params (role.id=1971d31ccfa34212a9ae9350ac58dcb9, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=71c7a54c598642a4b9219ae21c34f0b0) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:55.997703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b227b-3b77-425b-81fb-01d8805afda8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:55.999373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b227b-3b77-425b-81fb-01d8805afda8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:56.006742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 457/912] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:07:55 2022] GET /identity/v3/role_assignments?user.id=71c7a54c598642a4b9219ae21c34f0b0&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=1971d31ccfa34212a9ae9350ac58dcb9 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:56.874292 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab17de-6a80-4a9e-aa04-da82b6ef1d4d None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:56.875408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab17de-6a80-4a9e-aa04-da82b6ef1d4d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:56.875911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab17de-6a80-4a9e-aa04-da82b6ef1d4d None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:56.877893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 456/913] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:56.883952 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b789a-a193-47e5-9e2a-965106467d04 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:56.884599 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b789a-a193-47e5-9e2a-965106467d04 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:56.885085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b789a-a193-47e5-9e2a-965106467d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:56.904047 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5b6b789a-a193-47e5-9e2a-965106467d04 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:56.905588 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5b6b789a-a193-47e5-9e2a-965106467d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:56.976814 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 458/914] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:07:57.093053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b559c12-7f23-4565-8752-26269ddd1492 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:57.093402 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b559c12-7f23-4565-8752-26269ddd1492 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:57.093599 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b559c12-7f23-4565-8752-26269ddd1492 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:57.095389 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 457/915] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:57.100964 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77553881-d54f-475e-b460-c81e26d05bac None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:57.101255 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77553881-d54f-475e-b460-c81e26d05bac None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:57.101527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77553881-d54f-475e-b460-c81e26d05bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:57.120117 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-77553881-d54f-475e-b460-c81e26d05bac None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:57.121293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-77553881-d54f-475e-b460-c81e26d05bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:57.123236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:57.195383 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 459/916] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:07:57.259246 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b559c12-7f23-4565-8752-26269ddd1492 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:57.281926 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654666ff-7d9d-4ee5-a18a-70ce623ffb24 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:57.282230 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654666ff-7d9d-4ee5-a18a-70ce623ffb24 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:57.282491 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654666ff-7d9d-4ee5-a18a-70ce623ffb24 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:57.284212 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 460/917] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:07:57.289129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da75b0-02cd-4f4a-afc9-cb2378608f48 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:57.289418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da75b0-02cd-4f4a-afc9-cb2378608f48 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:57.289697 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da75b0-02cd-4f4a-afc9-cb2378608f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:57.309823 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c6da75b0-02cd-4f4a-afc9-cb2378608f48 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:57.310947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c6da75b0-02cd-4f4a-afc9-cb2378608f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:57.384538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b559c12-7f23-4565-8752-26269ddd1492 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:57.394880 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 461/918] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:07:57.423363 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0fba2-65b3-4d9a-8f55-f45d9a9f488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:57.424257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0fba2-65b3-4d9a-8f55-f45d9a9f488b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:57.424727 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0fba2-65b3-4d9a-8f55-f45d9a9f488b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:57.425174 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0fba2-65b3-4d9a-8f55-f45d9a9f488b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:57.425946 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0fba2-65b3-4d9a-8f55-f45d9a9f488b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:57.428099 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0fba2-65b3-4d9a-8f55-f45d9a9f488b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:57.437043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-75d0fba2-65b3-4d9a-8f55-f45d9a9f488b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 04:07:57.437043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:57.437043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:07:57.437043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:07:57.437043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:07:57.437043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:07:57.437043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:07:57.437043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:57.437043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 04:07:57.437043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:57.437043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:07:57.437043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:57.437043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:57.437043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:57.437043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:57.437043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:57.437962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:57.437962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:57.437962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:57.437962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:57.437962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:57.437962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:57.437962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:57.437962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:07:57.437962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:07:57.437962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:07:57.437962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:07:57.437962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:57.437962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:57.437962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:57.437962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:57.437962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:57.437962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:57.438893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:57.438893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:57.438893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:57.438893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:57.438893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:57.438893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:57.438893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:57.438893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:57.438893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:57.438893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:57.438893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:07:57.438893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:57.438893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 04:07:57.438893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:57.441624 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 458/919] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Sep 27 04:07:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:57.448341 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da75b0-02cd-4f4a-afc9-cb2378608f48 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:57.482435 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0fba2-65b3-4d9a-8f55-f45d9a9f488b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:57.523076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:57.537145 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:57.560318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da75b0-02cd-4f4a-afc9-cb2378608f48 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:57.598495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbfdff-50d2-4896-b003-ea374b1246c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:57.599864 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbfdff-50d2-4896-b003-ea374b1246c9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:57.600222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbfdff-50d2-4896-b003-ea374b1246c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:57.600573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbfdff-50d2-4896-b003-ea374b1246c9 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:57.601285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbfdff-50d2-4896-b003-ea374b1246c9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:57.601666 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbfdff-50d2-4896-b003-ea374b1246c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:57.603140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbfdff-50d2-4896-b003-ea374b1246c9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:57.613967 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 462/920] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 27 04:07:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:57.615145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbfdff-50d2-4896-b003-ea374b1246c9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:57.620924 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0fba2-65b3-4d9a-8f55-f45d9a9f488b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:57.665129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f85103-be1a-4a9b-8dff-7c3b3510e4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:57.665765 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f85103-be1a-4a9b-8dff-7c3b3510e4af None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:57.666045 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f85103-be1a-4a9b-8dff-7c3b3510e4af None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:57.666316 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f85103-be1a-4a9b-8dff-7c3b3510e4af None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:57.666937 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f85103-be1a-4a9b-8dff-7c3b3510e4af None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:57.668307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f85103-be1a-4a9b-8dff-7c3b3510e4af None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:57.677426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-c1f85103-be1a-4a9b-8dff-7c3b3510e4af None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:07:57.677426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:57.677426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:07:57.677426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:07:57.677426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:07:57.677426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:07:57.677426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:07:57.677426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:57.677426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:07:57.677426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:57.677426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:07:57.677426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:57.677426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:57.677426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:57.677426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:57.677426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:57.677426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:57.678408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:57.678408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:57.678408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:57.678408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:57.678408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:57.678408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:57.678408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:07:57.678408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:07:57.678408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:07:57.678408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:07:57.678408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:57.678408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:57.678408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:57.678408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:57.678408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:57.678408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:57.679875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:57.679875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:57.679875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:57.679875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:57.679875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:57.679875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:57.679875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:57.679875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:57.679875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:57.679875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:57.679875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:07:57.679875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:57.679875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:07:57.679875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:57.679875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 459/921] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 27 04:07:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:57.680677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f85103-be1a-4a9b-8dff-7c3b3510e4af None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:57.728868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbfdff-50d2-4896-b003-ea374b1246c9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:57.759328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:57.765416 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8c109-df2e-43c3-a04d-b2db7ca4ea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:57.766505 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8c109-df2e-43c3-a04d-b2db7ca4ea17 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:57.767174 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8c109-df2e-43c3-a04d-b2db7ca4ea17 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:57.767578 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8c109-df2e-43c3-a04d-b2db7ca4ea17 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:57.768225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8c109-df2e-43c3-a04d-b2db7ca4ea17 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:57.768537 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8c109-df2e-43c3-a04d-b2db7ca4ea17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:57.769913 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8c109-df2e-43c3-a04d-b2db7ca4ea17 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:57.780209 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 463/922] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 27 04:07:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:57.780209 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8c109-df2e-43c3-a04d-b2db7ca4ea17 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:57.793203 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f85103-be1a-4a9b-8dff-7c3b3510e4af None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:57.794752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:57.828882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e48d7f-7616-4425-b9a4-60bd4cc0bc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:57.829520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e48d7f-7616-4425-b9a4-60bd4cc0bc33 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:57.829795 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e48d7f-7616-4425-b9a4-60bd4cc0bc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:57.830068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e48d7f-7616-4425-b9a4-60bd4cc0bc33 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:57.830689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e48d7f-7616-4425-b9a4-60bd4cc0bc33 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:57.832082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e48d7f-7616-4425-b9a4-60bd4cc0bc33 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:57.840780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-87e48d7f-7616-4425-b9a4-60bd4cc0bc33 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 04:07:57.840780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:57.840780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:07:57.840780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:07:57.840780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:07:57.840780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:07:57.840780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:07:57.840780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:57.840780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 04:07:57.840780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:57.840780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:07:57.840780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:57.840780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:57.840780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:57.840780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:57.840780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:57.840780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:57.842028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:57.842028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:57.842028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:57.842028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:57.842028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:57.842028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:57.842028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:07:57.842028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:07:57.842028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:07:57.842028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:07:57.842028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:57.842028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:57.842028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:57.842028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:57.842028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:57.842028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:57.842923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:57.842923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:57.842923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:57.842923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:57.842923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:57.842923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:57.842923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:57.842923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:57.842923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:57.842923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:57.842923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:07:57.842923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:07:57.842923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 04:07:57.842923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:07:57.842923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 460/923] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:07:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:57.843733 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e48d7f-7616-4425-b9a4-60bd4cc0bc33 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:57.906121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8c109-df2e-43c3-a04d-b2db7ca4ea17 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:57.941000 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cad20-eb78-4510-b681-6be491052b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:57.941603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cad20-eb78-4510-b681-6be491052b25 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:57.941884 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cad20-eb78-4510-b681-6be491052b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:57.942159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cad20-eb78-4510-b681-6be491052b25 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:57.942850 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cad20-eb78-4510-b681-6be491052b25 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:57.943251 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cad20-eb78-4510-b681-6be491052b25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:57.944514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cad20-eb78-4510-b681-6be491052b25 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:57.947439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e48d7f-7616-4425-b9a4-60bd4cc0bc33 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:57.948996 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 464/924] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 27 04:07:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:57.949766 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cad20-eb78-4510-b681-6be491052b25 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:57.990114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dde1c2-c15e-47e6-8a58-32111248f8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:57.990985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dde1c2-c15e-47e6-8a58-32111248f8f1 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:57.991464 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dde1c2-c15e-47e6-8a58-32111248f8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:57.991891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dde1c2-c15e-47e6-8a58-32111248f8f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:57.992848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dde1c2-c15e-47e6-8a58-32111248f8f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:57.994551 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dde1c2-c15e-47e6-8a58-32111248f8f1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:58.011335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:58.019197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 461/925] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:07:57 2022] POST /identity/v3/endpoints => generated 347 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:07:58.021328 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dde1c2-c15e-47e6-8a58-32111248f8f1 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:58.059932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:58.060181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cad20-eb78-4510-b681-6be491052b25 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:58.113041 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa330d-0919-4e89-9879-439d70ba496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:58.113714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa330d-0919-4e89-9879-439d70ba496f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:58.114051 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa330d-0919-4e89-9879-439d70ba496f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:58.114309 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa330d-0919-4e89-9879-439d70ba496f None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:58.115737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa330d-0919-4e89-9879-439d70ba496f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:58.116161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa330d-0919-4e89-9879-439d70ba496f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:58.117714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa330d-0919-4e89-9879-439d70ba496f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:58.123560 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 465/926] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:07:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:58.129762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa330d-0919-4e89-9879-439d70ba496f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:58.181294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dde1c2-c15e-47e6-8a58-32111248f8f1 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:58.230323 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314ae1d-fa0c-4b42-ba94-7d455948c0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:58.230989 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314ae1d-fa0c-4b42-ba94-7d455948c0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:58.231643 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314ae1d-fa0c-4b42-ba94-7d455948c0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:58.231925 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314ae1d-fa0c-4b42-ba94-7d455948c0a7 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:58.232577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314ae1d-fa0c-4b42-ba94-7d455948c0a7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:58.232890 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314ae1d-fa0c-4b42-ba94-7d455948c0a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:58.234281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314ae1d-fa0c-4b42-ba94-7d455948c0a7 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:58.240816 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 462/927] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 27 04:07:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:58.241968 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c29f55-5356-474c-a34a-b666e2bec1e3 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:58.242259 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c29f55-5356-474c-a34a-b666e2bec1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:58.242537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c29f55-5356-474c-a34a-b666e2bec1e3 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:58.243991 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 463/928] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:07:58.247473 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c29f55-5356-474c-a34a-b666e2bec1e3 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:58.260580 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa330d-0919-4e89-9879-439d70ba496f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:58.282129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:58.298315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f549b2a-0308-41d2-872b-ee18ca171d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:58.298974 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f549b2a-0308-41d2-872b-ee18ca171d99 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:58.299263 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f549b2a-0308-41d2-872b-ee18ca171d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:58.299542 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f549b2a-0308-41d2-872b-ee18ca171d99 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:58.300189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f549b2a-0308-41d2-872b-ee18ca171d99 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:58.300503 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f549b2a-0308-41d2-872b-ee18ca171d99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:58.302393 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f549b2a-0308-41d2-872b-ee18ca171d99 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:58.307655 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 466/929] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 27 04:07:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:07:58.308896 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62201528-8e95-4e26-bb11-2d341c7f1826 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:58.309178 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62201528-8e95-4e26-bb11-2d341c7f1826 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:58.309455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62201528-8e95-4e26-bb11-2d341c7f1826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:58.327993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-62201528-8e95-4e26-bb11-2d341c7f1826 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:07:58.329186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-62201528-8e95-4e26-bb11-2d341c7f1826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:07:58.352501 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:58.370456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c29f55-5356-474c-a34a-b666e2bec1e3 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:58.409166 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 467/930] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:07:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:07:58.410375 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62201528-8e95-4e26-bb11-2d341c7f1826 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:58.419537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bc473-9cb8-45a9-b5b7-3db55caae179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:58.420153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bc473-9cb8-45a9-b5b7-3db55caae179 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:58.420434 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bc473-9cb8-45a9-b5b7-3db55caae179 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:58.420707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bc473-9cb8-45a9-b5b7-3db55caae179 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:58.421425 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bc473-9cb8-45a9-b5b7-3db55caae179 None admin] RBAC: Adding query filter params (interface=public, service_id=eef3d575fe364a3f84821ddb980041a8, region_id=RegionOne) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:58.421734 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bc473-9cb8-45a9-b5b7-3db55caae179 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:58.423139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bc473-9cb8-45a9-b5b7-3db55caae179 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:58.435775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 464/931] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 27 04:07:58 2022] GET /identity/v3/endpoints?service_id=eef3d575fe364a3f84821ddb980041a8&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:07:58.437729 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bc473-9cb8-45a9-b5b7-3db55caae179 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:58.534028 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62201528-8e95-4e26-bb11-2d341c7f1826 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:58.553278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:58.573529 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bc473-9cb8-45a9-b5b7-3db55caae179 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:58.580553 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4def09-be65-4727-9d9b-6a7459d846a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:58.581454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4def09-be65-4727-9d9b-6a7459d846a9 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:58.581931 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4def09-be65-4727-9d9b-6a7459d846a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:58.582398 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4def09-be65-4727-9d9b-6a7459d846a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:58.583320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4def09-be65-4727-9d9b-6a7459d846a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:58.584892 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4def09-be65-4727-9d9b-6a7459d846a9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:58.615456 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 468/932] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:07:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:07:58.622796 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa47d44-8dad-4478-b26e-aa59d25a7b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:58.623875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa47d44-8dad-4478-b26e-aa59d25a7b50 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:58.624375 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa47d44-8dad-4478-b26e-aa59d25a7b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:58.624933 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa47d44-8dad-4478-b26e-aa59d25a7b50 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:58.625854 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa47d44-8dad-4478-b26e-aa59d25a7b50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:58.627791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa47d44-8dad-4478-b26e-aa59d25a7b50 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:58.635683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 465/933] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 27 04:07:58 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:07:58.713038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4def09-be65-4727-9d9b-6a7459d846a9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:58.833113 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4def09-be65-4727-9d9b-6a7459d846a9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:58.869822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e331f4-5aa0-441b-92d0-8598ffe95d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:58.870617 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e331f4-5aa0-441b-92d0-8598ffe95d6e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:58.870992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e331f4-5aa0-441b-92d0-8598ffe95d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:58.871336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e331f4-5aa0-441b-92d0-8598ffe95d6e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:58.882599 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e331f4-5aa0-441b-92d0-8598ffe95d6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:07:58.888106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-b4e331f4-5aa0-441b-92d0-8598ffe95d6e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 04:07:58.888106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:58.888106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:58.888106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:58.888106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:58.888106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:58.888106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:58.888106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:58.888106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:58.888106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:58.888106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:58.888106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:58.888106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:07:58.888106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:07:58.888106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:07:58.888106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:07:58.889228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:07:58.889228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:07:58.889228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:07:58.889228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:07:58.889228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:58.889228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:58.889228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:58.889228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:58.889228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:58.889228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:58.889228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:58.889228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:58.889228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:58.889228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:58.889228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:58.889228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:58.890319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:58.890319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:58.890319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:58.890319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:58.890319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:07:58.890319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:07:58.890319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:07:58.890319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:07:58.890319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:07:58.890319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:07:58.890319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 04:07:58.890319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:58.894782 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 469/934] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Sep 27 04:07:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:58.898241 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa47d44-8dad-4478-b26e-aa59d25a7b50 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:58.913992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:59.012231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa47d44-8dad-4478-b26e-aa59d25a7b50 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:59.048297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ef37f-eecf-4ecf-a4d0-76df58d79aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:59.049208 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ef37f-eecf-4ecf-a4d0-76df58d79aec None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:59.049688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ef37f-eecf-4ecf-a4d0-76df58d79aec None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:59.050179 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ef37f-eecf-4ecf-a4d0-76df58d79aec None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:59.051163 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ef37f-eecf-4ecf-a4d0-76df58d79aec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:59.051670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ef37f-eecf-4ecf-a4d0-76df58d79aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:59.053765 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ef37f-eecf-4ecf-a4d0-76df58d79aec None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:59.062819 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 466/935] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 27 04:07:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:59.071819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e331f4-5aa0-441b-92d0-8598ffe95d6e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:59.105472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:59.177930 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e331f4-5aa0-441b-92d0-8598ffe95d6e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:59.213879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d62874-c8b8-486a-beb3-296a10b739ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:59.214556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d62874-c8b8-486a-beb3-296a10b739ac None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:59.214912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d62874-c8b8-486a-beb3-296a10b739ac None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:59.215325 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d62874-c8b8-486a-beb3-296a10b739ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:59.226171 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d62874-c8b8-486a-beb3-296a10b739ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:59.227673 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d62874-c8b8-486a-beb3-296a10b739ac None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:59.242904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-80d62874-c8b8-486a-beb3-296a10b739ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:59.242904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:59.242904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:59.242904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:59.242904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:59.242904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:59.242904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:59.242904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:59.242904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:59.242904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:59.242904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:59.242904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:59.242904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:59.242904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:59.242904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:59.242904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:59.243881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:59.243881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:59.243881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:59.243881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:59.243881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:59.243881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:59.243881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:59.243881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:59.243881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:59.243881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:59.243881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:59.243881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:59.243881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:59.243881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:59.243881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:59.243881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:59.243881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:59.244784 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:59.244784 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:59.244784 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:59.244784 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 470/936] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:59.250038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ef37f-eecf-4ecf-a4d0-76df58d79aec None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:59.327541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:59.360416 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ef37f-eecf-4ecf-a4d0-76df58d79aec None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:59.396418 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f079320-1897-40aa-bb66-b4e131a9e8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:59.397102 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f079320-1897-40aa-bb66-b4e131a9e8db None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:59.397732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f079320-1897-40aa-bb66-b4e131a9e8db None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:59.398013 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f079320-1897-40aa-bb66-b4e131a9e8db None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:59.398674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f079320-1897-40aa-bb66-b4e131a9e8db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:59.399016 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f079320-1897-40aa-bb66-b4e131a9e8db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:59.400407 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f079320-1897-40aa-bb66-b4e131a9e8db None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:59.414167 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 467/937] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:59.419742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d62874-c8b8-486a-beb3-296a10b739ac None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:59.509665 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:59.529782 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d62874-c8b8-486a-beb3-296a10b739ac None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:59.565996 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba74b7b-6600-4ad4-bf0c-fd4dabb03db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:59.566638 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba74b7b-6600-4ad4-bf0c-fd4dabb03db9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:59.566955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba74b7b-6600-4ad4-bf0c-fd4dabb03db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:59.567234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba74b7b-6600-4ad4-bf0c-fd4dabb03db9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:59.577341 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba74b7b-6600-4ad4-bf0c-fd4dabb03db9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:59.578873 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba74b7b-6600-4ad4-bf0c-fd4dabb03db9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:59.591412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-fba74b7b-6600-4ad4-bf0c-fd4dabb03db9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 04:07:59.591412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:59.591412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:59.591412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:59.591412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:59.591412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:59.591412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:59.591412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:59.591412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:59.591412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:59.591412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:59.591412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:59.591412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:07:59.591412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:07:59.591412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:07:59.591412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:07:59.592408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:59.592408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:59.592408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:07:59.592408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:59.592408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:07:59.592408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:07:59.592408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:59.592408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:59.592408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:59.592408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:59.592408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:59.592408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:59.592408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:59.592408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:59.592408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:59.592408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:59.592408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:59.592408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:59.593380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:59.593380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:59.593380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:07:59.593380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:07:59.593380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:07:59.593380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:07:59.593380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:07:59.593380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:07:59.593380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 04:07:59.593380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:59.593380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 471/938] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 27 04:07:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:59.598593 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f079320-1897-40aa-bb66-b4e131a9e8db None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:59.712408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f079320-1897-40aa-bb66-b4e131a9e8db None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:59.743121 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:59.748675 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee0b2d-7978-4276-af34-ca2f03feebca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:59.749287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee0b2d-7978-4276-af34-ca2f03feebca None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:59.749579 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee0b2d-7978-4276-af34-ca2f03feebca None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:59.749858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee0b2d-7978-4276-af34-ca2f03feebca None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:59.750602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee0b2d-7978-4276-af34-ca2f03feebca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:07:59.750947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee0b2d-7978-4276-af34-ca2f03feebca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:59.752391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee0b2d-7978-4276-af34-ca2f03feebca None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:59.770379 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 468/939] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Sep 27 04:07:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:07:59.776566 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba74b7b-6600-4ad4-bf0c-fd4dabb03db9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:07:59.879593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba74b7b-6600-4ad4-bf0c-fd4dabb03db9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:07:59.915822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab2775-b544-4eb1-9177-ed32ddf74bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:07:59.916835 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab2775-b544-4eb1-9177-ed32ddf74bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:07:59.917323 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab2775-b544-4eb1-9177-ed32ddf74bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:07:59.917820 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab2775-b544-4eb1-9177-ed32ddf74bf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:07:59.929668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab2775-b544-4eb1-9177-ed32ddf74bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:07:59.931453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab2775-b544-4eb1-9177-ed32ddf74bf1 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:07:59.933461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:07:59.946883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-5aab2775-b544-4eb1-9177-ed32ddf74bf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:59.946883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:07:59.946883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:07:59.946883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:07:59.946883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:07:59.946883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:07:59.946883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:07:59.946883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:07:59.946883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:07:59.946883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:07:59.946883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:07:59.946883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:07:59.946883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:07:59.946883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:07:59.946883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:07:59.946883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:07:59.948121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:07:59.948121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:07:59.948121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:07:59.948121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:07:59.948121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:07:59.948121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:07:59.948121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:07:59.948121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:07:59.948121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:07:59.948121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:07:59.948121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:07:59.948121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:07:59.948121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:07:59.948121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:07:59.948121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:07:59.948121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:07:59.948121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:07:59.949267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:07:59.949267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:07:59.949267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:07:59.951344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 472/940] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:07:59.957081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee0b2d-7978-4276-af34-ca2f03feebca None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:00.068546 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee0b2d-7978-4276-af34-ca2f03feebca None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:00.110646 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd5d00-1ed7-4b55-af74-b8e85d3c13f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:00.111287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd5d00-1ed7-4b55-af74-b8e85d3c13f9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:00.111574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd5d00-1ed7-4b55-af74-b8e85d3c13f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:00.111855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd5d00-1ed7-4b55-af74-b8e85d3c13f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:00.112511 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd5d00-1ed7-4b55-af74-b8e85d3c13f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:00.112825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd5d00-1ed7-4b55-af74-b8e85d3c13f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:00.114206 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd5d00-1ed7-4b55-af74-b8e85d3c13f9 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:00.126707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 469/941] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:00.132267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab2775-b544-4eb1-9177-ed32ddf74bf1 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:00.237494 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab2775-b544-4eb1-9177-ed32ddf74bf1 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:00.272897 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82846fd7-0277-48c3-965a-49eb3449df3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:00.273907 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82846fd7-0277-48c3-965a-49eb3449df3b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:00.274397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82846fd7-0277-48c3-965a-49eb3449df3b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:00.274902 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82846fd7-0277-48c3-965a-49eb3449df3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:00.282527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82846fd7-0277-48c3-965a-49eb3449df3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:00.284405 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82846fd7-0277-48c3-965a-49eb3449df3b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:00.298581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-82846fd7-0277-48c3-965a-49eb3449df3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:08:00.298581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:00.298581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:00.298581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:00.298581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:00.298581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:00.298581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:00.298581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:00.298581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:00.298581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:00.298581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:00.298581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:00.298581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:08:00.298581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:08:00.298581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:08:00.299600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:08:00.299600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:00.299600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:00.299600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:00.299600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:00.299600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:00.299600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:00.299600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:00.299600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:00.299600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:00.299600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:00.299600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:00.299600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:00.299600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:00.299600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:00.299600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:00.299600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:00.300531 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:08:00.300531 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:08:00.300531 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:08:00.300531 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:08:00.300531 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:08:00.300531 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:08:00.300531 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:08:00.300531 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:00.303198 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 473/942] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:08:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:00.311893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd5d00-1ed7-4b55-af74-b8e85d3c13f9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:00.367625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:00.420969 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd5d00-1ed7-4b55-af74-b8e85d3c13f9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:00.426166 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9545ea-0c77-4413-88d4-ebf578e97b8e None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:00.426524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9545ea-0c77-4413-88d4-ebf578e97b8e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:00.426943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9545ea-0c77-4413-88d4-ebf578e97b8e None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:00.428589 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 474/943] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:00.433590 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d7e3b-5b91-46a7-a6a2-93c5eec025c9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:00.433947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d7e3b-5b91-46a7-a6a2-93c5eec025c9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:00.434304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d7e3b-5b91-46a7-a6a2-93c5eec025c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:00.453562 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ca2d7e3b-5b91-46a7-a6a2-93c5eec025c9 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:00.455293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ca2d7e3b-5b91-46a7-a6a2-93c5eec025c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:00.456304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c357dd9-4c67-411b-8b05-600d9d9d27ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:00.456924 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c357dd9-4c67-411b-8b05-600d9d9d27ce None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:00.457215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c357dd9-4c67-411b-8b05-600d9d9d27ce None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:00.457516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c357dd9-4c67-411b-8b05-600d9d9d27ce None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:00.458868 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c357dd9-4c67-411b-8b05-600d9d9d27ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:00.459291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c357dd9-4c67-411b-8b05-600d9d9d27ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:00.460752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c357dd9-4c67-411b-8b05-600d9d9d27ce None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:00.474955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 470/944] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:08:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:00.480822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c357dd9-4c67-411b-8b05-600d9d9d27ce None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:00.521193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:00.553220 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 475/945] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:08:00.605451 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c357dd9-4c67-411b-8b05-600d9d9d27ce None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:00.616377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:00.641546 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b4f9f-a0c2-4795-9e9d-34e3025ac18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:00.642132 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b4f9f-a0c2-4795-9e9d-34e3025ac18d None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:00.642417 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b4f9f-a0c2-4795-9e9d-34e3025ac18d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:00.642696 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b4f9f-a0c2-4795-9e9d-34e3025ac18d None admin] PATH_INFO: `/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/71c7a54c598642a4b9219ae21c34f0b0/roles/1971d31ccfa34212a9ae9350ac58dcb9` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:00.644934 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b4f9f-a0c2-4795-9e9d-34e3025ac18d None admin] RBAC: Authorizing `identity:create_grant(project_id=37e7a8d1446d4cdea0ba00124411cd93, user_id=71c7a54c598642a4b9219ae21c34f0b0, role_id=1971d31ccfa34212a9ae9350ac58dcb9)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:00.647026 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b4f9f-a0c2-4795-9e9d-34e3025ac18d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:00.661215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 471/946] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:08:00 2022] PUT /identity/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/71c7a54c598642a4b9219ae21c34f0b0/roles/1971d31ccfa34212a9ae9350ac58dcb9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:08:00.841333 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d7e3b-5b91-46a7-a6a2-93c5eec025c9 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:00.901697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd9cdf-df77-4a70-8b76-01e007b277ef None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:00.901996 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd9cdf-df77-4a70-8b76-01e007b277ef None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:00.902210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd9cdf-df77-4a70-8b76-01e007b277ef None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:00.903823 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 472/947] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:08:00.908773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b481f0-b32a-496c-a561-b0fe0dcb8366 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:00.909076 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b481f0-b32a-496c-a561-b0fe0dcb8366 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:00.909335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b481f0-b32a-496c-a561-b0fe0dcb8366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:00.928284 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b9b481f0-b32a-496c-a561-b0fe0dcb8366 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:00.929474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b9b481f0-b32a-496c-a561-b0fe0dcb8366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:00.966105 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d7e3b-5b91-46a7-a6a2-93c5eec025c9 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:00.998240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 473/948] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:08:00.999763 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce2081-12ed-4271-8542-c7d26803c42c None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:01.000234 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce2081-12ed-4271-8542-c7d26803c42c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:01.000664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce2081-12ed-4271-8542-c7d26803c42c None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:01.002046 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 474/949] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:01.007760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0e8bc-2d60-49d9-a0c7-0ff6b1d363b8 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:01.008248 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0e8bc-2d60-49d9-a0c7-0ff6b1d363b8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:01.008897 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0e8bc-2d60-49d9-a0c7-0ff6b1d363b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:01.014824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54bf22b-0bf6-4ea7-81ec-2f74d966c7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:01.015663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bf22b-0bf6-4ea7-81ec-2f74d966c7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:01.016010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bf22b-0bf6-4ea7-81ec-2f74d966c7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:01.016351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bf22b-0bf6-4ea7-81ec-2f74d966c7b6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:01.017120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54bf22b-0bf6-4ea7-81ec-2f74d966c7b6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:01.018543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54bf22b-0bf6-4ea7-81ec-2f74d966c7b6 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:01.028493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-b54bf22b-0bf6-4ea7-81ec-2f74d966c7b6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 04:08:01.028493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:01.028493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:08:01.028493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:08:01.028493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:08:01.028493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:08:01.028493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:08:01.028493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:08:01.028493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 04:08:01.028493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:01.028493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:08:01.028493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:01.028493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:01.028493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:01.028493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:01.028493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:01.028493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:01.029536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:01.029536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:01.029536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:01.029536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:01.029536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:01.029536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:01.029536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:08:01.029536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:08:01.029536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:08:01.029536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:08:01.029536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:01.029536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:01.029536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:01.029536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:01.029536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:01.029536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:01.030381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:01.030381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:01.030381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:01.030381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:01.030381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:01.030381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:01.030381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:01.030381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:01.030381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:01.030381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:01.030381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:08:01.030381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:08:01.030381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 04:08:01.030381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:01.030381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 476/950] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:08:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:01.031230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e9f0e8bc-2d60-49d9-a0c7-0ff6b1d363b8 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:01.037155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e9f0e8bc-2d60-49d9-a0c7-0ff6b1d363b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:01.037822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54bf22b-0bf6-4ea7-81ec-2f74d966c7b6 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:01.091115 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:01.119848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 475/951] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:01.155096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54bf22b-0bf6-4ea7-81ec-2f74d966c7b6 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:01.190907 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30204aa6-e8f9-4e2b-9506-a6e18fbf41fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:01.192142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30204aa6-e8f9-4e2b-9506-a6e18fbf41fa None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:01.192684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30204aa6-e8f9-4e2b-9506-a6e18fbf41fa None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:01.193213 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30204aa6-e8f9-4e2b-9506-a6e18fbf41fa None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:01.194092 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30204aa6-e8f9-4e2b-9506-a6e18fbf41fa None admin] RBAC: Adding query filter params (name=compute) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:01.194615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30204aa6-e8f9-4e2b-9506-a6e18fbf41fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:01.196265 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30204aa6-e8f9-4e2b-9506-a6e18fbf41fa None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:01.201672 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 477/952] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 27 04:08:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:01.207806 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0e8bc-2d60-49d9-a0c7-0ff6b1d363b8 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:01.239812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:01.305351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30204aa6-e8f9-4e2b-9506-a6e18fbf41fa None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:01.321388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0e8bc-2d60-49d9-a0c7-0ff6b1d363b8 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:01.366194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889b583-e2c0-401c-a895-57dc15795128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:01.366840 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889b583-e2c0-401c-a895-57dc15795128 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:01.367242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889b583-e2c0-401c-a895-57dc15795128 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:01.367648 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889b583-e2c0-401c-a895-57dc15795128 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:01.368295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889b583-e2c0-401c-a895-57dc15795128 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:01.368600 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889b583-e2c0-401c-a895-57dc15795128 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:01.370233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889b583-e2c0-401c-a895-57dc15795128 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:01.376933 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 476/953] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 27 04:08:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:01.424003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889b583-e2c0-401c-a895-57dc15795128 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:01.434555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30204aa6-e8f9-4e2b-9506-a6e18fbf41fa None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:01.450879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:01.480231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a702da-687a-446a-972f-72f1b4742100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:01.481499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a702da-687a-446a-972f-72f1b4742100 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:01.482401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a702da-687a-446a-972f-72f1b4742100 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:01.482890 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a702da-687a-446a-972f-72f1b4742100 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:01.483689 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a702da-687a-446a-972f-72f1b4742100 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:01.485936 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a702da-687a-446a-972f-72f1b4742100 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:01.497404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-20a702da-687a-446a-972f-72f1b4742100 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:08:01.497404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:01.497404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:08:01.497404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:08:01.497404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:08:01.497404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:08:01.497404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:08:01.497404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:08:01.497404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:08:01.497404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:01.497404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:08:01.497404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:01.497404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:01.497404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:01.497404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:01.497404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:01.497404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:01.498472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:01.498472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:01.498472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:01.498472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:01.498472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:01.498472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:01.498472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:08:01.498472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:08:01.498472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:08:01.498472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:08:01.498472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:01.498472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:01.498472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:01.498472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:01.498472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:01.498472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:01.499344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:01.499344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:01.499344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:01.499344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:01.499344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:01.499344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:01.499344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:01.499344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:01.499344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:01.499344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:01.499344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:08:01.499344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:08:01.499344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:08:01.499344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:01.505987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 478/954] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 27 04:08:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:08:01.507647 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a702da-687a-446a-972f-72f1b4742100 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:01.537075 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:01.544254 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889b583-e2c0-401c-a895-57dc15795128 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:01.584007 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0559d-ba77-4031-8564-4dbf8347235a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:01.584621 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0559d-ba77-4031-8564-4dbf8347235a None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:01.584911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0559d-ba77-4031-8564-4dbf8347235a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:01.585189 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0559d-ba77-4031-8564-4dbf8347235a None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:01.585846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0559d-ba77-4031-8564-4dbf8347235a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:01.587360 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0559d-ba77-4031-8564-4dbf8347235a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:01.591455 dv-cinder-859186-3-smb devstack@keystone.service[81375]: WARNING keystone.server.flask.common [None req-c2e0559d-ba77-4031-8564-4dbf8347235a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 27 04:08:01.614950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.sql.core [None req-c2e0559d-ba77-4031-8564-4dbf8347235a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 27 04:08:01.614950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 27 04:08:01.614950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [parameters: {'id': '7cbb6a50abcf4af48443c7dc446d9af9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 27 04:08:01.614950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81375) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 27 04:08:01.624240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-c2e0559d-ba77-4031-8564-4dbf8347235a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7cbb6a50abcf4af48443c7dc446d9af9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7cbb6a50abcf4af48443c7dc446d9af9. Sep 27 04:08:01.624240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:01.624240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 04:08:01.624240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 04:08:01.624240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 04:08:01.624240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 04:08:01.624240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 04:08:01.624240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 04:08:01.624240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 04:08:01.624240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application conn.query(q) Sep 27 04:08:01.624240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 04:08:01.624240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 04:08:01.624240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 04:08:01.625366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result.read() Sep 27 04:08:01.625366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 04:08:01.625366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 04:08:01.625366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 04:08:01.625366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 04:08:01.625366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 04:08:01.625366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 04:08:01.625366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 04:08:01.625366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 04:08:01.625366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 27 04:08:01.625366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:01.625366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 27 04:08:01.625366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:01.625366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:01.625366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 27 04:08:01.625366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 27 04:08:01.625366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 27 04:08:01.625366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 27 04:08:01.626335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 04:08:01.626335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application next(self.gen) Sep 27 04:08:01.626335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 27 04:08:01.626335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application yield resource Sep 27 04:08:01.626335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 04:08:01.626335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application next(self.gen) Sep 27 04:08:01.626335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 27 04:08:01.626335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.session.rollback() Sep 27 04:08:01.626335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 04:08:01.626335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.force_reraise() Sep 27 04:08:01.626335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 04:08:01.626335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise self.value Sep 27 04:08:01.626335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 27 04:08:01.626335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 27 04:08:01.626335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 27 04:08:01.626335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application session.commit() Sep 27 04:08:01.626335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 27 04:08:01.627287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 27 04:08:01.627287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 27 04:08:01.627287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._prepare_impl() Sep 27 04:08:01.627287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 27 04:08:01.627287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.session.flush() Sep 27 04:08:01.627287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 27 04:08:01.627287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._flush(objects) Sep 27 04:08:01.627287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 27 04:08:01.627287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 27 04:08:01.627287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 27 04:08:01.627287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application compat.raise_( Sep 27 04:08:01.627287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 04:08:01.627287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception Sep 27 04:08:01.627287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 27 04:08:01.627287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application flush_context.execute() Sep 27 04:08:01.627287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 27 04:08:01.627287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rec.execute(self) Sep 27 04:08:01.628185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 27 04:08:01.628185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 27 04:08:01.628185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 27 04:08:01.628185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 27 04:08:01.628185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 27 04:08:01.628185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 27 04:08:01.628185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 27 04:08:01.628185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 27 04:08:01.628185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 27 04:08:01.628185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 27 04:08:01.628185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 27 04:08:01.628185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 27 04:08:01.628185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 27 04:08:01.628185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 27 04:08:01.628185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 27 04:08:01.629111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 27 04:08:01.629111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 04:08:01.629111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception Sep 27 04:08:01.629111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 04:08:01.629111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 04:08:01.629111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 04:08:01.629111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 04:08:01.629111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 04:08:01.629111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 04:08:01.629111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 04:08:01.629111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application conn.query(q) Sep 27 04:08:01.629111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 04:08:01.629111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 04:08:01.629111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 04:08:01.629111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result.read() Sep 27 04:08:01.629111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 04:08:01.629111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 04:08:01.630756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 04:08:01.630756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 04:08:01.630756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 04:08:01.630756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 04:08:01.630756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 04:08:01.630756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 04:08:01.630756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 27 04:08:01.630756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 27 04:08:01.630756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [parameters: {'id': '7cbb6a50abcf4af48443c7dc446d9af9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 27 04:08:01.630756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 27 04:08:01.630756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:01.630756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:08:01.630756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:01.630756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:01.630756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 27 04:08:01.631614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 27 04:08:01.631614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 27 04:08:01.631614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 27 04:08:01.631614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 27 04:08:01.631614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:01.631614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:08:01.631614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:01.631614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:01.631614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:01.631614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:01.631614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:01.631614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:01.631614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:01.631614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:01.631614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:01.631614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:01.631614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:01.632926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:01.632926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 27 04:08:01.632926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 27 04:08:01.632926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:01.632926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:01.632926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 27 04:08:01.632926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 27 04:08:01.632926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7cbb6a50abcf4af48443c7dc446d9af9. Sep 27 04:08:01.632926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:01.632926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 477/955] 10.222.0.48 () {60 vars in 1140 bytes} [Tue Sep 27 04:08:01 2022] POST /identity/v3/projects => generated 262 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:08:01.637635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0559d-ba77-4031-8564-4dbf8347235a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:01.647192 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a702da-687a-446a-972f-72f1b4742100 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:01.682324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bb29f-508e-4bea-951a-c297133a6459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:01.682877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bb29f-508e-4bea-951a-c297133a6459 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:01.683145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bb29f-508e-4bea-951a-c297133a6459 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:01.683432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bb29f-508e-4bea-951a-c297133a6459 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:01.684082 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bb29f-508e-4bea-951a-c297133a6459 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:01.684392 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bb29f-508e-4bea-951a-c297133a6459 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:01.686342 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bb29f-508e-4bea-951a-c297133a6459 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:01.691939 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 479/956] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 27 04:08:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:08:01.703948 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bb29f-508e-4bea-951a-c297133a6459 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:01.762570 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0559d-ba77-4031-8564-4dbf8347235a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:01.772062 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:01.799353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf10a39-39a9-4d3a-9d37-1caac7d6007a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:01.799987 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf10a39-39a9-4d3a-9d37-1caac7d6007a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:01.800265 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf10a39-39a9-4d3a-9d37-1caac7d6007a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:01.800537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf10a39-39a9-4d3a-9d37-1caac7d6007a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:01.807979 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf10a39-39a9-4d3a-9d37-1caac7d6007a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:01.809685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf10a39-39a9-4d3a-9d37-1caac7d6007a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:01.821669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-3bf10a39-39a9-4d3a-9d37-1caac7d6007a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:08:01.821669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:01.821669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:01.821669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:01.821669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:01.821669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:01.821669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:01.821669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:01.821669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:01.821669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:01.821669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:01.821669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:01.821669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:08:01.821669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:08:01.821669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:08:01.822583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:08:01.822583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:01.822583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:01.822583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:01.822583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:01.822583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:01.822583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:01.822583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:01.822583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:01.822583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:01.822583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:01.822583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:01.822583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:01.822583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:01.822583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:01.822583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:01.822583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:01.824027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:08:01.824027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:08:01.824027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:08:01.824027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:08:01.824027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:08:01.824027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:08:01.824027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:08:01.824027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:01.824027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 478/957] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:01.828219 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf10a39-39a9-4d3a-9d37-1caac7d6007a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:01.845361 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:01.857572 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bb29f-508e-4bea-951a-c297133a6459 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:01.905257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89343c-bcf0-4cb9-a091-3cd0ef3f3078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:01.906172 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89343c-bcf0-4cb9-a091-3cd0ef3f3078 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:01.906939 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89343c-bcf0-4cb9-a091-3cd0ef3f3078 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:01.907764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89343c-bcf0-4cb9-a091-3cd0ef3f3078 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:01.908810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89343c-bcf0-4cb9-a091-3cd0ef3f3078 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:01.909296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89343c-bcf0-4cb9-a091-3cd0ef3f3078 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:01.910846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89343c-bcf0-4cb9-a091-3cd0ef3f3078 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:01.924196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 480/958] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 27 04:08:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:01.926507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89343c-bcf0-4cb9-a091-3cd0ef3f3078 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:01.953609 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf10a39-39a9-4d3a-9d37-1caac7d6007a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:01.998341 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90246b38-4f40-41a6-9e59-bcb0072cb45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:01.999241 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90246b38-4f40-41a6-9e59-bcb0072cb45d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:02.002058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90246b38-4f40-41a6-9e59-bcb0072cb45d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:02.002543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90246b38-4f40-41a6-9e59-bcb0072cb45d None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:02.003432 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90246b38-4f40-41a6-9e59-bcb0072cb45d None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:02.003884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90246b38-4f40-41a6-9e59-bcb0072cb45d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:02.005539 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90246b38-4f40-41a6-9e59-bcb0072cb45d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:02.026846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 479/959] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 27 04:08:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:02.043949 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89343c-bcf0-4cb9-a091-3cd0ef3f3078 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:02.047522 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:02.084695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c57da-b579-48d8-be41-7f3d1fed9f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:02.085729 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c57da-b579-48d8-be41-7f3d1fed9f18 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:02.086251 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c57da-b579-48d8-be41-7f3d1fed9f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:02.086806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c57da-b579-48d8-be41-7f3d1fed9f18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:02.087747 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c57da-b579-48d8-be41-7f3d1fed9f18 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:02.089563 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c57da-b579-48d8-be41-7f3d1fed9f18 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:02.116040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 481/960] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:08:01 2022] POST /identity/v3/endpoints => generated 349 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:08:02.977590 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823da41-9466-4e11-8586-fc374aa267cd None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:02.978117 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823da41-9466-4e11-8586-fc374aa267cd None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:02.978196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823da41-9466-4e11-8586-fc374aa267cd None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:02.980006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 480/961] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:02.985691 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98fb8a-a4b8-4b8e-8c71-442a8b985c39 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:02.986216 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98fb8a-a4b8-4b8e-8c71-442a8b985c39 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:02.986297 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98fb8a-a4b8-4b8e-8c71-442a8b985c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:03.006477 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-3f98fb8a-a4b8-4b8e-8c71-442a8b985c39 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:03.007733 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3f98fb8a-a4b8-4b8e-8c71-442a8b985c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:03.094685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 482/962] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:03.367565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823da41-9466-4e11-8586-fc374aa267cd None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:03.450375 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:03.484199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823da41-9466-4e11-8586-fc374aa267cd None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:03.518824 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5fd1d-37b8-4087-b200-f0046c965230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:03.519457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5fd1d-37b8-4087-b200-f0046c965230 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:03.519743 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5fd1d-37b8-4087-b200-f0046c965230 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:03.520024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5fd1d-37b8-4087-b200-f0046c965230 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:03.530987 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5fd1d-37b8-4087-b200-f0046c965230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:08:03.535945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-84a5fd1d-37b8-4087-b200-f0046c965230 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 04:08:03.535945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:03.535945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:03.535945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:03.535945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:03.535945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:03.535945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:03.535945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:03.535945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:03.535945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:03.535945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:03.535945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:03.535945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:08:03.535945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:08:03.535945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:08:03.535945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:08:03.537534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:08:03.537534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:08:03.537534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:08:03.537534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:08:03.537534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:03.537534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:03.537534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:03.537534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:03.537534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:03.537534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:03.537534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:03.537534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:03.537534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:03.537534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:03.537534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:03.537534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:03.538385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:03.538385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:03.538385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:03.538385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:03.538385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:08:03.538385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:08:03.538385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:08:03.538385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:08:03.538385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:08:03.538385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:08:03.538385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 04:08:03.538385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:03.538385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 481/963] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Sep 27 04:08:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:03.543931 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98fb8a-a4b8-4b8e-8c71-442a8b985c39 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:03.633925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:03.654841 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98fb8a-a4b8-4b8e-8c71-442a8b985c39 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:03.692120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd513bb2-0179-495a-baa0-8c79e438e7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:03.694062 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd513bb2-0179-495a-baa0-8c79e438e7ae None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:03.694536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd513bb2-0179-495a-baa0-8c79e438e7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:03.695018 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd513bb2-0179-495a-baa0-8c79e438e7ae None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:03.695901 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd513bb2-0179-495a-baa0-8c79e438e7ae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:03.696409 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd513bb2-0179-495a-baa0-8c79e438e7ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:03.697993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd513bb2-0179-495a-baa0-8c79e438e7ae None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:03.703910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0db6f-eddc-467e-95c6-d37cb4e5aa02 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:03.704469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0db6f-eddc-467e-95c6-d37cb4e5aa02 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:03.705435 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0db6f-eddc-467e-95c6-d37cb4e5aa02 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:03.707339 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 482/964] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:08:03.713124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 483/965] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 27 04:08:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:03.714633 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269fc46-1a7f-4ded-9c70-75d1c2c1a6ff None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:03.714949 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269fc46-1a7f-4ded-9c70-75d1c2c1a6ff None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:03.715231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269fc46-1a7f-4ded-9c70-75d1c2c1a6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:03.719745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd513bb2-0179-495a-baa0-8c79e438e7ae None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:03.738277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9269fc46-1a7f-4ded-9c70-75d1c2c1a6ff None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:03.740664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9269fc46-1a7f-4ded-9c70-75d1c2c1a6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:03.830769 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd513bb2-0179-495a-baa0-8c79e438e7ae None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:03.837416 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 483/966] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:03.870523 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da173fbc-27c6-4bb8-8774-4c7cde823acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:03.871211 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da173fbc-27c6-4bb8-8774-4c7cde823acb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:03.871496 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da173fbc-27c6-4bb8-8774-4c7cde823acb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:03.871777 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da173fbc-27c6-4bb8-8774-4c7cde823acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:03.883384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da173fbc-27c6-4bb8-8774-4c7cde823acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:03.884902 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da173fbc-27c6-4bb8-8774-4c7cde823acb None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:03.893182 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:03.900677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-da173fbc-27c6-4bb8-8774-4c7cde823acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:08:03.900677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:03.900677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:03.900677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:03.900677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:03.900677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:03.900677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:03.900677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:03.900677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:03.900677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:03.900677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:03.900677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:03.900677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:08:03.900677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:08:03.900677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:08:03.900677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:08:03.901635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:03.901635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:03.901635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:03.901635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:03.901635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:03.901635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:03.901635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:03.901635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:03.901635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:03.901635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:03.901635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:03.901635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:03.901635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:03.901635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:03.901635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:03.901635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:03.901635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:08:03.902559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:08:03.902559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:08:03.902559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:03.902559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 484/967] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:08:03.907791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269fc46-1a7f-4ded-9c70-75d1c2c1a6ff None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:03.970131 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:04.019127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269fc46-1a7f-4ded-9c70-75d1c2c1a6ff None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:04.057129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662c0ff-1969-4284-83de-5b6a3f9e5c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:04.058126 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662c0ff-1969-4284-83de-5b6a3f9e5c84 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:04.058622 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662c0ff-1969-4284-83de-5b6a3f9e5c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:04.059142 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662c0ff-1969-4284-83de-5b6a3f9e5c84 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:04.059991 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662c0ff-1969-4284-83de-5b6a3f9e5c84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:04.060535 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662c0ff-1969-4284-83de-5b6a3f9e5c84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:04.062103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662c0ff-1969-4284-83de-5b6a3f9e5c84 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:04.074329 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 484/968] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:04.079682 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da173fbc-27c6-4bb8-8774-4c7cde823acb None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:04.141664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662c0ff-1969-4284-83de-5b6a3f9e5c84 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:04.186941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da173fbc-27c6-4bb8-8774-4c7cde823acb None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:04.225904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948fb99-a954-4611-8699-c5e79509013d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:04.226578 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948fb99-a954-4611-8699-c5e79509013d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:04.226899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948fb99-a954-4611-8699-c5e79509013d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:04.227177 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948fb99-a954-4611-8699-c5e79509013d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:04.238197 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7948fb99-a954-4611-8699-c5e79509013d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:04.240347 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7948fb99-a954-4611-8699-c5e79509013d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:04.259145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-7948fb99-a954-4611-8699-c5e79509013d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 04:08:04.259145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:04.259145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:04.259145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:04.259145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:04.259145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:04.259145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:04.259145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:04.259145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:04.259145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:04.259145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:04.259145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:04.259145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:08:04.259145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:08:04.259145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:08:04.259145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:08:04.260184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:04.260184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:04.260184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:08:04.260184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:08:04.260184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:08:04.260184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:08:04.260184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:04.260184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:04.260184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:04.260184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:04.260184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:04.260184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:04.260184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:04.260184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:04.260184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:04.260184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:04.260184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:04.260184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:04.261140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:04.261140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:04.261140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:08:04.261140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:08:04.261140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:08:04.261140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:08:04.261140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:08:04.261140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:08:04.261140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 04:08:04.261140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:04.264734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 485/969] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 27 04:08:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:04.270342 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948fb99-a954-4611-8699-c5e79509013d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:04.271630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662c0ff-1969-4284-83de-5b6a3f9e5c84 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:04.294587 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:04.312311 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4d98c-d8dc-4b29-b380-8a79dc27660c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:04.312939 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4d98c-d8dc-4b29-b380-8a79dc27660c None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:04.313209 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4d98c-d8dc-4b29-b380-8a79dc27660c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:04.313526 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4d98c-d8dc-4b29-b380-8a79dc27660c None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:04.314189 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4d98c-d8dc-4b29-b380-8a79dc27660c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:04.315611 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4d98c-d8dc-4b29-b380-8a79dc27660c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:04.340905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 485/970] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 27 04:08:04 2022] POST /identity/v3/services => generated 242 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:08:04.355321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:04.370345 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb782fd-ee55-4bbf-92d7-d527baff37e5 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:04.370672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb782fd-ee55-4bbf-92d7-d527baff37e5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:04.370947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb782fd-ee55-4bbf-92d7-d527baff37e5 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:04.372517 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 486/971] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:04.376309 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a92789-8b3d-4921-81cf-d11a45cd1040 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:04.376617 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a92789-8b3d-4921-81cf-d11a45cd1040 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:04.376859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a92789-8b3d-4921-81cf-d11a45cd1040 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:04.378612 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 487/972] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:04.383995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e0889-0e7b-42f3-9fa8-7f8ea8813a68 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:04.384330 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e0889-0e7b-42f3-9fa8-7f8ea8813a68 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:04.384559 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e0889-0e7b-42f3-9fa8-7f8ea8813a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:04.404045 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-290e0889-0e7b-42f3-9fa8-7f8ea8813a68 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:04.405281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-290e0889-0e7b-42f3-9fa8-7f8ea8813a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:04.420101 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948fb99-a954-4611-8699-c5e79509013d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:04.469832 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef29b8-0286-42ee-b9f8-fa64b4158ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:04.470461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef29b8-0286-42ee-b9f8-fa64b4158ddd None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:04.470769 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef29b8-0286-42ee-b9f8-fa64b4158ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:04.471051 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef29b8-0286-42ee-b9f8-fa64b4158ddd None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:04.472033 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef29b8-0286-42ee-b9f8-fa64b4158ddd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:04.472356 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef29b8-0286-42ee-b9f8-fa64b4158ddd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:04.474386 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef29b8-0286-42ee-b9f8-fa64b4158ddd None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:04.480872 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 488/973] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:04.482384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6aa96-2072-497e-ab2a-4335e3b802b0 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:04.482675 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6aa96-2072-497e-ab2a-4335e3b802b0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:04.483114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6aa96-2072-497e-ab2a-4335e3b802b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:04.502898 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 486/974] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Sep 27 04:08:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:04.504698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef29b8-0286-42ee-b9f8-fa64b4158ddd None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:04.510001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-76d6aa96-2072-497e-ab2a-4335e3b802b0 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:04.511301 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-76d6aa96-2072-497e-ab2a-4335e3b802b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:04.595530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 489/975] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:04.623842 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef29b8-0286-42ee-b9f8-fa64b4158ddd None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:04.639785 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:04.660047 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818bfea-9e04-4195-8eba-75d7ea350d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:04.660585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818bfea-9e04-4195-8eba-75d7ea350d66 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:04.660867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818bfea-9e04-4195-8eba-75d7ea350d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:04.661669 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818bfea-9e04-4195-8eba-75d7ea350d66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:04.735302 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818bfea-9e04-4195-8eba-75d7ea350d66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:04.736766 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818bfea-9e04-4195-8eba-75d7ea350d66 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:04.759024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6aa96-2072-497e-ab2a-4335e3b802b0 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:04.814909 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:04.849372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 487/976] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:08:04 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:08:04.850862 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818bfea-9e04-4195-8eba-75d7ea350d66 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:04.866230 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:04.901447 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6aa96-2072-497e-ab2a-4335e3b802b0 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:04.940120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a8993-78e3-4973-86df-d65bb78d7ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:04.940763 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a8993-78e3-4973-86df-d65bb78d7ccf None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:04.941051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a8993-78e3-4973-86df-d65bb78d7ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:04.941326 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a8993-78e3-4973-86df-d65bb78d7ccf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:04.941925 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a8993-78e3-4973-86df-d65bb78d7ccf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:04.943407 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a8993-78e3-4973-86df-d65bb78d7ccf None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:04.952964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-653a8993-78e3-4973-86df-d65bb78d7ccf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:08:04.952964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:04.952964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:08:04.952964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:08:04.952964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:08:04.952964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:08:04.952964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:08:04.952964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:08:04.952964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:08:04.952964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:04.952964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:08:04.952964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:04.952964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:04.952964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:04.952964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:04.952964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:04.952964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:04.954024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:04.954024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:04.954024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:04.954024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:04.954024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:04.954024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:04.954024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:08:04.954024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:08:04.954024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:08:04.954024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:08:04.954024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:04.954024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:04.954024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:04.954024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:04.954024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:04.954024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:04.955173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:04.955173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:04.955173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:04.955173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:04.955173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:04.955173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:04.955173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:04.955173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:04.955173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:04.955173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:04.955173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:08:04.955173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:08:04.955173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:08:04.955173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:04.955173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 490/977] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 27 04:08:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:08:04.955996 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a8993-78e3-4973-86df-d65bb78d7ccf None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:04.965897 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818bfea-9e04-4195-8eba-75d7ea350d66 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:05.004742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d39880-0db9-49f7-872a-738c2ebc4b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:05.005713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d39880-0db9-49f7-872a-738c2ebc4b40 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:05.006149 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d39880-0db9-49f7-872a-738c2ebc4b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:05.006430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d39880-0db9-49f7-872a-738c2ebc4b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:05.016538 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d39880-0db9-49f7-872a-738c2ebc4b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:05.017989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d39880-0db9-49f7-872a-738c2ebc4b40 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:05.034084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-a4d39880-0db9-49f7-872a-738c2ebc4b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:08:05.034084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:05.034084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:05.034084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:05.034084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:05.034084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:05.034084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:05.034084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:05.034084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:05.034084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:05.034084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:05.034084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:05.034084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:08:05.034084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:08:05.034084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:08:05.034084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:08:05.035313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:05.035313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:05.035313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:05.035313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:05.035313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:05.035313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:05.035313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:05.035313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:05.035313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:05.035313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:05.035313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:05.035313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:05.035313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:05.035313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:05.035313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:05.035313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:05.035313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:08:05.036795 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:08:05.036795 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:08:05.036795 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:05.036795 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 488/978] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:05.036795 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d39880-0db9-49f7-872a-738c2ebc4b40 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:05.067500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a8993-78e3-4973-86df-d65bb78d7ccf None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:05.070320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:05.105948 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9716de-627a-4bb0-b417-fa0086d8805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:05.106570 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9716de-627a-4bb0-b417-fa0086d8805b None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:05.106866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9716de-627a-4bb0-b417-fa0086d8805b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:05.107142 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9716de-627a-4bb0-b417-fa0086d8805b None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:05.107792 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9716de-627a-4bb0-b417-fa0086d8805b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:05.109215 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:05.109649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9716de-627a-4bb0-b417-fa0086d8805b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:05.125615 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.sql.core [None req-df9716de-627a-4bb0-b417-fa0086d8805b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 27 04:08:05.125615 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 27 04:08:05.125615 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [parameters: {'user_id': '2012b941df7e402cb65c063d9e00ac00', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 27 04:08:05.125615 dv-cinder-859186-3-smb devstack@keystone.service[81375]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81375) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 27 04:08:05.132957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-df9716de-627a-4bb0-b417-fa0086d8805b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 27 04:08:05.132957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:05.132957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 04:08:05.132957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 04:08:05.132957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 04:08:05.132957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 04:08:05.132957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 04:08:05.132957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 04:08:05.132957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 04:08:05.132957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application conn.query(q) Sep 27 04:08:05.132957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 04:08:05.132957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 04:08:05.132957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 04:08:05.132957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result.read() Sep 27 04:08:05.132957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 04:08:05.133871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 04:08:05.133871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 04:08:05.133871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 04:08:05.133871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 04:08:05.133871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 04:08:05.133871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 04:08:05.133871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 04:08:05.133871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 27 04:08:05.133871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:05.133871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 27 04:08:05.133871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:05.133871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:05.133871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 27 04:08:05.133871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 27 04:08:05.133871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 27 04:08:05.133871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 27 04:08:05.133871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 04:08:05.133871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application next(self.gen) Sep 27 04:08:05.134861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 27 04:08:05.134861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application yield resource Sep 27 04:08:05.134861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 04:08:05.134861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application next(self.gen) Sep 27 04:08:05.134861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 27 04:08:05.134861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.session.rollback() Sep 27 04:08:05.134861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 04:08:05.134861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.force_reraise() Sep 27 04:08:05.134861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 04:08:05.134861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise self.value Sep 27 04:08:05.134861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 27 04:08:05.134861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 27 04:08:05.134861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 27 04:08:05.134861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application session.commit() Sep 27 04:08:05.134861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 27 04:08:05.134861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 27 04:08:05.134861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 27 04:08:05.135782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._prepare_impl() Sep 27 04:08:05.135782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 27 04:08:05.135782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.session.flush() Sep 27 04:08:05.135782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 27 04:08:05.135782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._flush(objects) Sep 27 04:08:05.135782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 27 04:08:05.135782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 27 04:08:05.135782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 27 04:08:05.135782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application compat.raise_( Sep 27 04:08:05.135782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 04:08:05.135782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception Sep 27 04:08:05.135782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 27 04:08:05.135782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application flush_context.execute() Sep 27 04:08:05.135782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 27 04:08:05.135782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rec.execute(self) Sep 27 04:08:05.135782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 27 04:08:05.135782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 27 04:08:05.136682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 27 04:08:05.136682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 27 04:08:05.136682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 27 04:08:05.136682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 27 04:08:05.136682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 27 04:08:05.136682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 27 04:08:05.136682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 27 04:08:05.136682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 27 04:08:05.136682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 27 04:08:05.136682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 27 04:08:05.136682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 27 04:08:05.136682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 27 04:08:05.136682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 27 04:08:05.136682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 27 04:08:05.136682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 04:08:05.136682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception Sep 27 04:08:05.139384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 04:08:05.139384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 04:08:05.139384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 04:08:05.139384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 04:08:05.139384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 04:08:05.139384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 04:08:05.139384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 04:08:05.139384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application conn.query(q) Sep 27 04:08:05.139384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 04:08:05.139384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 04:08:05.139384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 04:08:05.139384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result.read() Sep 27 04:08:05.139384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 04:08:05.139384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 04:08:05.139384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 04:08:05.139384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 04:08:05.142200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 04:08:05.142200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 04:08:05.142200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 04:08:05.142200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 04:08:05.142200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 27 04:08:05.142200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 27 04:08:05.142200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [parameters: {'user_id': '2012b941df7e402cb65c063d9e00ac00', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 27 04:08:05.142200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 27 04:08:05.142200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:05.142200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:08:05.142200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:05.142200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:05.142200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:05.142200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:05.142200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:05.144712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:05.144712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:05.144712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:05.144712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:05.144712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:05.144712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:05.144712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:05.144712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 27 04:08:05.144712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 27 04:08:05.144712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:05.144712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:05.144712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:08:05.144712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:08:05.144712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:08:05.144712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:08:05.144712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 27 04:08:05.144712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 27 04:08:05.148483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 27 04:08:05.148483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 27 04:08:05.148483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 27 04:08:05.148483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 27 04:08:05.148483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 27 04:08:05.148483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:05.148483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 491/979] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Sep 27 04:08:04 2022] POST /identity/v3/users => generated 160 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:05.148483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9716de-627a-4bb0-b417-fa0086d8805b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:05.154025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d39880-0db9-49f7-872a-738c2ebc4b40 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:05.198415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9ccbb-7580-4068-a3cf-5c1d2ff51f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:05.199298 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9ccbb-7580-4068-a3cf-5c1d2ff51f9e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:05.199594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9ccbb-7580-4068-a3cf-5c1d2ff51f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:05.200147 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9ccbb-7580-4068-a3cf-5c1d2ff51f9e None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:05.200792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9ccbb-7580-4068-a3cf-5c1d2ff51f9e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:05.201189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9ccbb-7580-4068-a3cf-5c1d2ff51f9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:05.202459 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9ccbb-7580-4068-a3cf-5c1d2ff51f9e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:05.213169 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 489/980] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 27 04:08:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:05.213169 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9ccbb-7580-4068-a3cf-5c1d2ff51f9e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:05.245623 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9716de-627a-4bb0-b417-fa0086d8805b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:05.281852 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce61aa-9263-420d-ac98-0d2afbb297ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:05.282479 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce61aa-9263-420d-ac98-0d2afbb297ba None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:05.282806 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce61aa-9263-420d-ac98-0d2afbb297ba None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:05.283066 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce61aa-9263-420d-ac98-0d2afbb297ba None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:05.283735 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce61aa-9263-420d-ac98-0d2afbb297ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:05.284064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce61aa-9263-420d-ac98-0d2afbb297ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:05.285683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce61aa-9263-420d-ac98-0d2afbb297ba None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:05.300866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 492/981] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:05.306200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce61aa-9263-420d-ac98-0d2afbb297ba None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:05.321570 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9ccbb-7580-4068-a3cf-5c1d2ff51f9e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:05.335133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:05.353525 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:05.361408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b363a-58f1-4fb3-95cb-d7332aa09b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:05.362152 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b363a-58f1-4fb3-95cb-d7332aa09b1e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:05.362560 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b363a-58f1-4fb3-95cb-d7332aa09b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:05.362975 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b363a-58f1-4fb3-95cb-d7332aa09b1e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:05.372375 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b363a-58f1-4fb3-95cb-d7332aa09b1e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:05.373982 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b363a-58f1-4fb3-95cb-d7332aa09b1e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:05.386167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-4d9b363a-58f1-4fb3-95cb-d7332aa09b1e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 04:08:05.386167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:05.386167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:05.386167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:05.386167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:05.386167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:05.386167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:05.386167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:05.386167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:05.386167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:05.386167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:05.386167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:05.386167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:08:05.386167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:08:05.386167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:08:05.386167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:08:05.387365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:05.387365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:05.387365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:08:05.387365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:08:05.387365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:08:05.387365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:08:05.387365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:05.387365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:05.387365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:05.387365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:05.387365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:05.387365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:05.387365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:05.387365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:05.387365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:05.387365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:05.387365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:05.387365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:05.388648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:05.388648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:05.388648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:08:05.388648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:08:05.388648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:08:05.388648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:08:05.388648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:08:05.388648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:08:05.388648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 04:08:05.388648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:05.390000 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 490/982] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:08:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:05.390886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b363a-58f1-4fb3-95cb-d7332aa09b1e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:05.421511 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce61aa-9263-420d-ac98-0d2afbb297ba None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:05.458792 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c23020-c067-416f-99ef-45adaee17555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:05.459726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c23020-c067-416f-99ef-45adaee17555 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:05.460108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c23020-c067-416f-99ef-45adaee17555 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:05.460297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c23020-c067-416f-99ef-45adaee17555 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:05.460925 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c23020-c067-416f-99ef-45adaee17555 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:05.461234 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c23020-c067-416f-99ef-45adaee17555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:05.462628 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c23020-c067-416f-99ef-45adaee17555 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:05.467654 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 493/983] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 27 04:08:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:05.473061 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c23020-c067-416f-99ef-45adaee17555 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:05.507985 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b363a-58f1-4fb3-95cb-d7332aa09b1e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:05.543073 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ca3a0-552f-4fe0-88a3-226acc725774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:05.543704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ca3a0-552f-4fe0-88a3-226acc725774 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:05.543988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ca3a0-552f-4fe0-88a3-226acc725774 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:05.544266 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ca3a0-552f-4fe0-88a3-226acc725774 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:05.552095 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ca3a0-552f-4fe0-88a3-226acc725774 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:05.553550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ca3a0-552f-4fe0-88a3-226acc725774 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:05.566636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-b36ca3a0-552f-4fe0-88a3-226acc725774 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:08:05.566636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:05.566636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:05.566636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:05.566636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:05.566636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:05.566636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:05.566636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:05.566636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:05.566636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:05.566636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:05.566636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:05.566636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:08:05.566636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:08:05.566636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:08:05.567812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:08:05.567812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:05.567812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:05.567812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:05.567812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:05.567812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:05.567812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:05.567812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:05.567812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:05.567812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:05.567812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:05.567812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:05.567812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:05.567812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:05.567812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:05.567812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:05.567812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:05.568947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:08:05.568947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:08:05.568947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:08:05.568947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:08:05.568947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:08:05.568947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:08:05.568947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:08:05.568947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:05.572955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 491/984] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:08:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:05.573664 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ca3a0-552f-4fe0-88a3-226acc725774 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:05.575446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:05.586354 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c23020-c067-416f-99ef-45adaee17555 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:05.622205 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865379a7-31ca-489a-b204-d394c0c51de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:05.622838 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865379a7-31ca-489a-b204-d394c0c51de4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:05.623127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865379a7-31ca-489a-b204-d394c0c51de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:05.623410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865379a7-31ca-489a-b204-d394c0c51de4 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:05.624121 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865379a7-31ca-489a-b204-d394c0c51de4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:05.624427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865379a7-31ca-489a-b204-d394c0c51de4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:05.625981 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:05.626861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865379a7-31ca-489a-b204-d394c0c51de4 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:05.670747 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 494/985] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 27 04:08:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:05.670747 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865379a7-31ca-489a-b204-d394c0c51de4 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:05.691419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ca3a0-552f-4fe0-88a3-226acc725774 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:05.747156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321e1ac-bc1a-49ca-83bf-c7e3c96e1cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:05.748239 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321e1ac-bc1a-49ca-83bf-c7e3c96e1cce None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:05.748805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321e1ac-bc1a-49ca-83bf-c7e3c96e1cce None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:05.749302 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321e1ac-bc1a-49ca-83bf-c7e3c96e1cce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:05.750166 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321e1ac-bc1a-49ca-83bf-c7e3c96e1cce None admin] RBAC: Adding query filter params (interface=admin, service_id=eef3d575fe364a3f84821ddb980041a8, region_id=RegionOne) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:05.751201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321e1ac-bc1a-49ca-83bf-c7e3c96e1cce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:05.752612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321e1ac-bc1a-49ca-83bf-c7e3c96e1cce None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:05.764997 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 492/986] 10.222.0.48 () {56 vars in 1249 bytes} [Tue Sep 27 04:08:05 2022] GET /identity/v3/endpoints?service_id=eef3d575fe364a3f84821ddb980041a8&interface=admin®ion_id=RegionOne => generated 193 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:05.766772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321e1ac-bc1a-49ca-83bf-c7e3c96e1cce None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:05.804048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865379a7-31ca-489a-b204-d394c0c51de4 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:05.858195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df2566-fb55-45e3-952e-414edbd89536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:05.859237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df2566-fb55-45e3-952e-414edbd89536 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:05.859237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df2566-fb55-45e3-952e-414edbd89536 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:05.859450 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df2566-fb55-45e3-952e-414edbd89536 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:05.860098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df2566-fb55-45e3-952e-414edbd89536 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:05.860416 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df2566-fb55-45e3-952e-414edbd89536 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:05.861912 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df2566-fb55-45e3-952e-414edbd89536 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:05.875403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 495/987] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:08:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:05.884011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df2566-fb55-45e3-952e-414edbd89536 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:05.886384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321e1ac-bc1a-49ca-83bf-c7e3c96e1cce None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:05.897846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:05.905939 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:05.930254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861ff5b-75c6-4210-a423-0ac3ac3550d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:05.931245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861ff5b-75c6-4210-a423-0ac3ac3550d4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:05.931674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861ff5b-75c6-4210-a423-0ac3ac3550d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:05.932125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861ff5b-75c6-4210-a423-0ac3ac3550d4 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:05.932876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861ff5b-75c6-4210-a423-0ac3ac3550d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:05.934390 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861ff5b-75c6-4210-a423-0ac3ac3550d4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:05.945852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 493/988] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 27 04:08:05 2022] GET /identity/v3/services => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:08:06.017180 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df2566-fb55-45e3-952e-414edbd89536 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:06.054675 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3519c-8b22-4fac-9d48-1a14f87762cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:06.055324 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3519c-8b22-4fac-9d48-1a14f87762cc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:06.055604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3519c-8b22-4fac-9d48-1a14f87762cc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:06.055877 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3519c-8b22-4fac-9d48-1a14f87762cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:06.056623 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3519c-8b22-4fac-9d48-1a14f87762cc None admin] RBAC: Adding query filter params (role.id=1971d31ccfa34212a9ae9350ac58dcb9, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=71c7a54c598642a4b9219ae21c34f0b0) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:06.056932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3519c-8b22-4fac-9d48-1a14f87762cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:06.058376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3519c-8b22-4fac-9d48-1a14f87762cc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:06.065231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 496/989] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:08:05 2022] GET /identity/v3/role_assignments?user.id=71c7a54c598642a4b9219ae21c34f0b0&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=1971d31ccfa34212a9ae9350ac58dcb9 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:08:06.564082 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e14d7-7ebd-4f9a-992b-a3df3b10310d None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:06.564630 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e14d7-7ebd-4f9a-992b-a3df3b10310d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:06.564630 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e14d7-7ebd-4f9a-992b-a3df3b10310d None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:06.565967 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 494/990] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:06.572942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85add40-de3e-45a2-987a-2e41b38f86f6 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:06.572942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85add40-de3e-45a2-987a-2e41b38f86f6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:06.572942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85add40-de3e-45a2-987a-2e41b38f86f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:06.590863 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d85add40-de3e-45a2-987a-2e41b38f86f6 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:06.592364 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d85add40-de3e-45a2-987a-2e41b38f86f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:06.662317 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 497/991] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:06.928948 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e14d7-7ebd-4f9a-992b-a3df3b10310d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:07.033671 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e14d7-7ebd-4f9a-992b-a3df3b10310d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:07.066632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12365f14-4742-4b4d-a24d-8314dfb0842c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:07.067871 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12365f14-4742-4b4d-a24d-8314dfb0842c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:07.068160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12365f14-4742-4b4d-a24d-8314dfb0842c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:07.068429 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12365f14-4742-4b4d-a24d-8314dfb0842c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:07.069009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12365f14-4742-4b4d-a24d-8314dfb0842c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:07.070353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12365f14-4742-4b4d-a24d-8314dfb0842c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:07.078938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-12365f14-4742-4b4d-a24d-8314dfb0842c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 04:08:07.078938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:07.078938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:08:07.078938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:08:07.078938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:08:07.078938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:08:07.078938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:08:07.078938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:08:07.078938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 04:08:07.078938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:07.078938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:08:07.078938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:07.078938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:07.078938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:07.078938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:07.078938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:07.078938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:07.079927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:07.079927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:07.079927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:07.079927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:07.079927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:07.079927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:07.079927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:08:07.079927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:08:07.079927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:08:07.079927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:08:07.079927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:07.079927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:07.079927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:07.079927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:07.079927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:07.079927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:07.080828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:07.080828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:07.080828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:07.080828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:07.080828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:07.080828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:07.080828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:07.080828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:07.080828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:07.080828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:07.080828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:08:07.080828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:08:07.080828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 04:08:07.080828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:07.082788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 495/992] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:08:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:07.086232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85add40-de3e-45a2-987a-2e41b38f86f6 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:07.088410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:07.187352 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85add40-de3e-45a2-987a-2e41b38f86f6 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:07.221188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d6ebc-9be5-4fc1-8789-0fcbe967f267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:07.221807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d6ebc-9be5-4fc1-8789-0fcbe967f267 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:07.222085 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d6ebc-9be5-4fc1-8789-0fcbe967f267 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:07.222358 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d6ebc-9be5-4fc1-8789-0fcbe967f267 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:07.223013 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d6ebc-9be5-4fc1-8789-0fcbe967f267 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:07.223314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d6ebc-9be5-4fc1-8789-0fcbe967f267 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:07.224700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d6ebc-9be5-4fc1-8789-0fcbe967f267 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:07.229772 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 498/993] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 27 04:08:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:07.235347 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12365f14-4742-4b4d-a24d-8314dfb0842c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:07.278498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:07.336207 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12365f14-4742-4b4d-a24d-8314dfb0842c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:07.369752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffb5e1-5e24-4e32-a64e-b28d6082124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:07.370358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffb5e1-5e24-4e32-a64e-b28d6082124f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:07.370636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffb5e1-5e24-4e32-a64e-b28d6082124f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:07.370941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffb5e1-5e24-4e32-a64e-b28d6082124f None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:07.371572 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffb5e1-5e24-4e32-a64e-b28d6082124f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:07.371873 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffb5e1-5e24-4e32-a64e-b28d6082124f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:07.373225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffb5e1-5e24-4e32-a64e-b28d6082124f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:07.378136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 496/994] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 27 04:08:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:07.383917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d6ebc-9be5-4fc1-8789-0fcbe967f267 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:07.455374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:07.493732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d6ebc-9be5-4fc1-8789-0fcbe967f267 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:07.527871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbc47c-b1de-4ba3-874f-0675ae1656a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:07.528482 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbc47c-b1de-4ba3-874f-0675ae1656a1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:07.528769 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbc47c-b1de-4ba3-874f-0675ae1656a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:07.529046 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbc47c-b1de-4ba3-874f-0675ae1656a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:07.529760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbc47c-b1de-4ba3-874f-0675ae1656a1 None admin] RBAC: Adding query filter params (interface=public, service_id=7c7d6e4f09d448e9ad024ee99f7874c5, region_id=RegionOne) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:07.530090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbc47c-b1de-4ba3-874f-0675ae1656a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:07.531519 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbc47c-b1de-4ba3-874f-0675ae1656a1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:07.543634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 499/995] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 27 04:08:07 2022] GET /identity/v3/endpoints?service_id=7c7d6e4f09d448e9ad024ee99f7874c5&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:07.544844 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffb5e1-5e24-4e32-a64e-b28d6082124f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:07.647155 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffb5e1-5e24-4e32-a64e-b28d6082124f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:07.654223 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:07.683273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ca6e4-6892-4f55-9c8a-25deb51a7098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:07.683970 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ca6e4-6892-4f55-9c8a-25deb51a7098 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:07.684321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ca6e4-6892-4f55-9c8a-25deb51a7098 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:07.684664 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ca6e4-6892-4f55-9c8a-25deb51a7098 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:07.685342 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ca6e4-6892-4f55-9c8a-25deb51a7098 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:07.686799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ca6e4-6892-4f55-9c8a-25deb51a7098 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:07.698747 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 497/996] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 27 04:08:07 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:08:08.121865 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967debdb-9b9c-445d-9eb7-b884d774a0fb None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:08.122452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967debdb-9b9c-445d-9eb7-b884d774a0fb None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:08.122452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967debdb-9b9c-445d-9eb7-b884d774a0fb None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:08.124048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 500/997] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:08.130286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66731a82-17a3-4744-9e51-ac279ba7f09d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:08.130591 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66731a82-17a3-4744-9e51-ac279ba7f09d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:08.130884 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66731a82-17a3-4744-9e51-ac279ba7f09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:08.150602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-66731a82-17a3-4744-9e51-ac279ba7f09d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:08.151867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-66731a82-17a3-4744-9e51-ac279ba7f09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:08.222020 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 498/998] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:08.248893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32714e-1d9f-4d32-b175-2f29213a6f1c None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:08.249173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32714e-1d9f-4d32-b175-2f29213a6f1c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:08.249450 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32714e-1d9f-4d32-b175-2f29213a6f1c None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:08.250927 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 501/999] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:08.255962 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e951ff-1335-4f2a-ba28-dc5a6a352460 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:08.256252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e951ff-1335-4f2a-ba28-dc5a6a352460 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:08.256529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e951ff-1335-4f2a-ba28-dc5a6a352460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:08.274255 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-29e951ff-1335-4f2a-ba28-dc5a6a352460 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:08.275457 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-29e951ff-1335-4f2a-ba28-dc5a6a352460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:08.339939 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 499/1000] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:08.490316 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32714e-1d9f-4d32-b175-2f29213a6f1c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:08.602291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32714e-1d9f-4d32-b175-2f29213a6f1c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:08.608020 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e951ff-1335-4f2a-ba28-dc5a6a352460 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:08.631933 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:08.638219 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68f07b-346c-4b93-af7b-579e24f673e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:08.639099 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68f07b-346c-4b93-af7b-579e24f673e5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:08.639613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68f07b-346c-4b93-af7b-579e24f673e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:08.639855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:08.639965 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68f07b-346c-4b93-af7b-579e24f673e5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:08.640467 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68f07b-346c-4b93-af7b-579e24f673e5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:08.641849 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68f07b-346c-4b93-af7b-579e24f673e5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:08.651343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-ee68f07b-346c-4b93-af7b-579e24f673e5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:08:08.651343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:08.651343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:08:08.651343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:08:08.651343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:08:08.651343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:08:08.651343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:08:08.651343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:08:08.651343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:08:08.651343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:08.651343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:08:08.651343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:08.651343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:08.651343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:08.651343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:08.651343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:08.651343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:08.652356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:08.652356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:08.652356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:08.652356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:08.652356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:08.652356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:08.652356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:08:08.652356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:08:08.652356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:08:08.652356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:08:08.652356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:08.652356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:08.652356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:08.652356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:08.652356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:08.652356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:08.653304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:08.653304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:08.653304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:08.653304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:08.653304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:08.653304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:08.653304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:08.653304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:08.653304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:08.653304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:08.653304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:08:08.653304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:08:08.653304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:08:08.653304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:08.653304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 502/1001] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 27 04:08:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:08.658197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68f07b-346c-4b93-af7b-579e24f673e5 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:08.715191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e951ff-1335-4f2a-ba28-dc5a6a352460 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:08.752018 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17c61a-2982-446b-9469-cf8a2b5c17be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:08.752649 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17c61a-2982-446b-9469-cf8a2b5c17be None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:08.752934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17c61a-2982-446b-9469-cf8a2b5c17be None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:08.753208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17c61a-2982-446b-9469-cf8a2b5c17be None admin] PATH_INFO: `/v3/services/image` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:08.753802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17c61a-2982-446b-9469-cf8a2b5c17be None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:08.755231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17c61a-2982-446b-9469-cf8a2b5c17be None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:08.763859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-5a17c61a-2982-446b-9469-cf8a2b5c17be None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 04:08:08.763859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:08.763859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:08:08.763859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:08:08.763859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:08:08.763859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:08:08.763859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:08:08.763859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:08:08.763859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 04:08:08.763859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:08.763859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:08:08.763859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:08.763859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:08.763859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:08.763859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:08.763859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:08.763859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:08.767112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:08.767112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:08.767112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:08.767112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:08.767112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:08.767112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:08.767112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:08:08.767112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:08:08.767112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:08:08.767112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:08:08.767112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:08.767112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:08.767112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:08.767112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:08.767112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:08.767112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:08.768184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:08.768184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:08.768184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:08.768184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:08.768184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:08.768184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:08.768184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:08.768184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:08.768184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:08.768184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:08.768184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:08:08.768184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:08:08.768184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 04:08:08.768184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:08.768184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 500/1002] 10.222.0.48 () {56 vars in 1105 bytes} [Tue Sep 27 04:08:08 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:08:08.769199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68f07b-346c-4b93-af7b-579e24f673e5 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:08.771437 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17c61a-2982-446b-9469-cf8a2b5c17be None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:08.806440 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1932d4-5343-4b7c-9eaf-bfd51dba48da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:08.807272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1932d4-5343-4b7c-9eaf-bfd51dba48da None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:08.807678 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1932d4-5343-4b7c-9eaf-bfd51dba48da None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:08.808047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1932d4-5343-4b7c-9eaf-bfd51dba48da None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:08.808771 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1932d4-5343-4b7c-9eaf-bfd51dba48da None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:08.809149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1932d4-5343-4b7c-9eaf-bfd51dba48da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:08.810616 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1932d4-5343-4b7c-9eaf-bfd51dba48da None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:08.815718 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 503/1003] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 27 04:08:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:08.821103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1932d4-5343-4b7c-9eaf-bfd51dba48da None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:08.871543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:08.879109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:08.881592 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17c61a-2982-446b-9469-cf8a2b5c17be None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:08.918277 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39902c2-9a5d-41ce-88b6-b86ebf0ed442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:08.918996 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39902c2-9a5d-41ce-88b6-b86ebf0ed442 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:08.919278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39902c2-9a5d-41ce-88b6-b86ebf0ed442 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:08.919550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39902c2-9a5d-41ce-88b6-b86ebf0ed442 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:08.920178 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39902c2-9a5d-41ce-88b6-b86ebf0ed442 None admin] RBAC: Adding query filter params (name=image) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:08.920483 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39902c2-9a5d-41ce-88b6-b86ebf0ed442 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:08.921835 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39902c2-9a5d-41ce-88b6-b86ebf0ed442 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:08.922805 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1932d4-5343-4b7c-9eaf-bfd51dba48da None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:08.932966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 501/1004] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:08:08.933687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39902c2-9a5d-41ce-88b6-b86ebf0ed442 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:08.957736 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8f500-8e24-4791-b26a-dfbf43125049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:08.958473 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8f500-8e24-4791-b26a-dfbf43125049 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:08.958862 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8f500-8e24-4791-b26a-dfbf43125049 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:08.959211 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8f500-8e24-4791-b26a-dfbf43125049 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:08.959921 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8f500-8e24-4791-b26a-dfbf43125049 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:08.960228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8f500-8e24-4791-b26a-dfbf43125049 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:08.961597 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8f500-8e24-4791-b26a-dfbf43125049 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:08.966340 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 504/1005] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 27 04:08:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:08:08.971936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8f500-8e24-4791-b26a-dfbf43125049 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:09.038581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39902c2-9a5d-41ce-88b6-b86ebf0ed442 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:09.073670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8f500-8e24-4791-b26a-dfbf43125049 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:09.074783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf68b8b-d28f-4c3a-9ed0-ee411a6045d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:09.075391 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf68b8b-d28f-4c3a-9ed0-ee411a6045d5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:09.075673 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf68b8b-d28f-4c3a-9ed0-ee411a6045d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:09.076518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf68b8b-d28f-4c3a-9ed0-ee411a6045d5 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:09.076674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf68b8b-d28f-4c3a-9ed0-ee411a6045d5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:09.076881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf68b8b-d28f-4c3a-9ed0-ee411a6045d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:09.078249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf68b8b-d28f-4c3a-9ed0-ee411a6045d5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:09.083718 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 502/1006] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:08 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:09.101784 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:09.116802 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2351b7-d98f-4f2a-99ff-dec440294e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:09.117596 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2351b7-d98f-4f2a-99ff-dec440294e1c None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:09.117977 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2351b7-d98f-4f2a-99ff-dec440294e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:09.118372 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2351b7-d98f-4f2a-99ff-dec440294e1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:09.119195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2351b7-d98f-4f2a-99ff-dec440294e1c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:09.120700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2351b7-d98f-4f2a-99ff-dec440294e1c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:09.145515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 505/1007] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:08:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:08:09.856358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa516a-6d60-401e-9c7b-fd01038b69d5 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:09.856881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa516a-6d60-401e-9c7b-fd01038b69d5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:09.856881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa516a-6d60-401e-9c7b-fd01038b69d5 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:09.858261 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 503/1008] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:08:09.863901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ef1f8-b684-4b3a-8428-a8cbd717fae4 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:09.864842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ef1f8-b684-4b3a-8428-a8cbd717fae4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:09.865192 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ef1f8-b684-4b3a-8428-a8cbd717fae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:09.883046 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-224ef1f8-b684-4b3a-8428-a8cbd717fae4 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:09.884237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-224ef1f8-b684-4b3a-8428-a8cbd717fae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:09.959346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 506/1009] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:09 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:10.225659 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa516a-6d60-401e-9c7b-fd01038b69d5 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:10.251073 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:10.328870 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa516a-6d60-401e-9c7b-fd01038b69d5 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:10.365351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45df1b0-92a7-4531-832d-0d9c231821b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:10.366019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45df1b0-92a7-4531-832d-0d9c231821b5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:10.366304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45df1b0-92a7-4531-832d-0d9c231821b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:10.366574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45df1b0-92a7-4531-832d-0d9c231821b5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:10.367186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45df1b0-92a7-4531-832d-0d9c231821b5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:10.368542 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45df1b0-92a7-4531-832d-0d9c231821b5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:10.377395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-e45df1b0-92a7-4531-832d-0d9c231821b5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 04:08:10.377395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:10.377395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:08:10.377395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:08:10.377395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:08:10.377395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:08:10.377395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:08:10.377395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:08:10.377395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 04:08:10.377395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:10.377395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:08:10.377395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:10.377395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:10.377395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:10.377395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:10.377395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:10.377395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:10.378396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:10.378396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:10.378396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:10.378396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:10.378396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:10.378396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:10.378396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:08:10.378396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:08:10.378396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:08:10.378396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:08:10.378396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:10.378396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:10.378396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:10.378396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:10.378396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:10.378396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:10.383757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:10.383757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:10.383757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:10.383757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:10.383757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:10.383757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:10.383757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:10.383757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:10.383757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:10.383757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:10.383757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:08:10.383757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:08:10.383757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 04:08:10.383757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:10.383757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 504/1010] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:08:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:10.385163 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ef1f8-b684-4b3a-8428-a8cbd717fae4 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:10.493192 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ef1f8-b684-4b3a-8428-a8cbd717fae4 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:10.502211 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:10.529768 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187ba45-dda8-405b-81ff-47db80dff3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:10.530369 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187ba45-dda8-405b-81ff-47db80dff3fa None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:10.530647 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187ba45-dda8-405b-81ff-47db80dff3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:10.530942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187ba45-dda8-405b-81ff-47db80dff3fa None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:10.531573 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187ba45-dda8-405b-81ff-47db80dff3fa None admin] RBAC: Adding query filter params (name=compute) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:10.531873 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187ba45-dda8-405b-81ff-47db80dff3fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:10.533228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187ba45-dda8-405b-81ff-47db80dff3fa None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:10.542475 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 507/1011] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 27 04:08:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:10.543983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45df1b0-92a7-4531-832d-0d9c231821b5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:10.633786 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:10.650465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45df1b0-92a7-4531-832d-0d9c231821b5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:10.685654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3427ea-4eb0-43c6-8aca-bddbab5fea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:10.686262 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3427ea-4eb0-43c6-8aca-bddbab5fea5a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:10.686595 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3427ea-4eb0-43c6-8aca-bddbab5fea5a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:10.686923 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3427ea-4eb0-43c6-8aca-bddbab5fea5a None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:10.687562 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3427ea-4eb0-43c6-8aca-bddbab5fea5a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:10.687886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3427ea-4eb0-43c6-8aca-bddbab5fea5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:10.689365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3427ea-4eb0-43c6-8aca-bddbab5fea5a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:10.699890 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 505/1012] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 27 04:08:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:10.700889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187ba45-dda8-405b-81ff-47db80dff3fa None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:10.808446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187ba45-dda8-405b-81ff-47db80dff3fa None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:10.844121 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a16919-9b38-407d-9ccf-e41d172ff435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:10.844740 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a16919-9b38-407d-9ccf-e41d172ff435 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:10.845079 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a16919-9b38-407d-9ccf-e41d172ff435 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:10.845360 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a16919-9b38-407d-9ccf-e41d172ff435 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:10.846090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a16919-9b38-407d-9ccf-e41d172ff435 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:10.847505 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a16919-9b38-407d-9ccf-e41d172ff435 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:10.874760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 508/1013] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:08:10 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:08:11.260133 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27883629-8832-4f97-8012-eeda17c6d298 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:11.260652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27883629-8832-4f97-8012-eeda17c6d298 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:11.260756 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27883629-8832-4f97-8012-eeda17c6d298 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:11.262168 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 506/1014] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:11.267159 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40061474-5713-4cde-9331-164d48cbf469 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:11.267452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40061474-5713-4cde-9331-164d48cbf469 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:11.267733 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40061474-5713-4cde-9331-164d48cbf469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:11.286527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-40061474-5713-4cde-9331-164d48cbf469 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:11.287756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-40061474-5713-4cde-9331-164d48cbf469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:11.311472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:11.326950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba10942-9e7d-4a0e-a666-770aec1b1f8d None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:11.327240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba10942-9e7d-4a0e-a666-770aec1b1f8d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:11.327514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba10942-9e7d-4a0e-a666-770aec1b1f8d None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:11.328827 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 507/1015] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:08:11.333859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba65b4-e9f4-4319-928b-c8dd5c4e0a2d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:11.334146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba65b4-e9f4-4319-928b-c8dd5c4e0a2d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:11.334426 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba65b4-e9f4-4319-928b-c8dd5c4e0a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:11.352467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f2ba65b4-e9f4-4319-928b-c8dd5c4e0a2d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:11.353654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f2ba65b4-e9f4-4319-928b-c8dd5c4e0a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:11.372865 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 509/1016] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:11 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:11.430751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 508/1017] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:11 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:08:11.644410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40061474-5713-4cde-9331-164d48cbf469 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:11.691379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba65b4-e9f4-4319-928b-c8dd5c4e0a2d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:11.749321 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40061474-5713-4cde-9331-164d48cbf469 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:11.774373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:11.786051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f230c-6515-4d49-8d7c-969dd74981d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:11.786931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f230c-6515-4d49-8d7c-969dd74981d8 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:11.787400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f230c-6515-4d49-8d7c-969dd74981d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:11.787873 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f230c-6515-4d49-8d7c-969dd74981d8 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:11.788727 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f230c-6515-4d49-8d7c-969dd74981d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:11.790351 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f230c-6515-4d49-8d7c-969dd74981d8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:11.793889 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba65b4-e9f4-4319-928b-c8dd5c4e0a2d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:11.818770 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 510/1018] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 27 04:08:11 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:08:11.853194 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032530b3-a2f5-4cd5-8127-66bc9de81e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:11.854118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032530b3-a2f5-4cd5-8127-66bc9de81e36 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:11.854399 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032530b3-a2f5-4cd5-8127-66bc9de81e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:11.854668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032530b3-a2f5-4cd5-8127-66bc9de81e36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:11.855860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032530b3-a2f5-4cd5-8127-66bc9de81e36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:11.857314 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032530b3-a2f5-4cd5-8127-66bc9de81e36 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:11.862765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 509/1019] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:08:11.864962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f230c-6515-4d49-8d7c-969dd74981d8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:11.883206 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:11.977893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f230c-6515-4d49-8d7c-969dd74981d8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:12.014858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e062832-23a5-4e8d-9d05-31ac62ea33f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:12.015480 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e062832-23a5-4e8d-9d05-31ac62ea33f0 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:12.015765 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e062832-23a5-4e8d-9d05-31ac62ea33f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:12.016040 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e062832-23a5-4e8d-9d05-31ac62ea33f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:12.016703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e062832-23a5-4e8d-9d05-31ac62ea33f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:12.018134 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e062832-23a5-4e8d-9d05-31ac62ea33f0 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:12.050755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 511/1020] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 27 04:08:11 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:08:13.127527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95c434-c354-4074-8c82-487b26902342 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:13.128118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95c434-c354-4074-8c82-487b26902342 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:13.128118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95c434-c354-4074-8c82-487b26902342 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:13.129417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 510/1021] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:13.134521 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a7781-6a81-4b47-91b4-c1da58bcee9f None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:13.134964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a7781-6a81-4b47-91b4-c1da58bcee9f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:13.135135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a7781-6a81-4b47-91b4-c1da58bcee9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:13.153543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-339a7781-6a81-4b47-91b4-c1da58bcee9f None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:13.154749 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-339a7781-6a81-4b47-91b4-c1da58bcee9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:13.213299 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:13.224634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 512/1022] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:13.488943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95c434-c354-4074-8c82-487b26902342 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:13.590337 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95c434-c354-4074-8c82-487b26902342 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:13.623713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c8032-5ddf-4800-9823-d0c0daf2f9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:13.624338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c8032-5ddf-4800-9823-d0c0daf2f9ce None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:13.624616 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c8032-5ddf-4800-9823-d0c0daf2f9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:13.624886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c8032-5ddf-4800-9823-d0c0daf2f9ce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:13.635675 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c8032-5ddf-4800-9823-d0c0daf2f9ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:08:13.640384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-1c0c8032-5ddf-4800-9823-d0c0daf2f9ce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 04:08:13.640384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:13.640384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:13.640384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:13.640384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:13.640384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:13.640384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:13.640384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:13.640384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:13.640384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:13.640384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:13.640384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:13.640384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:08:13.640384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:08:13.640384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:08:13.640384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:08:13.641312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:08:13.641312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:08:13.641312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:08:13.641312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:08:13.641312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:13.641312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:13.641312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:13.641312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:13.641312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:13.641312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:13.641312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:13.641312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:13.641312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:13.641312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:13.641312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:13.641312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:13.642161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:13.642161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:13.642161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:13.642161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:13.642161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:08:13.642161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:08:13.642161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:08:13.642161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:08:13.642161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:08:13.642161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:08:13.642161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 04:08:13.642161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:13.642161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 511/1023] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Sep 27 04:08:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:13.649538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a7781-6a81-4b47-91b4-c1da58bcee9f None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:13.747214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a7781-6a81-4b47-91b4-c1da58bcee9f None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:13.780446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1ad33-3c8c-40a9-846a-46bf61b972da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:13.781051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1ad33-3c8c-40a9-846a-46bf61b972da None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:13.781329 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1ad33-3c8c-40a9-846a-46bf61b972da None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:13.781600 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1ad33-3c8c-40a9-846a-46bf61b972da None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:13.782267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1ad33-3c8c-40a9-846a-46bf61b972da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:13.782574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1ad33-3c8c-40a9-846a-46bf61b972da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:13.783974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1ad33-3c8c-40a9-846a-46bf61b972da None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:13.797435 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 513/1024] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 27 04:08:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:13.798837 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c8032-5ddf-4800-9823-d0c0daf2f9ce None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:13.804595 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:13.908267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c8032-5ddf-4800-9823-d0c0daf2f9ce None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:13.942748 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3c7c6-6e3f-4d98-aa81-58375593244d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:13.943412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3c7c6-6e3f-4d98-aa81-58375593244d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:13.943691 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3c7c6-6e3f-4d98-aa81-58375593244d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:13.943961 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3c7c6-6e3f-4d98-aa81-58375593244d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:13.953996 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3c7c6-6e3f-4d98-aa81-58375593244d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:13.955483 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3c7c6-6e3f-4d98-aa81-58375593244d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:13.970015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-38e3c7c6-6e3f-4d98-aa81-58375593244d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:08:13.970015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:13.970015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:13.970015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:13.970015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:13.970015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:13.970015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:13.970015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:13.970015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:13.970015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:13.970015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:13.970015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:13.970015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:08:13.970015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:08:13.970015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:08:13.970015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:08:13.971227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:13.971227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:13.971227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:13.971227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:13.971227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:13.971227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:13.971227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:13.971227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:13.971227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:13.971227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:13.971227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:13.971227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:13.971227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:13.971227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:13.971227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:13.971227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:13.971227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:08:13.972188 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:08:13.972188 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:08:13.972188 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:13.972770 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 512/1025] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:13.976981 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1ad33-3c8c-40a9-846a-46bf61b972da None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:13.985920 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789467c-acb0-48ab-aeb4-4824804bf407 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:13.986207 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789467c-acb0-48ab-aeb4-4824804bf407 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:13.986484 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789467c-acb0-48ab-aeb4-4824804bf407 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:13.988404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 513/1026] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:08:13.993679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a653c-7dc2-43f8-8e32-4c6c587b250f None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:13.993967 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a653c-7dc2-43f8-8e32-4c6c587b250f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:13.994245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a653c-7dc2-43f8-8e32-4c6c587b250f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:14.013756 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-627a653c-7dc2-43f8-8e32-4c6c587b250f None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:14.014898 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-627a653c-7dc2-43f8-8e32-4c6c587b250f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:14.042287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:14.068985 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:14.087262 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1ad33-3c8c-40a9-846a-46bf61b972da None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:14.091058 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 514/1027] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:14.136563 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e447f56-f944-4846-9f2b-b67b3590b4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:14.137279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e447f56-f944-4846-9f2b-b67b3590b4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:14.137468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e447f56-f944-4846-9f2b-b67b3590b4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:14.137739 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e447f56-f944-4846-9f2b-b67b3590b4a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:14.138404 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e447f56-f944-4846-9f2b-b67b3590b4a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:14.138705 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e447f56-f944-4846-9f2b-b67b3590b4a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:14.140424 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e447f56-f944-4846-9f2b-b67b3590b4a2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:14.157157 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 514/1028] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:08:14.158759 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a653c-7dc2-43f8-8e32-4c6c587b250f None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:14.231642 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88eb780-6d5c-4a4a-bb85-80357dbe5f1f None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:14.231980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88eb780-6d5c-4a4a-bb85-80357dbe5f1f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:14.232221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88eb780-6d5c-4a4a-bb85-80357dbe5f1f None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:14.233722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 515/1029] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:14.238403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa24e7-91b9-4881-b449-942cbf10f953 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:14.238692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa24e7-91b9-4881-b449-942cbf10f953 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:14.239582 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa24e7-91b9-4881-b449-942cbf10f953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:14.257458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a5aa24e7-91b9-4881-b449-942cbf10f953 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:14.258664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a5aa24e7-91b9-4881-b449-942cbf10f953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:14.262512 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a653c-7dc2-43f8-8e32-4c6c587b250f None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:14.297217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57898a2-8fab-46e5-95e3-818f8074288e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:14.297769 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57898a2-8fab-46e5-95e3-818f8074288e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:14.298045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57898a2-8fab-46e5-95e3-818f8074288e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:14.298318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57898a2-8fab-46e5-95e3-818f8074288e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:14.305979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57898a2-8fab-46e5-95e3-818f8074288e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:14.307438 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57898a2-8fab-46e5-95e3-818f8074288e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:14.319038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-a57898a2-8fab-46e5-95e3-818f8074288e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:08:14.319038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:14.319038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:14.319038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:14.319038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:14.319038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:14.319038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:14.319038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:14.319038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:14.319038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:14.319038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:14.319038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:14.319038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:08:14.319038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:08:14.319038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:08:14.319038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:08:14.320001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:14.320001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:14.320001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:08:14.320001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:08:14.320001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:08:14.320001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:08:14.320001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:14.320001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:14.320001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:14.320001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:14.320001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:14.320001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:14.320001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:14.320001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:14.320001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:14.320001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:14.320001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:14.320001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:14.321559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:14.321559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:14.321559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:08:14.321559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:08:14.321559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:08:14.321559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:08:14.321559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:08:14.321559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:08:14.321559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:08:14.321559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:14.321559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 515/1030] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 27 04:08:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:14.326163 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57898a2-8fab-46e5-95e3-818f8074288e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:14.338517 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 516/1031] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:08:14.357758 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa24e7-91b9-4881-b449-942cbf10f953 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:14.374154 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:14.414073 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:14.436115 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57898a2-8fab-46e5-95e3-818f8074288e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:14.466519 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa24e7-91b9-4881-b449-942cbf10f953 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:14.472462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba96a74-bdfa-40c5-99b4-657c8ed1a710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:14.473305 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba96a74-bdfa-40c5-99b4-657c8ed1a710 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:14.474345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba96a74-bdfa-40c5-99b4-657c8ed1a710 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:14.475310 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba96a74-bdfa-40c5-99b4-657c8ed1a710 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:14.476252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba96a74-bdfa-40c5-99b4-657c8ed1a710 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:14.477077 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba96a74-bdfa-40c5-99b4-657c8ed1a710 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:14.479575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba96a74-bdfa-40c5-99b4-657c8ed1a710 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:14.500633 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d88bf-a544-489f-b092-6627f52e0f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:14.501258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d88bf-a544-489f-b092-6627f52e0f2f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:14.501537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d88bf-a544-489f-b092-6627f52e0f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:14.501808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d88bf-a544-489f-b092-6627f52e0f2f None admin] PATH_INFO: `/v3/services/image` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:14.502038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 516/1032] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 27 04:08:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:14.502395 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d88bf-a544-489f-b092-6627f52e0f2f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:14.503780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d88bf-a544-489f-b092-6627f52e0f2f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:14.507678 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba96a74-bdfa-40c5-99b4-657c8ed1a710 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:14.512978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-189d88bf-a544-489f-b092-6627f52e0f2f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 04:08:14.512978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:14.512978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:08:14.512978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:08:14.512978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:08:14.512978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:08:14.512978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:08:14.512978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:08:14.512978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 04:08:14.512978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:14.512978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:08:14.512978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:14.512978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:14.512978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:14.512978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:14.512978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:14.512978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:14.514998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:14.514998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:14.514998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:14.514998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:14.514998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:14.514998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:14.514998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:08:14.514998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:08:14.514998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:08:14.514998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:08:14.514998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:14.514998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:14.514998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:14.514998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:14.514998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:14.514998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:14.515888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:14.515888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:14.515888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:14.515888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:14.515888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:14.515888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:14.515888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:14.515888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:14.515888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:14.515888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:14.515888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:08:14.515888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:08:14.515888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 04:08:14.515888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:14.515888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 517/1033] 10.222.0.48 () {56 vars in 1105 bytes} [Tue Sep 27 04:08:14 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:08:14.519674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d88bf-a544-489f-b092-6627f52e0f2f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:14.612126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba96a74-bdfa-40c5-99b4-657c8ed1a710 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:14.614319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:14.628419 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d88bf-a544-489f-b092-6627f52e0f2f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:14.640891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:14.647662 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8654839-3521-437d-988c-264a30e787b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:14.648270 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8654839-3521-437d-988c-264a30e787b0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:14.648556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8654839-3521-437d-988c-264a30e787b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:14.648833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8654839-3521-437d-988c-264a30e787b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:14.662783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc660da1-b2fb-4099-aa89-3ad3be356eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:14.663385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc660da1-b2fb-4099-aa89-3ad3be356eca None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:14.663666 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc660da1-b2fb-4099-aa89-3ad3be356eca None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:14.663942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc660da1-b2fb-4099-aa89-3ad3be356eca None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:14.664571 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc660da1-b2fb-4099-aa89-3ad3be356eca None admin] RBAC: Adding query filter params (name=image) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:14.664876 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc660da1-b2fb-4099-aa89-3ad3be356eca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:14.666255 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc660da1-b2fb-4099-aa89-3ad3be356eca None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:14.671091 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 518/1034] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:08:14.671691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc660da1-b2fb-4099-aa89-3ad3be356eca None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:14.718786 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8654839-3521-437d-988c-264a30e787b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:14.720264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8654839-3521-437d-988c-264a30e787b0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:14.765760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc660da1-b2fb-4099-aa89-3ad3be356eca None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:14.798696 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34e519-081e-4644-af1a-6e9a5c6d3ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:14.799347 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34e519-081e-4644-af1a-6e9a5c6d3ffa None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:14.799649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34e519-081e-4644-af1a-6e9a5c6d3ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:14.799929 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34e519-081e-4644-af1a-6e9a5c6d3ffa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:14.801032 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34e519-081e-4644-af1a-6e9a5c6d3ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:14.802990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34e519-081e-4644-af1a-6e9a5c6d3ffa None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:14.804548 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 519/1035] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:14.805301 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34e519-081e-4644-af1a-6e9a5c6d3ffa None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:14.819577 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 517/1036] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:08:14 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 04:08:14.820385 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8654839-3521-437d-988c-264a30e787b0 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:14.823350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:14.855394 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:14.908324 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34e519-081e-4644-af1a-6e9a5c6d3ffa None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:14.920075 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8654839-3521-437d-988c-264a30e787b0 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:14.941333 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163604b-a097-4e8d-a827-d3e569d614ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:14.941934 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163604b-a097-4e8d-a827-d3e569d614ea None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:14.942266 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163604b-a097-4e8d-a827-d3e569d614ea None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:14.942539 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163604b-a097-4e8d-a827-d3e569d614ea None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:14.943199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163604b-a097-4e8d-a827-d3e569d614ea None admin] RBAC: Adding query filter params (type=image) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:14.943505 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163604b-a097-4e8d-a827-d3e569d614ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:14.944937 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163604b-a097-4e8d-a827-d3e569d614ea None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:14.949569 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 520/1037] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:14.950344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163604b-a097-4e8d-a827-d3e569d614ea None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:14.952969 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fed07-882f-496e-a109-42a7bf30fe20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:14.953573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fed07-882f-496e-a109-42a7bf30fe20 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:14.953851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fed07-882f-496e-a109-42a7bf30fe20 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:14.954128 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fed07-882f-496e-a109-42a7bf30fe20 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:14.954922 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fed07-882f-496e-a109-42a7bf30fe20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:14.956337 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fed07-882f-496e-a109-42a7bf30fe20 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:14.980208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 518/1038] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 27 04:08:14 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:08:14.981236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fed07-882f-496e-a109-42a7bf30fe20 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:15.064980 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:15.067898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163604b-a097-4e8d-a827-d3e569d614ea None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:15.078267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:15.115225 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fed31-4bbc-447c-86df-0ca2e6831fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:15.116057 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fed31-4bbc-447c-86df-0ca2e6831fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:15.116496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fed31-4bbc-447c-86df-0ca2e6831fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:15.116956 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fed31-4bbc-447c-86df-0ca2e6831fe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:15.131800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fed07-882f-496e-a109-42a7bf30fe20 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:15.132082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fed31-4bbc-447c-86df-0ca2e6831fe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:15.133847 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fed31-4bbc-447c-86df-0ca2e6831fe2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:15.151355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-0f9fed31-4bbc-447c-86df-0ca2e6831fe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:08:15.151355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:15.151355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:15.151355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:15.151355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:15.151355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:15.151355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:15.151355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:15.151355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:15.151355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:15.151355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:15.151355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:15.151355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:08:15.151355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:08:15.151355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:08:15.151355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:08:15.152831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:15.152831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:15.152831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:15.152831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:15.152831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:15.152831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:15.152831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:15.152831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:15.152831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:15.152831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:15.152831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:15.152831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:15.152831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:15.152831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:15.152831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:15.152831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:15.152831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:08:15.153737 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:08:15.153737 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:08:15.153737 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:15.153737 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 521/1039] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:15.158292 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fed31-4bbc-447c-86df-0ca2e6831fe2 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:15.177893 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dff16-d682-4d22-93b0-68e62e163385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:15.178687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dff16-d682-4d22-93b0-68e62e163385 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:15.179050 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dff16-d682-4d22-93b0-68e62e163385 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:15.179636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dff16-d682-4d22-93b0-68e62e163385 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:15.180853 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dff16-d682-4d22-93b0-68e62e163385 None admin] RBAC: Adding query filter params (interface=public, service_id=035cea3e8c6c4c088eb0d1f7fa4be55f, region_id=RegionOne) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:15.180853 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dff16-d682-4d22-93b0-68e62e163385 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:15.182588 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dff16-d682-4d22-93b0-68e62e163385 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:15.188907 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 519/1040] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 27 04:08:14 2022] GET /identity/v3/endpoints?service_id=035cea3e8c6c4c088eb0d1f7fa4be55f&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:15.194597 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dff16-d682-4d22-93b0-68e62e163385 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:15.273767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fed31-4bbc-447c-86df-0ca2e6831fe2 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:15.305990 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dff16-d682-4d22-93b0-68e62e163385 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:15.308936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579a1cb-6755-4471-9920-f5a6885c76bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:15.309547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579a1cb-6755-4471-9920-f5a6885c76bf None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:15.309836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579a1cb-6755-4471-9920-f5a6885c76bf None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:15.310113 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579a1cb-6755-4471-9920-f5a6885c76bf None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:15.310791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579a1cb-6755-4471-9920-f5a6885c76bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:15.311103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579a1cb-6755-4471-9920-f5a6885c76bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:15.312480 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579a1cb-6755-4471-9920-f5a6885c76bf None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:15.325708 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 522/1041] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:08:15.330016 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:15.331772 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579a1cb-6755-4471-9920-f5a6885c76bf None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:15.341699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409669eb-8c78-4023-a05f-5431d56bc6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:15.342302 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409669eb-8c78-4023-a05f-5431d56bc6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:15.342582 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409669eb-8c78-4023-a05f-5431d56bc6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:15.342890 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409669eb-8c78-4023-a05f-5431d56bc6b6 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:15.343500 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409669eb-8c78-4023-a05f-5431d56bc6b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:15.344906 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409669eb-8c78-4023-a05f-5431d56bc6b6 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:15.351995 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 520/1042] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 27 04:08:15 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:08:15.363410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:15.460157 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579a1cb-6755-4471-9920-f5a6885c76bf None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:15.497343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0ce3d-f48f-4035-82da-df2cf7da67e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:15.497984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0ce3d-f48f-4035-82da-df2cf7da67e6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:15.498262 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0ce3d-f48f-4035-82da-df2cf7da67e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:15.498533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0ce3d-f48f-4035-82da-df2cf7da67e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:15.506312 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0ce3d-f48f-4035-82da-df2cf7da67e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:15.507816 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0ce3d-f48f-4035-82da-df2cf7da67e6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:15.519931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-b9e0ce3d-f48f-4035-82da-df2cf7da67e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:08:15.519931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:15.519931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:15.519931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:15.519931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:15.519931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:15.519931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:15.519931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:15.519931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:15.519931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:15.519931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:15.519931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:15.519931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:08:15.519931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:08:15.519931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:08:15.521421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:08:15.521421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:15.521421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:15.521421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:15.521421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:15.521421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:15.521421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:15.521421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:15.521421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:15.521421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:15.521421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:15.521421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:15.521421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:15.521421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:15.521421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:15.521421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:15.521421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:15.522807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:08:15.522807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:08:15.522807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:08:15.522807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:08:15.522807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:08:15.522807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:08:15.522807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:08:15.522807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:15.522807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 523/1043] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:08:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:15.527607 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409669eb-8c78-4023-a05f-5431d56bc6b6 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:15.638455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409669eb-8c78-4023-a05f-5431d56bc6b6 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:15.672823 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb436cfc-e457-48b4-a34d-882bdb0de817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:15.673787 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb436cfc-e457-48b4-a34d-882bdb0de817 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:15.674276 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb436cfc-e457-48b4-a34d-882bdb0de817 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:15.674795 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb436cfc-e457-48b4-a34d-882bdb0de817 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:15.675715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb436cfc-e457-48b4-a34d-882bdb0de817 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:15.676246 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb436cfc-e457-48b4-a34d-882bdb0de817 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:15.677931 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb436cfc-e457-48b4-a34d-882bdb0de817 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:15.690272 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 521/1044] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:08:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:15.696792 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0ce3d-f48f-4035-82da-df2cf7da67e6 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:15.782345 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:15.803185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0ce3d-f48f-4035-82da-df2cf7da67e6 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:15.839823 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1701d-1175-406d-94da-97bb4e95da27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:15.840723 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1701d-1175-406d-94da-97bb4e95da27 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:15.841217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1701d-1175-406d-94da-97bb4e95da27 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:15.841680 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1701d-1175-406d-94da-97bb4e95da27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:15.842607 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1701d-1175-406d-94da-97bb4e95da27 None admin] RBAC: Adding query filter params (role.id=1971d31ccfa34212a9ae9350ac58dcb9, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=3960d52dee8443cf9ec8930a389a7b60) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:15.843154 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1701d-1175-406d-94da-97bb4e95da27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:15.844782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1701d-1175-406d-94da-97bb4e95da27 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:15.856122 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 524/1045] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:08:15 2022] GET /identity/v3/role_assignments?user.id=3960d52dee8443cf9ec8930a389a7b60&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=1971d31ccfa34212a9ae9350ac58dcb9 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:08:17.213085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0697b-64f2-43b6-af4e-173091fa5a8f None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:17.213647 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0697b-64f2-43b6-af4e-173091fa5a8f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:17.213647 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0697b-64f2-43b6-af4e-173091fa5a8f None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:17.215018 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 522/1046] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:17.220187 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2912b-6b98-4edf-b681-533e85aa5b30 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:17.220584 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2912b-6b98-4edf-b681-533e85aa5b30 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:17.220759 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2912b-6b98-4edf-b681-533e85aa5b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:17.239944 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-aed2912b-6b98-4edf-b681-533e85aa5b30 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:17.241117 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-aed2912b-6b98-4edf-b681-533e85aa5b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:17.307000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 525/1047] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:17.569615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb8238-dd45-40e9-b985-ae5e370043b7 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:17.569914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb8238-dd45-40e9-b985-ae5e370043b7 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:17.570084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb8238-dd45-40e9-b985-ae5e370043b7 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:17.571467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 523/1048] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:17.576772 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e3e43-196c-49d0-81e0-73c10a214ad5 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:17.577062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e3e43-196c-49d0-81e0-73c10a214ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:17.577342 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e3e43-196c-49d0-81e0-73c10a214ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:17.578859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb8238-dd45-40e9-b985-ae5e370043b7 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:17.600333 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-722e3e43-196c-49d0-81e0-73c10a214ad5 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:17.601517 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-722e3e43-196c-49d0-81e0-73c10a214ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:17.637533 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:17.671995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 526/1049] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:08:17.692001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb8238-dd45-40e9-b985-ae5e370043b7 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:17.727164 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619fef7-7f9d-492b-b77f-a7ecae213be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:17.727849 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619fef7-7f9d-492b-b77f-a7ecae213be1 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:17.728136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619fef7-7f9d-492b-b77f-a7ecae213be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:17.728412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619fef7-7f9d-492b-b77f-a7ecae213be1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:17.738667 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619fef7-7f9d-492b-b77f-a7ecae213be1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:08:17.743606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-b619fef7-7f9d-492b-b77f-a7ecae213be1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:08:17.743606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:17.743606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:17.743606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:17.743606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:17.743606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:17.743606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:17.743606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:17.743606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:17.743606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:17.743606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:17.743606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:17.743606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:08:17.743606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:08:17.743606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:08:17.743606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:08:17.744545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:08:17.744545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:08:17.744545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:08:17.744545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:08:17.744545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:17.744545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:17.744545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:17.744545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:17.744545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:17.744545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:17.744545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:17.744545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:17.744545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:17.744545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:17.744545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:17.744545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:17.747714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:17.747714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:17.747714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:17.747714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:17.747714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:08:17.747714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:08:17.747714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:08:17.747714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:08:17.747714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:08:17.747714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:08:17.747714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:08:17.747714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:17.747714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 524/1050] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:08:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:08:17.751171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e3e43-196c-49d0-81e0-73c10a214ad5 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:17.754926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:17.856904 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e3e43-196c-49d0-81e0-73c10a214ad5 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:17.891537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bccd8d-e31d-48b4-ae9b-e40921a6158a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:17.892147 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bccd8d-e31d-48b4-ae9b-e40921a6158a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:17.892434 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bccd8d-e31d-48b4-ae9b-e40921a6158a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:17.892712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bccd8d-e31d-48b4-ae9b-e40921a6158a None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:17.893381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bccd8d-e31d-48b4-ae9b-e40921a6158a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:17.893689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bccd8d-e31d-48b4-ae9b-e40921a6158a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:17.895108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bccd8d-e31d-48b4-ae9b-e40921a6158a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:17.908626 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 527/1051] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:08:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:17.909672 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619fef7-7f9d-492b-b77f-a7ecae213be1 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:17.940186 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bccd8d-e31d-48b4-ae9b-e40921a6158a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:18.010609 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:18.020223 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619fef7-7f9d-492b-b77f-a7ecae213be1 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:18.030671 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:18.049867 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bccd8d-e31d-48b4-ae9b-e40921a6158a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:18.057505 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f3693-e572-460a-983e-e1a19b563d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:18.058143 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f3693-e572-460a-983e-e1a19b563d98 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:18.058428 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f3693-e572-460a-983e-e1a19b563d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:18.058707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f3693-e572-460a-983e-e1a19b563d98 None admin] PATH_INFO: `/v3/users/a3c2e49099584654b452473439b644f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:18.075567 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f3693-e572-460a-983e-e1a19b563d98 None admin] RBAC: Authorizing `identity:get_user(user_id=a3c2e49099584654b452473439b644f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:18.077037 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f3693-e572-460a-983e-e1a19b563d98 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:18.078768 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 525/1052] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:08:17 2022] GET /identity/v3/users/a3c2e49099584654b452473439b644f2 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:08:18.079956 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e09991-9723-484a-adf4-8711be24ac23 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:18.080244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e09991-9723-484a-adf4-8711be24ac23 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:18.080717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e09991-9723-484a-adf4-8711be24ac23 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:18.083605 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 526/1053] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:18.085070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e09991-9723-484a-adf4-8711be24ac23 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:18.090475 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003fa286-f372-4bab-9096-62d52160107e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:18.091152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fa286-f372-4bab-9096-62d52160107e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:18.091436 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fa286-f372-4bab-9096-62d52160107e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:18.091711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fa286-f372-4bab-9096-62d52160107e None admin] PATH_INFO: `/v3/services/image` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:18.092568 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003fa286-f372-4bab-9096-62d52160107e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:18.094315 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003fa286-f372-4bab-9096-62d52160107e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:18.104474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-003fa286-f372-4bab-9096-62d52160107e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 04:08:18.104474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:18.104474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:08:18.104474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:08:18.104474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:08:18.104474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:08:18.104474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:08:18.104474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:08:18.104474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 04:08:18.104474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:18.104474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:08:18.104474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:18.104474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:18.104474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:18.104474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:18.104474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:18.104474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:18.105507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:18.105507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:18.105507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:18.105507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:18.105507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:18.105507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:18.105507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:08:18.105507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:08:18.105507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:08:18.105507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:08:18.105507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:18.105507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:18.105507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:18.105507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:18.105507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:18.105507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:18.107242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:18.107242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:18.107242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:18.107242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:18.107242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:18.107242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:18.107242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:18.107242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:18.107242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:18.107242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:18.107242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:08:18.107242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:08:18.107242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 04:08:18.107242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:18.107242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 528/1054] 10.222.0.48 () {56 vars in 1105 bytes} [Tue Sep 27 04:08:17 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:08:18.108077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753ad49-2d0a-4f45-8771-024016c788c9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:18.108077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753ad49-2d0a-4f45-8771-024016c788c9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:18.108077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753ad49-2d0a-4f45-8771-024016c788c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:18.126760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9753ad49-2d0a-4f45-8771-024016c788c9 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:18.127984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9753ad49-2d0a-4f45-8771-024016c788c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:18.192715 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 529/1055] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:18.193548 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753ad49-2d0a-4f45-8771-024016c788c9 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:18.205603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e09991-9723-484a-adf4-8711be24ac23 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:18.240906 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ba009-3256-4896-a69b-e0ce54b2426c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:18.241524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ba009-3256-4896-a69b-e0ce54b2426c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:18.241779 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ba009-3256-4896-a69b-e0ce54b2426c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:18.242058 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ba009-3256-4896-a69b-e0ce54b2426c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:18.255803 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:18.277136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:18.302176 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753ad49-2d0a-4f45-8771-024016c788c9 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:18.311882 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ba009-3256-4896-a69b-e0ce54b2426c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:18.313655 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ba009-3256-4896-a69b-e0ce54b2426c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:18.338141 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee15b4b-77f2-4448-a6d3-721f1299bc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:18.338774 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee15b4b-77f2-4448-a6d3-721f1299bc20 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:18.339076 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee15b4b-77f2-4448-a6d3-721f1299bc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:18.339341 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee15b4b-77f2-4448-a6d3-721f1299bc20 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:18.339970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee15b4b-77f2-4448-a6d3-721f1299bc20 None admin] RBAC: Adding query filter params (name=image) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:18.340273 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee15b4b-77f2-4448-a6d3-721f1299bc20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:18.341734 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee15b4b-77f2-4448-a6d3-721f1299bc20 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:18.351571 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 530/1056] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:18.353354 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee15b4b-77f2-4448-a6d3-721f1299bc20 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:18.427666 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 527/1057] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:08:18 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:08:18.433513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ba009-3256-4896-a69b-e0ce54b2426c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:18.473396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee15b4b-77f2-4448-a6d3-721f1299bc20 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:18.496790 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:18.502617 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:18.508301 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9c7cd-daa2-40a5-b620-32eb2cbe603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:18.508904 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9c7cd-daa2-40a5-b620-32eb2cbe603e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:18.509184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9c7cd-daa2-40a5-b620-32eb2cbe603e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:18.509452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9c7cd-daa2-40a5-b620-32eb2cbe603e None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:18.510178 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9c7cd-daa2-40a5-b620-32eb2cbe603e None admin] RBAC: Adding query filter params (type=image) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:18.510490 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9c7cd-daa2-40a5-b620-32eb2cbe603e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:18.511889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9c7cd-daa2-40a5-b620-32eb2cbe603e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:18.516621 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 531/1058] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:08:18.516621 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9c7cd-daa2-40a5-b620-32eb2cbe603e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:18.538549 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ba009-3256-4896-a69b-e0ce54b2426c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:18.571043 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b642c7-7b04-49e0-b64c-d472aaab8b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:18.571668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b642c7-7b04-49e0-b64c-d472aaab8b74 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:18.571948 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b642c7-7b04-49e0-b64c-d472aaab8b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:18.572219 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b642c7-7b04-49e0-b64c-d472aaab8b74 None admin] PATH_INFO: `/v3/projects/f4d59d8057ce404188753175b2022f7d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:18.573328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b642c7-7b04-49e0-b64c-d472aaab8b74 None admin] RBAC: Authorizing `identity:get_project(project_id=f4d59d8057ce404188753175b2022f7d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:18.574766 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b642c7-7b04-49e0-b64c-d472aaab8b74 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:18.576497 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 528/1059] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:08:18 2022] GET /identity/v3/projects/f4d59d8057ce404188753175b2022f7d => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:08:18.577139 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b642c7-7b04-49e0-b64c-d472aaab8b74 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:18.620336 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9c7cd-daa2-40a5-b620-32eb2cbe603e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:18.653946 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba287f-29da-4e03-a85a-da1808e67045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:18.654497 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba287f-29da-4e03-a85a-da1808e67045 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:18.654813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba287f-29da-4e03-a85a-da1808e67045 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:18.655092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba287f-29da-4e03-a85a-da1808e67045 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:18.665325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba287f-29da-4e03-a85a-da1808e67045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:08:18.670082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-ceba287f-29da-4e03-a85a-da1808e67045 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 04:08:18.670082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:18.670082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:18.670082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:18.670082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:18.670082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:18.670082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:18.670082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:18.670082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:18.670082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:18.670082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:18.670082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:18.670082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:08:18.670082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:08:18.670082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:08:18.670082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:08:18.671069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:08:18.671069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:08:18.671069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:08:18.671069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:08:18.671069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:18.671069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:18.671069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:18.671069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:18.671069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:18.671069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:18.671069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:18.671069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:18.671069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:18.671069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:18.671069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:18.671069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:18.671910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:18.671910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:18.671910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:18.671910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:18.671910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:08:18.671910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:08:18.671910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:08:18.671910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:08:18.671910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:08:18.671910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:08:18.671910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 04:08:18.671910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:18.671910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 532/1060] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Sep 27 04:08:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:18.672703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba287f-29da-4e03-a85a-da1808e67045 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:18.681364 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b642c7-7b04-49e0-b64c-d472aaab8b74 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:18.716401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a8bc8-d586-4da6-bf8a-bea817416a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:18.717000 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a8bc8-d586-4da6-bf8a-bea817416a61 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:18.717280 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a8bc8-d586-4da6-bf8a-bea817416a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:18.717550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a8bc8-d586-4da6-bf8a-bea817416a61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:18.718214 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a8bc8-d586-4da6-bf8a-bea817416a61 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:18.719374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:18.719605 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a8bc8-d586-4da6-bf8a-bea817416a61 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:18.725176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:18.741507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 529/1061] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:08:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:08:18.742122 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a8bc8-d586-4da6-bf8a-bea817416a61 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:18.795050 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba287f-29da-4e03-a85a-da1808e67045 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:18.840003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fb488-c709-40c8-a47f-0bd8b28f17ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:18.840632 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fb488-c709-40c8-a47f-0bd8b28f17ff None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:18.840906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fb488-c709-40c8-a47f-0bd8b28f17ff None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:18.841182 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fb488-c709-40c8-a47f-0bd8b28f17ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:18.841931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fb488-c709-40c8-a47f-0bd8b28f17ff None admin] RBAC: Adding query filter params (role.id=2613cf4a98d44744a094c7782b19b4b5, scope.project.id=f4d59d8057ce404188753175b2022f7d, user.id=a3c2e49099584654b452473439b644f2) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:18.842303 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fb488-c709-40c8-a47f-0bd8b28f17ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:18.843826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fb488-c709-40c8-a47f-0bd8b28f17ff None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:18.850239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 533/1062] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:08:18 2022] GET /identity/v3/role_assignments?user.id=a3c2e49099584654b452473439b644f2&scope.project.id=f4d59d8057ce404188753175b2022f7d&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:18.872530 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a8bc8-d586-4da6-bf8a-bea817416a61 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:18.913559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cc937-374c-4f8e-b061-0d616f31ed61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:18.914106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cc937-374c-4f8e-b061-0d616f31ed61 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:18.914384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cc937-374c-4f8e-b061-0d616f31ed61 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:18.914655 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cc937-374c-4f8e-b061-0d616f31ed61 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:18.915377 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935cc937-374c-4f8e-b061-0d616f31ed61 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:18.915686 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935cc937-374c-4f8e-b061-0d616f31ed61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:18.917118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935cc937-374c-4f8e-b061-0d616f31ed61 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:18.926986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 530/1063] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 27 04:08:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:18.932951 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fb488-c709-40c8-a47f-0bd8b28f17ff None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:19.045709 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fb488-c709-40c8-a47f-0bd8b28f17ff None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:19.055568 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:19.086387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a38dc7-86a2-4d17-bfa0-ad08273cd983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:19.087334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a38dc7-86a2-4d17-bfa0-ad08273cd983 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:19.087857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a38dc7-86a2-4d17-bfa0-ad08273cd983 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:19.088399 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a38dc7-86a2-4d17-bfa0-ad08273cd983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:19.101557 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a38dc7-86a2-4d17-bfa0-ad08273cd983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:19.103066 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a38dc7-86a2-4d17-bfa0-ad08273cd983 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:19.121239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-b0a38dc7-86a2-4d17-bfa0-ad08273cd983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:08:19.121239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:19.121239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:19.121239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:19.121239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:19.121239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:19.121239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:19.121239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:19.121239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:19.121239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:19.121239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:19.121239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:19.121239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:08:19.121239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:08:19.121239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:08:19.121239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:08:19.122250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:19.122250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:19.122250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:19.122250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:19.122250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:19.122250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:19.122250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:19.122250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:19.122250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:19.122250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:19.122250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:19.122250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:19.122250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:19.122250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:19.122250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:19.122250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:19.122250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:08:19.123188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:08:19.123188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:08:19.123188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:19.126791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 534/1064] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:19.128482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cc937-374c-4f8e-b061-0d616f31ed61 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:19.181972 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:19.231521 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cc937-374c-4f8e-b061-0d616f31ed61 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:19.265654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5432360-3ab8-4544-8d56-5623e61098fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:19.266276 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5432360-3ab8-4544-8d56-5623e61098fc None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:19.266539 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5432360-3ab8-4544-8d56-5623e61098fc None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:19.266840 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5432360-3ab8-4544-8d56-5623e61098fc None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:19.267494 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5432360-3ab8-4544-8d56-5623e61098fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:19.267803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5432360-3ab8-4544-8d56-5623e61098fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:19.270546 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5432360-3ab8-4544-8d56-5623e61098fc None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:19.286221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 531/1065] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:19.287441 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a38dc7-86a2-4d17-bfa0-ad08273cd983 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:19.401141 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a38dc7-86a2-4d17-bfa0-ad08273cd983 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:19.438462 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0439ad-6975-4242-a0b9-c7c2fe8fbb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:19.439152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0439ad-6975-4242-a0b9-c7c2fe8fbb5d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:19.439446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0439ad-6975-4242-a0b9-c7c2fe8fbb5d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:19.439726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0439ad-6975-4242-a0b9-c7c2fe8fbb5d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:19.448072 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0439ad-6975-4242-a0b9-c7c2fe8fbb5d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:19.449558 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0439ad-6975-4242-a0b9-c7c2fe8fbb5d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:19.461385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-1e0439ad-6975-4242-a0b9-c7c2fe8fbb5d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:08:19.461385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:19.461385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:19.461385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:19.461385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:19.461385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:19.461385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:19.461385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:19.461385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:19.461385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:19.461385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:19.461385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:19.461385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:08:19.461385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:08:19.461385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:08:19.461385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:08:19.462314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:19.462314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:19.462314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:08:19.462314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:08:19.462314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:08:19.462314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:08:19.462314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:19.462314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:19.462314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:19.462314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:19.462314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:19.462314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:19.462314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:19.462314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:19.462314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:19.462314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:19.462314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:19.462314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:19.463320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:19.463320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:19.463320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:08:19.463320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:08:19.463320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:08:19.463320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:08:19.463320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:08:19.463320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:08:19.463320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:08:19.463320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:19.467081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 535/1066] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 27 04:08:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:19.468297 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5432360-3ab8-4544-8d56-5623e61098fc None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:19.571388 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5432360-3ab8-4544-8d56-5623e61098fc None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:19.585481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:19.607684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a0c96-82c4-4b63-966a-73cd9bc9a0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:19.608294 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a0c96-82c4-4b63-966a-73cd9bc9a0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:19.608578 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a0c96-82c4-4b63-966a-73cd9bc9a0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:19.608855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a0c96-82c4-4b63-966a-73cd9bc9a0e5 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:19.609591 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a0c96-82c4-4b63-966a-73cd9bc9a0e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:19.609904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a0c96-82c4-4b63-966a-73cd9bc9a0e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:19.611390 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a0c96-82c4-4b63-966a-73cd9bc9a0e5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:19.634040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 532/1067] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 27 04:08:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:19.635545 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0439ad-6975-4242-a0b9-c7c2fe8fbb5d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:19.660057 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:19.745092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0439ad-6975-4242-a0b9-c7c2fe8fbb5d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:19.780193 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e180b4-e8dd-47ab-bb82-72a94e2eb8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:19.780822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e180b4-e8dd-47ab-bb82-72a94e2eb8ff None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:19.781101 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e180b4-e8dd-47ab-bb82-72a94e2eb8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:19.781371 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e180b4-e8dd-47ab-bb82-72a94e2eb8ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:19.791873 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e180b4-e8dd-47ab-bb82-72a94e2eb8ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:19.793310 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e180b4-e8dd-47ab-bb82-72a94e2eb8ff None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:19.807698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-42e180b4-e8dd-47ab-bb82-72a94e2eb8ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:08:19.807698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:19.807698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:19.807698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:19.807698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:19.807698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:19.807698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:19.807698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:19.807698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:19.807698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:19.807698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:19.807698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:19.807698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:08:19.807698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:08:19.807698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:08:19.807698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:08:19.808640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:19.808640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:19.808640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:19.808640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:19.808640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:19.808640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:19.808640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:19.808640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:19.808640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:19.808640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:19.808640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:19.808640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:19.808640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:19.808640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:19.808640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:19.808640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:19.808640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:08:19.814492 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:08:19.814492 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:08:19.814492 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:19.814492 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 536/1068] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:19.815931 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a0c96-82c4-4b63-966a-73cd9bc9a0e5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:19.918366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a0c96-82c4-4b63-966a-73cd9bc9a0e5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:19.952965 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbb27a-34ec-4715-a619-282ed74f48a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:19.953565 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbb27a-34ec-4715-a619-282ed74f48a4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:19.953846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbb27a-34ec-4715-a619-282ed74f48a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:19.954121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbb27a-34ec-4715-a619-282ed74f48a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:19.954786 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbb27a-34ec-4715-a619-282ed74f48a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:19.955099 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbb27a-34ec-4715-a619-282ed74f48a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:19.956453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbb27a-34ec-4715-a619-282ed74f48a4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:19.968048 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 533/1069] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:19.973489 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e180b4-e8dd-47ab-bb82-72a94e2eb8ff None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:20.046449 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:20.078037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e180b4-e8dd-47ab-bb82-72a94e2eb8ff None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:20.116813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfc555-9287-4541-98d0-9c643d9ea6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:20.117442 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfc555-9287-4541-98d0-9c643d9ea6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:20.117724 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfc555-9287-4541-98d0-9c643d9ea6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:20.117997 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfc555-9287-4541-98d0-9c643d9ea6f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:20.124868 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfc555-9287-4541-98d0-9c643d9ea6f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:20.126313 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfc555-9287-4541-98d0-9c643d9ea6f1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:20.137413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-9abfc555-9287-4541-98d0-9c643d9ea6f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:08:20.137413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:20.137413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:20.137413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:20.137413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:20.137413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:20.137413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:20.137413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:20.137413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:20.137413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:20.137413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:20.137413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:20.137413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:08:20.137413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:08:20.137413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:08:20.138291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:08:20.138291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:20.138291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:20.138291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:20.138291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:20.138291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:20.138291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:20.138291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:20.138291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:20.138291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:20.138291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:20.138291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:20.138291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:20.138291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:20.138291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:20.138291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:20.138291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:20.139295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:08:20.139295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:08:20.139295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:08:20.139295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:08:20.139295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:08:20.139295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:08:20.139295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:08:20.139295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:20.139295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 537/1070] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:08:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:08:20.144355 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbb27a-34ec-4715-a619-282ed74f48a4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:20.175522 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:20.246782 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbb27a-34ec-4715-a619-282ed74f48a4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:20.280074 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a5c9a-c5f6-40e7-88ab-bde77df29b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:20.280655 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a5c9a-c5f6-40e7-88ab-bde77df29b7e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:20.280936 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a5c9a-c5f6-40e7-88ab-bde77df29b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:20.281205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a5c9a-c5f6-40e7-88ab-bde77df29b7e None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:20.281886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a5c9a-c5f6-40e7-88ab-bde77df29b7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:20.282190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a5c9a-c5f6-40e7-88ab-bde77df29b7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:20.283627 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a5c9a-c5f6-40e7-88ab-bde77df29b7e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:20.296530 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 534/1071] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:08:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:20.301476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfc555-9287-4541-98d0-9c643d9ea6f1 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:20.404603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfc555-9287-4541-98d0-9c643d9ea6f1 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:20.434983 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:20.440346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33595c-1905-4050-9afe-88f937499bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:20.441409 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33595c-1905-4050-9afe-88f937499bf5 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:20.442459 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33595c-1905-4050-9afe-88f937499bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:20.443081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33595c-1905-4050-9afe-88f937499bf5 None admin] PATH_INFO: `/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/3960d52dee8443cf9ec8930a389a7b60/roles/1971d31ccfa34212a9ae9350ac58dcb9` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:20.445654 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33595c-1905-4050-9afe-88f937499bf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=37e7a8d1446d4cdea0ba00124411cd93, user_id=3960d52dee8443cf9ec8930a389a7b60, role_id=1971d31ccfa34212a9ae9350ac58dcb9)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:20.447136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33595c-1905-4050-9afe-88f937499bf5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:20.462442 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 538/1072] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:08:20 2022] PUT /identity/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/3960d52dee8443cf9ec8930a389a7b60/roles/1971d31ccfa34212a9ae9350ac58dcb9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:08:20.985626 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f8339-f70a-4b0e-ada6-bbe904a15298 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:20.985985 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f8339-f70a-4b0e-ada6-bbe904a15298 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:20.986200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f8339-f70a-4b0e-ada6-bbe904a15298 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:20.987601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 535/1073] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:20.993359 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe04348-95f0-45e0-913a-18450696fbb7 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:20.993659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe04348-95f0-45e0-913a-18450696fbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:20.993941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe04348-95f0-45e0-913a-18450696fbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:21.012149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-efe04348-95f0-45e0-913a-18450696fbb7 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:21.013351 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-efe04348-95f0-45e0-913a-18450696fbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:21.045729 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a7530-49d3-4f59-9f26-3a8b9623b9d6 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:21.046014 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a7530-49d3-4f59-9f26-3a8b9623b9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:21.046293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a7530-49d3-4f59-9f26-3a8b9623b9d6 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:21.047671 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 536/1074] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:21.053143 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312dc49-2d1d-4541-ba28-838144accaed None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:21.053424 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312dc49-2d1d-4541-ba28-838144accaed None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:21.053697 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312dc49-2d1d-4541-ba28-838144accaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:21.071045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-7312dc49-2d1d-4541-ba28-838144accaed None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:21.072224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7312dc49-2d1d-4541-ba28-838144accaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:21.087220 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 539/1075] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:21.141455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 537/1076] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:08:21.367752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe04348-95f0-45e0-913a-18450696fbb7 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:21.407551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312dc49-2d1d-4541-ba28-838144accaed None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:21.429647 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:21.478743 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe04348-95f0-45e0-913a-18450696fbb7 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:21.502010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:21.515381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312dc49-2d1d-4541-ba28-838144accaed None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:21.516326 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ee890-4674-45cb-ab44-c8ae166e08b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:21.516935 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ee890-4674-45cb-ab44-c8ae166e08b2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:21.517217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ee890-4674-45cb-ab44-c8ae166e08b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:21.517492 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ee890-4674-45cb-ab44-c8ae166e08b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:21.554160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc352e7b-e3d1-4835-a8f2-be98285f216d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:21.554856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc352e7b-e3d1-4835-a8f2-be98285f216d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:21.555165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc352e7b-e3d1-4835-a8f2-be98285f216d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:21.555442 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc352e7b-e3d1-4835-a8f2-be98285f216d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:21.565807 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc352e7b-e3d1-4835-a8f2-be98285f216d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:08:21.570601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-cc352e7b-e3d1-4835-a8f2-be98285f216d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:08:21.570601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:21.570601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:21.570601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:21.570601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:21.570601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:21.570601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:21.570601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:21.570601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:21.570601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:21.570601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:21.570601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:21.570601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:08:21.570601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:08:21.570601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:08:21.570601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:08:21.571564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:08:21.571564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:08:21.571564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:08:21.571564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:08:21.571564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:21.571564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:21.571564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:21.571564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:21.571564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:21.571564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:21.571564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:21.571564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:21.571564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:21.571564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:21.571564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:21.571564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:21.572404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:21.572404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:21.572404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:21.572404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:21.572404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:08:21.572404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:08:21.572404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:08:21.572404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:08:21.572404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:08:21.572404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:08:21.572404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:08:21.572404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:21.572404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 538/1077] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:08:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:08:21.577523 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc352e7b-e3d1-4835-a8f2-be98285f216d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:21.600807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ee890-4674-45cb-ab44-c8ae166e08b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:21.602334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ee890-4674-45cb-ab44-c8ae166e08b2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:21.663496 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:21.685287 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc352e7b-e3d1-4835-a8f2-be98285f216d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:21.710488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 540/1078] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:08:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:08:21.716548 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ee890-4674-45cb-ab44-c8ae166e08b2 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:21.724659 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1442602-6002-4247-973c-254b713279f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:21.725269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1442602-6002-4247-973c-254b713279f0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:21.725548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1442602-6002-4247-973c-254b713279f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:21.725824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1442602-6002-4247-973c-254b713279f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:21.726499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1442602-6002-4247-973c-254b713279f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:21.726836 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1442602-6002-4247-973c-254b713279f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:21.728206 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1442602-6002-4247-973c-254b713279f0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:21.736788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 539/1079] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:08:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:08:21.742442 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1442602-6002-4247-973c-254b713279f0 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:21.745122 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:21.826697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ee890-4674-45cb-ab44-c8ae166e08b2 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:21.845074 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1442602-6002-4247-973c-254b713279f0 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:21.863126 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e93df-9675-460e-bf15-cd8038b03953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:21.864393 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e93df-9675-460e-bf15-cd8038b03953 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:21.864685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e93df-9675-460e-bf15-cd8038b03953 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:21.864957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e93df-9675-460e-bf15-cd8038b03953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:21.875307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e93df-9675-460e-bf15-cd8038b03953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:21.877005 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e93df-9675-460e-bf15-cd8038b03953 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:21.883537 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c962000-5c46-46bd-ad58-544c8ede8d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:21.884191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c962000-5c46-46bd-ad58-544c8ede8d06 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:21.884505 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c962000-5c46-46bd-ad58-544c8ede8d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:21.884754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c962000-5c46-46bd-ad58-544c8ede8d06 None admin] PATH_INFO: `/v3/users/a3c2e49099584654b452473439b644f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:21.885889 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c962000-5c46-46bd-ad58-544c8ede8d06 None admin] RBAC: Authorizing `identity:get_user(user_id=a3c2e49099584654b452473439b644f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:21.887345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c962000-5c46-46bd-ad58-544c8ede8d06 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:21.888920 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 540/1080] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:08:21 2022] GET /identity/v3/users/a3c2e49099584654b452473439b644f2 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:21.893152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-0e9e93df-9675-460e-bf15-cd8038b03953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:08:21.893152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:21.893152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:21.893152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:21.893152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:21.893152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:21.893152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:21.893152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:21.893152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:21.893152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:21.893152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:21.893152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:21.893152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:08:21.893152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:08:21.893152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:08:21.893152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:08:21.894109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:21.894109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:21.894109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:21.894109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:21.894109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:21.894109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:21.894109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:21.894109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:21.894109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:21.894109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:21.894109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:21.894109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:21.894109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:21.894109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:21.894109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:21.894109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:21.894109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:08:21.895090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:08:21.895090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:08:21.895090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:21.896132 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c962000-5c46-46bd-ad58-544c8ede8d06 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:21.899114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 541/1081] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:08:21.899807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e93df-9675-460e-bf15-cd8038b03953 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:21.908629 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:21.978318 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:22.005822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e93df-9675-460e-bf15-cd8038b03953 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:22.007077 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c962000-5c46-46bd-ad58-544c8ede8d06 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:22.041835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a672fc-91d9-45cd-b4c6-62b77b6550a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:22.042384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b18e31-5898-433c-8d0f-e67bd8a8afe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:22.042504 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a672fc-91d9-45cd-b4c6-62b77b6550a9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:22.042802 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a672fc-91d9-45cd-b4c6-62b77b6550a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:22.043023 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a672fc-91d9-45cd-b4c6-62b77b6550a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:22.043123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b18e31-5898-433c-8d0f-e67bd8a8afe5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:22.043323 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b18e31-5898-433c-8d0f-e67bd8a8afe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:22.043602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b18e31-5898-433c-8d0f-e67bd8a8afe5 None admin] PATH_INFO: `/v3/projects/f4d59d8057ce404188753175b2022f7d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:22.043707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a672fc-91d9-45cd-b4c6-62b77b6550a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:22.043971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a672fc-91d9-45cd-b4c6-62b77b6550a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:22.044844 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b18e31-5898-433c-8d0f-e67bd8a8afe5 None admin] RBAC: Authorizing `identity:get_project(project_id=f4d59d8057ce404188753175b2022f7d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:22.045349 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a672fc-91d9-45cd-b4c6-62b77b6550a9 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:22.046272 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b18e31-5898-433c-8d0f-e67bd8a8afe5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:22.047987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 541/1082] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:08:21 2022] GET /identity/v3/projects/f4d59d8057ce404188753175b2022f7d => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:22.053756 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b18e31-5898-433c-8d0f-e67bd8a8afe5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:22.057851 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 542/1083] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:22.142313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:22.166620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b18e31-5898-433c-8d0f-e67bd8a8afe5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:22.208446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4686c26-80a3-41ec-98b1-0e4750634336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:22.209128 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4686c26-80a3-41ec-98b1-0e4750634336 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:22.209427 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4686c26-80a3-41ec-98b1-0e4750634336 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:22.209694 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4686c26-80a3-41ec-98b1-0e4750634336 None admin] PATH_INFO: `/v3/projects/f4d59d8057ce404188753175b2022f7d/users/a3c2e49099584654b452473439b644f2/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:22.211744 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4686c26-80a3-41ec-98b1-0e4750634336 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4d59d8057ce404188753175b2022f7d, user_id=a3c2e49099584654b452473439b644f2, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:22.213207 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4686c26-80a3-41ec-98b1-0e4750634336 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:22.231270 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 542/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:08:22 2022] PUT /identity/v3/projects/f4d59d8057ce404188753175b2022f7d/users/a3c2e49099584654b452473439b644f2/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:08:22.635790 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63ae93-ce47-4908-ac5b-74739c32298c None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:22.636292 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63ae93-ce47-4908-ac5b-74739c32298c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:22.636292 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63ae93-ce47-4908-ac5b-74739c32298c None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:22.637590 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 543/1085] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:22.643040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fab4f7-5f7b-4dfc-a9e0-e21742a723c1 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:22.643448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fab4f7-5f7b-4dfc-a9e0-e21742a723c1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:22.643723 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fab4f7-5f7b-4dfc-a9e0-e21742a723c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:22.662170 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c1fab4f7-5f7b-4dfc-a9e0-e21742a723c1 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:22.663371 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c1fab4f7-5f7b-4dfc-a9e0-e21742a723c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:22.728702 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 543/1086] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:22.996712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63ae93-ce47-4908-ac5b-74739c32298c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:23.094189 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63ae93-ce47-4908-ac5b-74739c32298c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:23.134704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec8df0-1a34-4ee3-b858-bdf1041161e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:23.135345 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec8df0-1a34-4ee3-b858-bdf1041161e7 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:23.135627 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec8df0-1a34-4ee3-b858-bdf1041161e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:23.135905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec8df0-1a34-4ee3-b858-bdf1041161e7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:23.137728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:23.147250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec8df0-1a34-4ee3-b858-bdf1041161e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:08:23.151941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-59ec8df0-1a34-4ee3-b858-bdf1041161e7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 04:08:23.151941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:23.151941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:23.151941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:23.151941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:23.151941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:23.151941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:23.151941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:23.151941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:23.151941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:23.151941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:23.151941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:23.151941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:08:23.151941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:08:23.151941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:08:23.151941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:08:23.153096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:08:23.153096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:08:23.153096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:08:23.153096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:08:23.153096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:23.153096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:23.153096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:23.153096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:23.153096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:23.153096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:23.153096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:23.153096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:23.153096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:23.153096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:23.153096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:23.153096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:23.154098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:23.154098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:23.154098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:23.154098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:23.154098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:08:23.154098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:08:23.154098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:08:23.154098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:08:23.154098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:08:23.154098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:08:23.154098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 04:08:23.154098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:23.158006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 544/1087] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Sep 27 04:08:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:23.159065 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fab4f7-5f7b-4dfc-a9e0-e21742a723c1 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:23.222328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:23.256584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fab4f7-5f7b-4dfc-a9e0-e21742a723c1 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:23.288530 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2910d-c107-4c49-a5b5-8590f9100cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:23.289126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2910d-c107-4c49-a5b5-8590f9100cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:23.289404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2910d-c107-4c49-a5b5-8590f9100cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:23.289673 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2910d-c107-4c49-a5b5-8590f9100cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:23.290330 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2910d-c107-4c49-a5b5-8590f9100cb8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:23.290635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2910d-c107-4c49-a5b5-8590f9100cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:23.292030 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2910d-c107-4c49-a5b5-8590f9100cb8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:23.299510 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 544/1088] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 27 04:08:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:23.305233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec8df0-1a34-4ee3-b858-bdf1041161e7 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:23.404826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec8df0-1a34-4ee3-b858-bdf1041161e7 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:23.438400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436eb3d-f437-4df9-a5d7-9ac34f6a33fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:23.439064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436eb3d-f437-4df9-a5d7-9ac34f6a33fa None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:23.439348 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436eb3d-f437-4df9-a5d7-9ac34f6a33fa None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:23.439621 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436eb3d-f437-4df9-a5d7-9ac34f6a33fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:23.449985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436eb3d-f437-4df9-a5d7-9ac34f6a33fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:23.451549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436eb3d-f437-4df9-a5d7-9ac34f6a33fa None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:23.466161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-e436eb3d-f437-4df9-a5d7-9ac34f6a33fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:08:23.466161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:23.466161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:23.466161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:23.466161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:23.466161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:23.466161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:23.466161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:23.466161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:23.466161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:23.466161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:23.466161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:23.466161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:08:23.466161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:08:23.466161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:08:23.466161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:08:23.467355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:23.467355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:23.467355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:23.467355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:23.467355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:23.467355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:23.467355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:23.467355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:23.467355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:23.467355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:23.467355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:23.467355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:23.467355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:23.467355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:23.467355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:23.467355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:23.467355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:08:23.468468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:08:23.468468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:08:23.468468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:23.470868 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 545/1089] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:23.473009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2910d-c107-4c49-a5b5-8590f9100cb8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:23.570285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2910d-c107-4c49-a5b5-8590f9100cb8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:23.596138 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:23.602193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589e642-24fc-4e06-8681-05b654734308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:23.602836 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589e642-24fc-4e06-8681-05b654734308 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:23.603117 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589e642-24fc-4e06-8681-05b654734308 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:23.603388 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589e642-24fc-4e06-8681-05b654734308 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:23.604278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589e642-24fc-4e06-8681-05b654734308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:23.604579 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589e642-24fc-4e06-8681-05b654734308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:23.605930 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589e642-24fc-4e06-8681-05b654734308 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:23.617880 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 545/1090] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:23.623307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436eb3d-f437-4df9-a5d7-9ac34f6a33fa None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:23.667613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:23.719948 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436eb3d-f437-4df9-a5d7-9ac34f6a33fa None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:23.752444 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89355be5-8715-43c0-bcf7-3d010def8d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:23.753053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89355be5-8715-43c0-bcf7-3d010def8d09 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:23.753334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89355be5-8715-43c0-bcf7-3d010def8d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:23.753606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89355be5-8715-43c0-bcf7-3d010def8d09 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:23.761295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89355be5-8715-43c0-bcf7-3d010def8d09 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:23.762877 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89355be5-8715-43c0-bcf7-3d010def8d09 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:23.773791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-89355be5-8715-43c0-bcf7-3d010def8d09 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:08:23.773791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:23.773791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:23.773791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:23.773791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:23.773791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:23.773791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:23.773791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:23.773791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:23.773791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:23.773791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:23.773791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:23.773791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:08:23.773791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:08:23.773791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:08:23.773791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:08:23.774891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:23.774891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:23.774891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:08:23.774891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:08:23.774891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:08:23.774891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:08:23.774891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:23.774891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:23.774891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:23.774891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:23.774891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:23.774891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:23.774891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:23.774891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:23.774891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:23.774891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:23.774891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:23.774891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:23.775866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:23.775866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:23.775866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:08:23.775866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:08:23.775866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:08:23.775866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:08:23.775866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:08:23.775866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:08:23.775866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:08:23.775866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:23.775866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 546/1091] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 27 04:08:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:08:23.782414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589e642-24fc-4e06-8681-05b654734308 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:23.879089 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589e642-24fc-4e06-8681-05b654734308 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:23.914851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92657e37-ca20-4512-af1b-92d859796563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:23.915463 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92657e37-ca20-4512-af1b-92d859796563 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:23.915744 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92657e37-ca20-4512-af1b-92d859796563 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:23.916020 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92657e37-ca20-4512-af1b-92d859796563 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:23.916748 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92657e37-ca20-4512-af1b-92d859796563 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:23.917056 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92657e37-ca20-4512-af1b-92d859796563 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:23.918478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92657e37-ca20-4512-af1b-92d859796563 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:23.935543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 546/1092] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 27 04:08:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:23.941220 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89355be5-8715-43c0-bcf7-3d010def8d09 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:24.038624 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89355be5-8715-43c0-bcf7-3d010def8d09 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:24.045420 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:24.072322 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839ee6e-2a02-4d38-b97d-f5e52eb3b5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:24.072924 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839ee6e-2a02-4d38-b97d-f5e52eb3b5dc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:24.073213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839ee6e-2a02-4d38-b97d-f5e52eb3b5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:24.073487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839ee6e-2a02-4d38-b97d-f5e52eb3b5dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:24.139537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839ee6e-2a02-4d38-b97d-f5e52eb3b5dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:24.140942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839ee6e-2a02-4d38-b97d-f5e52eb3b5dc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:24.237209 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 547/1093] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:08:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:08:24.243042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92657e37-ca20-4512-af1b-92d859796563 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:24.299897 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:24.351695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92657e37-ca20-4512-af1b-92d859796563 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:24.371681 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc914de-5bd8-4dc3-98ce-b9f65adca21d None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:24.372018 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc914de-5bd8-4dc3-98ce-b9f65adca21d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:24.372298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc914de-5bd8-4dc3-98ce-b9f65adca21d None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:24.373631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 548/1094] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:08:24.378563 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531a36f-07dd-4f69-8fc0-26447c85ca23 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:24.378873 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531a36f-07dd-4f69-8fc0-26447c85ca23 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:24.379149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531a36f-07dd-4f69-8fc0-26447c85ca23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:24.384946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fa15b-4403-4883-9f48-f05d25906555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:24.385568 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fa15b-4403-4883-9f48-f05d25906555 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:24.385848 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fa15b-4403-4883-9f48-f05d25906555 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:24.386121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fa15b-4403-4883-9f48-f05d25906555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:24.392525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:24.399325 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fa15b-4403-4883-9f48-f05d25906555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:24.400239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a531a36f-07dd-4f69-8fc0-26447c85ca23 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:24.400840 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fa15b-4403-4883-9f48-f05d25906555 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:24.401442 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a531a36f-07dd-4f69-8fc0-26447c85ca23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:24.416451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-c72fa15b-4403-4883-9f48-f05d25906555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:08:24.416451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:24.416451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:24.416451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:24.416451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:24.416451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:24.416451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:24.416451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:24.416451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:24.416451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:24.416451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:24.416451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:24.416451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:08:24.416451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:08:24.416451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:08:24.416451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:08:24.417741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:24.417741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:24.417741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:24.417741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:24.417741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:24.417741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:24.417741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:24.417741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:24.417741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:24.417741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:24.417741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:24.417741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:24.417741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:24.417741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:24.417741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:24.417741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:24.417741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:08:24.418953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:08:24.418953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:08:24.418953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:24.418953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 547/1095] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:24.423400 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fa15b-4403-4883-9f48-f05d25906555 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:24.470175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 549/1096] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:08:24.517015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:24.520568 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fa15b-4403-4883-9f48-f05d25906555 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:24.552960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83c3c9-f9b0-49c2-9a16-33660531f4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:24.553556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83c3c9-f9b0-49c2-9a16-33660531f4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:24.553837 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83c3c9-f9b0-49c2-9a16-33660531f4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:24.554110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83c3c9-f9b0-49c2-9a16-33660531f4a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:24.554775 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83c3c9-f9b0-49c2-9a16-33660531f4a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:24.555084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83c3c9-f9b0-49c2-9a16-33660531f4a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:24.556435 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83c3c9-f9b0-49c2-9a16-33660531f4a3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:24.567930 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 548/1097] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:08:24.573568 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531a36f-07dd-4f69-8fc0-26447c85ca23 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:24.669737 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531a36f-07dd-4f69-8fc0-26447c85ca23 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:24.702010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a93bb5-f0cc-4192-9031-9fc3fcb4d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:24.702624 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a93bb5-f0cc-4192-9031-9fc3fcb4d76b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:24.702930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a93bb5-f0cc-4192-9031-9fc3fcb4d76b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:24.703202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a93bb5-f0cc-4192-9031-9fc3fcb4d76b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:24.705742 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:24.710904 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a93bb5-f0cc-4192-9031-9fc3fcb4d76b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:24.712458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a93bb5-f0cc-4192-9031-9fc3fcb4d76b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:24.723488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-05a93bb5-f0cc-4192-9031-9fc3fcb4d76b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:08:24.723488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:24.723488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:24.723488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:24.723488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:24.723488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:24.723488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:24.723488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:24.723488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:24.723488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:24.723488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:24.723488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:24.723488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:08:24.723488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:08:24.723488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:08:24.724468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:08:24.724468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:24.724468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:24.724468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:24.724468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:24.724468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:24.724468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:24.724468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:24.724468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:24.724468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:24.724468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:24.724468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:24.724468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:24.724468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:24.724468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:24.724468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:24.724468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:24.725383 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:08:24.725383 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:08:24.725383 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:08:24.725383 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:08:24.725383 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:08:24.725383 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:08:24.725383 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:08:24.725383 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:24.725383 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 550/1098] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:08:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:24.730607 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83c3c9-f9b0-49c2-9a16-33660531f4a3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:24.737952 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a93bb5-f0cc-4192-9031-9fc3fcb4d76b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:24.829263 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83c3c9-f9b0-49c2-9a16-33660531f4a3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:24.835143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a93bb5-f0cc-4192-9031-9fc3fcb4d76b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:24.862101 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11c838-bf6b-409d-b3f7-11c8269fd7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:24.862789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11c838-bf6b-409d-b3f7-11c8269fd7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:24.863000 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11c838-bf6b-409d-b3f7-11c8269fd7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:24.863272 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11c838-bf6b-409d-b3f7-11c8269fd7b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:24.863957 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11c838-bf6b-409d-b3f7-11c8269fd7b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:24.864260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11c838-bf6b-409d-b3f7-11c8269fd7b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:24.865671 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11c838-bf6b-409d-b3f7-11c8269fd7b5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:24.868356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcf2b0-cd12-44fd-a052-6f52eda740db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:24.868975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcf2b0-cd12-44fd-a052-6f52eda740db None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:24.869262 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcf2b0-cd12-44fd-a052-6f52eda740db None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:24.869542 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcf2b0-cd12-44fd-a052-6f52eda740db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:24.877183 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 549/1099] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:08:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:24.882912 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcf2b0-cd12-44fd-a052-6f52eda740db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:08:24.883683 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11c838-bf6b-409d-b3f7-11c8269fd7b5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:24.885629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-a2fcf2b0-cd12-44fd-a052-6f52eda740db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:08:24.885629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:24.885629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:24.885629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:24.885629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:24.885629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:24.885629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:24.885629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:24.885629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:24.885629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:24.885629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:24.885629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:24.885629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:08:24.885629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:08:24.885629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:08:24.885629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:08:24.886602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:08:24.886602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:08:24.886602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:08:24.886602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:08:24.886602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:24.886602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:24.886602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:24.886602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:24.886602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:24.886602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:24.886602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:24.886602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:24.886602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:24.886602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:24.886602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:24.886602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:24.887515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:24.887515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:24.887515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:24.887515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:24.887515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:08:24.887515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:08:24.887515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:08:24.887515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:08:24.887515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:08:24.887515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:08:24.887515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:08:24.887515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:24.887515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 551/1100] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:08:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:08:24.892310 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcf2b0-cd12-44fd-a052-6f52eda740db None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:24.907378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:24.947903 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:24.989224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11c838-bf6b-409d-b3f7-11c8269fd7b5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:24.992534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcf2b0-cd12-44fd-a052-6f52eda740db None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:25.022466 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3cd41-11e1-46ab-9854-e88e6035b3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:25.023124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3cd41-11e1-46ab-9854-e88e6035b3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:25.023404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3cd41-11e1-46ab-9854-e88e6035b3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:25.023674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3cd41-11e1-46ab-9854-e88e6035b3d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:25.024402 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3cd41-11e1-46ab-9854-e88e6035b3d5 None admin] RBAC: Adding query filter params (role.id=1971d31ccfa34212a9ae9350ac58dcb9, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=3960d52dee8443cf9ec8930a389a7b60) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:25.024713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3cd41-11e1-46ab-9854-e88e6035b3d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:25.025182 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e0317-9a53-4bb4-b9d3-7468130bf0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:25.025786 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e0317-9a53-4bb4-b9d3-7468130bf0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:25.026113 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e0317-9a53-4bb4-b9d3-7468130bf0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:25.026416 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e0317-9a53-4bb4-b9d3-7468130bf0c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:25.026591 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3cd41-11e1-46ab-9854-e88e6035b3d5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:25.027103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e0317-9a53-4bb4-b9d3-7468130bf0c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:25.027408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e0317-9a53-4bb4-b9d3-7468130bf0c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:25.028765 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e0317-9a53-4bb4-b9d3-7468130bf0c1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:25.032340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 550/1101] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:08:24 2022] GET /identity/v3/role_assignments?user.id=3960d52dee8443cf9ec8930a389a7b60&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=1971d31ccfa34212a9ae9350ac58dcb9 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:25.037310 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 552/1102] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:08:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:08:25.043488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3cd41-11e1-46ab-9854-e88e6035b3d5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:25.133339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:25.150474 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3cd41-11e1-46ab-9854-e88e6035b3d5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:25.185753 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe5a8a-361a-4ac4-a661-2b41bb96019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:25.186403 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe5a8a-361a-4ac4-a661-2b41bb96019b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:25.186688 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe5a8a-361a-4ac4-a661-2b41bb96019b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:25.186994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe5a8a-361a-4ac4-a661-2b41bb96019b None admin] PATH_INFO: `/v3/users/a3c2e49099584654b452473439b644f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:25.188176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe5a8a-361a-4ac4-a661-2b41bb96019b None admin] RBAC: Authorizing `identity:get_user(user_id=a3c2e49099584654b452473439b644f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:25.189631 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe5a8a-361a-4ac4-a661-2b41bb96019b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:25.191260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 551/1103] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:08:25 2022] GET /identity/v3/users/a3c2e49099584654b452473439b644f2 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:25.197125 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e0317-9a53-4bb4-b9d3-7468130bf0c1 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:25.302005 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e0317-9a53-4bb4-b9d3-7468130bf0c1 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:25.320259 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:25.338498 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99d437-34c8-4763-9d72-454cc68101f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:25.339140 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d437-34c8-4763-9d72-454cc68101f3 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:25.339425 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d437-34c8-4763-9d72-454cc68101f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:25.339696 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d437-34c8-4763-9d72-454cc68101f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:25.409535 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99d437-34c8-4763-9d72-454cc68101f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:25.411581 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99d437-34c8-4763-9d72-454cc68101f3 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:25.509618 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 553/1104] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:08:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:08:25.515635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe5a8a-361a-4ac4-a661-2b41bb96019b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:25.619063 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe5a8a-361a-4ac4-a661-2b41bb96019b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:25.652980 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb967e-f1aa-4ae3-9c98-f7965fbb7bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:25.653611 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb967e-f1aa-4ae3-9c98-f7965fbb7bfd None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:25.653893 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb967e-f1aa-4ae3-9c98-f7965fbb7bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:25.654626 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb967e-f1aa-4ae3-9c98-f7965fbb7bfd None admin] PATH_INFO: `/v3/projects/f4d59d8057ce404188753175b2022f7d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:25.655441 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb967e-f1aa-4ae3-9c98-f7965fbb7bfd None admin] RBAC: Authorizing `identity:get_project(project_id=f4d59d8057ce404188753175b2022f7d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:25.656862 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb967e-f1aa-4ae3-9c98-f7965fbb7bfd None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:25.658472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 552/1105] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:08:25 2022] GET /identity/v3/projects/f4d59d8057ce404188753175b2022f7d => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:25.664649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99d437-34c8-4763-9d72-454cc68101f3 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:25.683656 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:25.766858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99d437-34c8-4763-9d72-454cc68101f3 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:25.800314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31d250-27ea-44a8-a02a-90c7318f6a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:25.800917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31d250-27ea-44a8-a02a-90c7318f6a11 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:25.801723 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31d250-27ea-44a8-a02a-90c7318f6a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:25.802001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31d250-27ea-44a8-a02a-90c7318f6a11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:25.802750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31d250-27ea-44a8-a02a-90c7318f6a11 None admin] RBAC: Adding query filter params (role.id=2613cf4a98d44744a094c7782b19b4b5, scope.project.id=f4d59d8057ce404188753175b2022f7d, user.id=a3c2e49099584654b452473439b644f2) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:25.803061 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31d250-27ea-44a8-a02a-90c7318f6a11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:25.804491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31d250-27ea-44a8-a02a-90c7318f6a11 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:25.810315 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 554/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:08:25 2022] GET /identity/v3/role_assignments?user.id=a3c2e49099584654b452473439b644f2&scope.project.id=f4d59d8057ce404188753175b2022f7d&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:08:27.944094 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed01be-1a80-48cd-a761-34371e9084aa None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:27.944621 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed01be-1a80-48cd-a761-34371e9084aa None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:27.944621 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed01be-1a80-48cd-a761-34371e9084aa None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:27.945956 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 553/1107] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:27.951033 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e806e9-8499-4060-96fe-6d591b5fbf57 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:27.951455 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e806e9-8499-4060-96fe-6d591b5fbf57 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:27.951617 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e806e9-8499-4060-96fe-6d591b5fbf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:27.969571 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-97e806e9-8499-4060-96fe-6d591b5fbf57 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:27.970770 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-97e806e9-8499-4060-96fe-6d591b5fbf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:28.033715 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 555/1108] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:28.306098 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed01be-1a80-48cd-a761-34371e9084aa None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:28.328211 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:28.406311 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed01be-1a80-48cd-a761-34371e9084aa None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:28.440577 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28ad98-4cd1-4444-b254-f9826a3ed40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:28.441197 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28ad98-4cd1-4444-b254-f9826a3ed40e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:28.441481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28ad98-4cd1-4444-b254-f9826a3ed40e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:28.441787 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28ad98-4cd1-4444-b254-f9826a3ed40e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:28.442928 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28ad98-4cd1-4444-b254-f9826a3ed40e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:28.444378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28ad98-4cd1-4444-b254-f9826a3ed40e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:28.445926 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 554/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:28.451664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e806e9-8499-4060-96fe-6d591b5fbf57 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:28.465620 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:28.549556 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e806e9-8499-4060-96fe-6d591b5fbf57 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:28.581887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48009245-7083-404b-829b-01acb44ac030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:28.582422 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48009245-7083-404b-829b-01acb44ac030 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:28.582699 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48009245-7083-404b-829b-01acb44ac030 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:28.582995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48009245-7083-404b-829b-01acb44ac030 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:28.583655 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48009245-7083-404b-829b-01acb44ac030 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:28.585077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48009245-7083-404b-829b-01acb44ac030 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:28.605286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 556/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 27 04:08:28 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:08:30.776273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a471d79-88b4-4611-b83c-c7d56497fb33 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:30.776805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a471d79-88b4-4611-b83c-c7d56497fb33 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:30.776805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a471d79-88b4-4611-b83c-c7d56497fb33 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:30.778134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 555/1111] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:30.783299 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146fb9-b59f-4a5b-93ba-971b783ea69b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:30.783670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146fb9-b59f-4a5b-93ba-971b783ea69b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:30.783868 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146fb9-b59f-4a5b-93ba-971b783ea69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:30.801619 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f3146fb9-b59f-4a5b-93ba-971b783ea69b None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:30.802948 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f3146fb9-b59f-4a5b-93ba-971b783ea69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:30.862601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:30.869036 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 557/1112] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:31.140751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a471d79-88b4-4611-b83c-c7d56497fb33 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:31.231087 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:31.244647 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a471d79-88b4-4611-b83c-c7d56497fb33 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:31.278009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d5f7e-9a43-4ef4-ac98-80aa1e93966c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:31.278623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d5f7e-9a43-4ef4-ac98-80aa1e93966c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:31.278934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d5f7e-9a43-4ef4-ac98-80aa1e93966c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:31.279213 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d5f7e-9a43-4ef4-ac98-80aa1e93966c None admin] PATH_INFO: `/v3/roles/9e2965c7d68d423a965894a8eb16903f` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:31.280591 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d5f7e-9a43-4ef4-ac98-80aa1e93966c None admin] RBAC: Authorizing `identity:get_role(role_id=9e2965c7d68d423a965894a8eb16903f)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:31.281956 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d5f7e-9a43-4ef4-ac98-80aa1e93966c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:31.283339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 556/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:08:31 2022] GET /identity/v3/roles/9e2965c7d68d423a965894a8eb16903f => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:31.289062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146fb9-b59f-4a5b-93ba-971b783ea69b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:31.385441 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146fb9-b59f-4a5b-93ba-971b783ea69b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:31.418421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02373b03-0aa6-4003-93c7-ace2ef8e9f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:31.419108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02373b03-0aa6-4003-93c7-ace2ef8e9f87 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:31.419396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02373b03-0aa6-4003-93c7-ace2ef8e9f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:31.419675 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02373b03-0aa6-4003-93c7-ace2ef8e9f87 None admin] PATH_INFO: `/v3/users/a17de3f2759b4e4eadd6096ce5ad1e2d` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:31.433071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02373b03-0aa6-4003-93c7-ace2ef8e9f87 None admin] RBAC: Authorizing `identity:get_user(user_id=a17de3f2759b4e4eadd6096ce5ad1e2d)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:31.434514 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02373b03-0aa6-4003-93c7-ace2ef8e9f87 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:31.436136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 558/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:08:31 2022] GET /identity/v3/users/a17de3f2759b4e4eadd6096ce5ad1e2d => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:31.441842 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d5f7e-9a43-4ef4-ac98-80aa1e93966c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:31.536448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d5f7e-9a43-4ef4-ac98-80aa1e93966c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:31.569664 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ccf1c-ae02-41dd-9452-c3f6279b3689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:31.570249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ccf1c-ae02-41dd-9452-c3f6279b3689 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:31.570526 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ccf1c-ae02-41dd-9452-c3f6279b3689 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:31.570822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ccf1c-ae02-41dd-9452-c3f6279b3689 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:31.593569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:31.634603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ccf1c-ae02-41dd-9452-c3f6279b3689 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:31.636068 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ccf1c-ae02-41dd-9452-c3f6279b3689 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:31.728280 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 557/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:08:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:08:31.734378 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02373b03-0aa6-4003-93c7-ace2ef8e9f87 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:31.788279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:31.830473 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02373b03-0aa6-4003-93c7-ace2ef8e9f87 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:31.864034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7bdd5-7545-42ac-b811-d8b1692a4d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:31.864972 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7bdd5-7545-42ac-b811-d8b1692a4d81 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:31.865261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7bdd5-7545-42ac-b811-d8b1692a4d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:31.865537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7bdd5-7545-42ac-b811-d8b1692a4d81 None admin] PATH_INFO: `/v3/projects/f4d59d8057ce404188753175b2022f7d` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:31.866652 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7bdd5-7545-42ac-b811-d8b1692a4d81 None admin] RBAC: Authorizing `identity:get_project(project_id=f4d59d8057ce404188753175b2022f7d)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:31.868108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7bdd5-7545-42ac-b811-d8b1692a4d81 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:31.869707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 559/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:08:31 2022] GET /identity/v3/projects/f4d59d8057ce404188753175b2022f7d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:31.875727 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ccf1c-ae02-41dd-9452-c3f6279b3689 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:31.928422 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:31.970244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ccf1c-ae02-41dd-9452-c3f6279b3689 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:32.002939 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4e3a8-4b5e-4f6b-bea2-2f3eb4ab95d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:32.003468 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4e3a8-4b5e-4f6b-bea2-2f3eb4ab95d6 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:32.003750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4e3a8-4b5e-4f6b-bea2-2f3eb4ab95d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:32.004027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4e3a8-4b5e-4f6b-bea2-2f3eb4ab95d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:32.004775 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4e3a8-4b5e-4f6b-bea2-2f3eb4ab95d6 None admin] RBAC: Adding query filter params (role.id=9e2965c7d68d423a965894a8eb16903f, scope.project.id=f4d59d8057ce404188753175b2022f7d, user.id=a17de3f2759b4e4eadd6096ce5ad1e2d) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:32.005085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4e3a8-4b5e-4f6b-bea2-2f3eb4ab95d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:32.006498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4e3a8-4b5e-4f6b-bea2-2f3eb4ab95d6 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:32.011643 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 558/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:08:31 2022] GET /identity/v3/role_assignments?user.id=a17de3f2759b4e4eadd6096ce5ad1e2d&scope.project.id=f4d59d8057ce404188753175b2022f7d&role.id=9e2965c7d68d423a965894a8eb16903f => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:08:34.106654 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a8c08-e5a7-4667-a72c-2574ab6cfff4 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:34.107213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a8c08-e5a7-4667-a72c-2574ab6cfff4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:34.107213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a8c08-e5a7-4667-a72c-2574ab6cfff4 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:34.108577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 560/1118] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:34.113955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976beda4-c51e-4ce8-908e-85f6d3d85367 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:34.114361 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976beda4-c51e-4ce8-908e-85f6d3d85367 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:34.114500 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976beda4-c51e-4ce8-908e-85f6d3d85367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:34.132174 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-976beda4-c51e-4ce8-908e-85f6d3d85367 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:34.133352 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-976beda4-c51e-4ce8-908e-85f6d3d85367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:34.203770 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 559/1119] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:34.472470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a8c08-e5a7-4667-a72c-2574ab6cfff4 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:34.569224 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a8c08-e5a7-4667-a72c-2574ab6cfff4 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:34.592222 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:34.603062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19968db5-91e5-415e-82af-8521b1f37b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:34.603683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19968db5-91e5-415e-82af-8521b1f37b9d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:34.603967 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19968db5-91e5-415e-82af-8521b1f37b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:34.604498 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19968db5-91e5-415e-82af-8521b1f37b9d None admin] PATH_INFO: `/v3/roles/9e2965c7d68d423a965894a8eb16903f` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:34.605879 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19968db5-91e5-415e-82af-8521b1f37b9d None admin] RBAC: Authorizing `identity:get_role(role_id=9e2965c7d68d423a965894a8eb16903f)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:34.607288 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19968db5-91e5-415e-82af-8521b1f37b9d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:34.608611 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 561/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:08:34 2022] GET /identity/v3/roles/9e2965c7d68d423a965894a8eb16903f => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:34.614448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976beda4-c51e-4ce8-908e-85f6d3d85367 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:34.666356 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:34.715486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976beda4-c51e-4ce8-908e-85f6d3d85367 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:34.748165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e302b-056a-4d1e-b145-eda960ec8545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:34.748788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e302b-056a-4d1e-b145-eda960ec8545 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:34.749097 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e302b-056a-4d1e-b145-eda960ec8545 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:34.749373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e302b-056a-4d1e-b145-eda960ec8545 None admin] PATH_INFO: `/v3/users/a17de3f2759b4e4eadd6096ce5ad1e2d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:34.750473 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e302b-056a-4d1e-b145-eda960ec8545 None admin] RBAC: Authorizing `identity:get_user(user_id=a17de3f2759b4e4eadd6096ce5ad1e2d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:34.751940 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e302b-056a-4d1e-b145-eda960ec8545 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:34.753529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 560/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:08:34 2022] GET /identity/v3/users/a17de3f2759b4e4eadd6096ce5ad1e2d => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:34.759903 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19968db5-91e5-415e-82af-8521b1f37b9d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:34.865694 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19968db5-91e5-415e-82af-8521b1f37b9d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:34.897526 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81759b27-02ab-4ecb-bd18-00e0d9467f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:34.898135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81759b27-02ab-4ecb-bd18-00e0d9467f6e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:34.898414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81759b27-02ab-4ecb-bd18-00e0d9467f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:34.898686 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81759b27-02ab-4ecb-bd18-00e0d9467f6e None admin] PATH_INFO: `/v3/projects/f4d59d8057ce404188753175b2022f7d` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:34.899805 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81759b27-02ab-4ecb-bd18-00e0d9467f6e None admin] RBAC: Authorizing `identity:get_project(project_id=f4d59d8057ce404188753175b2022f7d)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:34.901224 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81759b27-02ab-4ecb-bd18-00e0d9467f6e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:34.902840 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 562/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:08:34 2022] GET /identity/v3/projects/f4d59d8057ce404188753175b2022f7d => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:34.908728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e302b-056a-4d1e-b145-eda960ec8545 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:35.005846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e302b-056a-4d1e-b145-eda960ec8545 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:35.021572 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:35.037717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b72eae-d7f3-4990-9e43-856254f8162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:35.038364 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b72eae-d7f3-4990-9e43-856254f8162a None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:35.038646 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b72eae-d7f3-4990-9e43-856254f8162a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:35.038950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b72eae-d7f3-4990-9e43-856254f8162a None admin] PATH_INFO: `/v3/projects/f4d59d8057ce404188753175b2022f7d/users/a17de3f2759b4e4eadd6096ce5ad1e2d/roles/9e2965c7d68d423a965894a8eb16903f` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:35.041065 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b72eae-d7f3-4990-9e43-856254f8162a None admin] RBAC: Authorizing `identity:create_grant(project_id=f4d59d8057ce404188753175b2022f7d, user_id=a17de3f2759b4e4eadd6096ce5ad1e2d, role_id=9e2965c7d68d423a965894a8eb16903f)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:35.042490 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b72eae-d7f3-4990-9e43-856254f8162a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:35.055018 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 561/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:08:34 2022] PUT /identity/v3/projects/f4d59d8057ce404188753175b2022f7d/users/a17de3f2759b4e4eadd6096ce5ad1e2d/roles/9e2965c7d68d423a965894a8eb16903f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:08:37.145869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d751c-ce21-4ed3-9c9d-244880cc8dea None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:37.146425 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d751c-ce21-4ed3-9c9d-244880cc8dea None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:37.146425 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d751c-ce21-4ed3-9c9d-244880cc8dea None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:37.147883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 563/1124] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:37.152943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564bfb5-5252-4acc-ab35-f16ceb17a7c4 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:37.153345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564bfb5-5252-4acc-ab35-f16ceb17a7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:37.153495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564bfb5-5252-4acc-ab35-f16ceb17a7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:37.171223 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c564bfb5-5252-4acc-ab35-f16ceb17a7c4 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:37.172396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c564bfb5-5252-4acc-ab35-f16ceb17a7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:37.236139 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 562/1125] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:37.502467 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d751c-ce21-4ed3-9c9d-244880cc8dea None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:37.559781 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:37.599455 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d751c-ce21-4ed3-9c9d-244880cc8dea None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:37.632697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa66e9e-614c-4726-9426-89f22c46f20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:37.633309 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa66e9e-614c-4726-9426-89f22c46f20e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:37.633590 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa66e9e-614c-4726-9426-89f22c46f20e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:37.633864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa66e9e-614c-4726-9426-89f22c46f20e None admin] PATH_INFO: `/v3/roles/9e2965c7d68d423a965894a8eb16903f` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:37.635248 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa66e9e-614c-4726-9426-89f22c46f20e None admin] RBAC: Authorizing `identity:get_role(role_id=9e2965c7d68d423a965894a8eb16903f)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:37.636608 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa66e9e-614c-4726-9426-89f22c46f20e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:37.637894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 564/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:08:37 2022] GET /identity/v3/roles/9e2965c7d68d423a965894a8eb16903f => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:37.643707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564bfb5-5252-4acc-ab35-f16ceb17a7c4 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:37.738490 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564bfb5-5252-4acc-ab35-f16ceb17a7c4 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:37.749271 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:37.774923 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ddeaf-bbc6-4ebf-80fb-f24a196abd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:37.775537 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ddeaf-bbc6-4ebf-80fb-f24a196abd87 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:37.775816 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ddeaf-bbc6-4ebf-80fb-f24a196abd87 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:37.776090 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ddeaf-bbc6-4ebf-80fb-f24a196abd87 None admin] PATH_INFO: `/v3/users/a17de3f2759b4e4eadd6096ce5ad1e2d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:37.777185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ddeaf-bbc6-4ebf-80fb-f24a196abd87 None admin] RBAC: Authorizing `identity:get_user(user_id=a17de3f2759b4e4eadd6096ce5ad1e2d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:37.778607 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ddeaf-bbc6-4ebf-80fb-f24a196abd87 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:37.780255 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 563/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:08:37 2022] GET /identity/v3/users/a17de3f2759b4e4eadd6096ce5ad1e2d => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:37.786827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa66e9e-614c-4726-9426-89f22c46f20e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:37.883458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa66e9e-614c-4726-9426-89f22c46f20e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:37.908553 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:37.917015 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a294e-624f-4928-821b-5790368c181c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:37.917613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a294e-624f-4928-821b-5790368c181c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:37.917898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a294e-624f-4928-821b-5790368c181c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:37.918176 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a294e-624f-4928-821b-5790368c181c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:37.982700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a294e-624f-4928-821b-5790368c181c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:37.984165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a294e-624f-4928-821b-5790368c181c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:38.077293 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 565/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:08:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:08:38.083553 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ddeaf-bbc6-4ebf-80fb-f24a196abd87 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:38.179468 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ddeaf-bbc6-4ebf-80fb-f24a196abd87 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:38.212023 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d18de4-09b3-4b1b-8d58-35082093e623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:38.212634 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d18de4-09b3-4b1b-8d58-35082093e623 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:38.212918 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d18de4-09b3-4b1b-8d58-35082093e623 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:38.213196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d18de4-09b3-4b1b-8d58-35082093e623 None admin] PATH_INFO: `/v3/projects/f4d59d8057ce404188753175b2022f7d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:38.214312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d18de4-09b3-4b1b-8d58-35082093e623 None admin] RBAC: Authorizing `identity:get_project(project_id=f4d59d8057ce404188753175b2022f7d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:38.215772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d18de4-09b3-4b1b-8d58-35082093e623 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:38.217346 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 564/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:08:38 2022] GET /identity/v3/projects/f4d59d8057ce404188753175b2022f7d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:38.223203 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a294e-624f-4928-821b-5790368c181c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:38.249361 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:38.318059 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a294e-624f-4928-821b-5790368c181c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:38.350812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af75e1f-f60c-49fe-bf56-b2d5ea564b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:38.351404 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af75e1f-f60c-49fe-bf56-b2d5ea564b85 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:38.351689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af75e1f-f60c-49fe-bf56-b2d5ea564b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:38.351960 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af75e1f-f60c-49fe-bf56-b2d5ea564b85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:38.352673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af75e1f-f60c-49fe-bf56-b2d5ea564b85 None admin] RBAC: Adding query filter params (role.id=9e2965c7d68d423a965894a8eb16903f, scope.project.id=f4d59d8057ce404188753175b2022f7d, user.id=a17de3f2759b4e4eadd6096ce5ad1e2d) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:38.352980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af75e1f-f60c-49fe-bf56-b2d5ea564b85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:38.354646 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af75e1f-f60c-49fe-bf56-b2d5ea564b85 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:38.360204 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 566/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:08:38 2022] GET /identity/v3/role_assignments?user.id=a17de3f2759b4e4eadd6096ce5ad1e2d&scope.project.id=f4d59d8057ce404188753175b2022f7d&role.id=9e2965c7d68d423a965894a8eb16903f => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:40.504941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b5bab-f32e-403a-9e19-aca622366c0d None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:40.505486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b5bab-f32e-403a-9e19-aca622366c0d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:40.505486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b5bab-f32e-403a-9e19-aca622366c0d None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:40.506821 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 565/1131] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:40.511917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45d773-e7aa-4d29-88ae-4b6d37d0e626 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:40.512350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45d773-e7aa-4d29-88ae-4b6d37d0e626 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:40.512472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45d773-e7aa-4d29-88ae-4b6d37d0e626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:40.530062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-7c45d773-e7aa-4d29-88ae-4b6d37d0e626 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:40.531279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7c45d773-e7aa-4d29-88ae-4b6d37d0e626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:40.594579 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 567/1132] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:40.863010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b5bab-f32e-403a-9e19-aca622366c0d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:40.914578 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:40.967165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b5bab-f32e-403a-9e19-aca622366c0d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:40.999607 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7b61c-954b-4e0f-b209-9a75102d81a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:41.000219 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7b61c-954b-4e0f-b209-9a75102d81a8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:41.000501 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7b61c-954b-4e0f-b209-9a75102d81a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:41.000773 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7b61c-954b-4e0f-b209-9a75102d81a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:41.001864 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7b61c-954b-4e0f-b209-9a75102d81a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:41.003312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7b61c-954b-4e0f-b209-9a75102d81a8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:41.004832 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 566/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:41.010543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45d773-e7aa-4d29-88ae-4b6d37d0e626 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:41.033445 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:41.106724 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45d773-e7aa-4d29-88ae-4b6d37d0e626 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:41.139041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10408e9f-4746-4ba8-ac88-57ae30bd9941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:41.139580 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10408e9f-4746-4ba8-ac88-57ae30bd9941 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:41.139866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10408e9f-4746-4ba8-ac88-57ae30bd9941 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:41.140140 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10408e9f-4746-4ba8-ac88-57ae30bd9941 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:41.140793 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10408e9f-4746-4ba8-ac88-57ae30bd9941 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:41.142211 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10408e9f-4746-4ba8-ac88-57ae30bd9941 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:41.167574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 568/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 27 04:08:41 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:08:43.310650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757a188-61e7-449f-8f49-4ca4f7ed65d8 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:43.311248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757a188-61e7-449f-8f49-4ca4f7ed65d8 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:43.311248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757a188-61e7-449f-8f49-4ca4f7ed65d8 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:43.312516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 567/1135] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:43.317791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712ac0a-dfe8-405a-84c0-3f7ebbacc030 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:43.318213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712ac0a-dfe8-405a-84c0-3f7ebbacc030 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:43.318361 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712ac0a-dfe8-405a-84c0-3f7ebbacc030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:43.336595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1712ac0a-dfe8-405a-84c0-3f7ebbacc030 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:43.337791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1712ac0a-dfe8-405a-84c0-3f7ebbacc030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:43.403775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 569/1136] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:43.673440 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757a188-61e7-449f-8f49-4ca4f7ed65d8 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:43.770185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757a188-61e7-449f-8f49-4ca4f7ed65d8 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:43.784224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:43.805268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb7ed0-bcd9-47f4-880f-b525b94472f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:43.805881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb7ed0-bcd9-47f4-880f-b525b94472f3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:43.806156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb7ed0-bcd9-47f4-880f-b525b94472f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:43.806423 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb7ed0-bcd9-47f4-880f-b525b94472f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:43.807533 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb7ed0-bcd9-47f4-880f-b525b94472f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:43.808954 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb7ed0-bcd9-47f4-880f-b525b94472f3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:43.810472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 568/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:08:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:43.816208 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712ac0a-dfe8-405a-84c0-3f7ebbacc030 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:43.819319 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:43.913374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712ac0a-dfe8-405a-84c0-3f7ebbacc030 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:43.945371 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382b5f5-805c-4cc4-ae6c-d9dd50b6f7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:43.945906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382b5f5-805c-4cc4-ae6c-d9dd50b6f7c6 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:43.946195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382b5f5-805c-4cc4-ae6c-d9dd50b6f7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:43.946472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382b5f5-805c-4cc4-ae6c-d9dd50b6f7c6 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:43.947154 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382b5f5-805c-4cc4-ae6c-d9dd50b6f7c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:43.948589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382b5f5-805c-4cc4-ae6c-d9dd50b6f7c6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:43.968975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 570/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 27 04:08:43 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:08:46.118028 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9813b-05c4-4399-ba67-5ad2c4202d5f None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:46.118587 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9813b-05c4-4399-ba67-5ad2c4202d5f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:46.118587 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9813b-05c4-4399-ba67-5ad2c4202d5f None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:46.119951 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 569/1139] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:46.125054 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754cb36-a0ca-4ae2-8645-f33257fccafb None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:46.125439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754cb36-a0ca-4ae2-8645-f33257fccafb None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:46.125607 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754cb36-a0ca-4ae2-8645-f33257fccafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:46.143850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e754cb36-a0ca-4ae2-8645-f33257fccafb None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:46.145064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e754cb36-a0ca-4ae2-8645-f33257fccafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:46.208960 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:46.220833 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 571/1140] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:46.492762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9813b-05c4-4399-ba67-5ad2c4202d5f None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:46.589029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9813b-05c4-4399-ba67-5ad2c4202d5f None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:46.621781 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96a683-5d1c-47ac-9180-c72e2adce9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:46.622396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96a683-5d1c-47ac-9180-c72e2adce9af None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:46.622673 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96a683-5d1c-47ac-9180-c72e2adce9af None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:46.622971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96a683-5d1c-47ac-9180-c72e2adce9af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:46.632522 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96a683-5d1c-47ac-9180-c72e2adce9af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:08:46.637222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-2c96a683-5d1c-47ac-9180-c72e2adce9af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:08:46.637222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:46.637222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:46.637222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:46.637222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:46.637222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:46.637222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:46.637222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:46.637222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:46.637222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:46.637222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:46.637222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:46.637222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:08:46.637222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:08:46.637222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:08:46.637222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:08:46.638286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:08:46.638286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:08:46.638286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:08:46.638286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:08:46.638286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:46.638286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:46.638286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:46.638286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:46.638286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:46.638286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:46.638286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:46.638286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:46.638286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:46.638286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:46.638286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:46.638286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:46.639257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:46.639257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:46.639257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:46.639257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:46.639257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:08:46.639257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:08:46.639257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:08:46.639257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:08:46.639257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:08:46.639257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:08:46.639257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:08:46.639257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:46.639257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 570/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:08:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:46.644137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754cb36-a0ca-4ae2-8645-f33257fccafb None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:46.739602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754cb36-a0ca-4ae2-8645-f33257fccafb None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:46.774863 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95f17f-42c0-478e-94f6-c506cb290585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:46.775469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95f17f-42c0-478e-94f6-c506cb290585 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:46.775750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95f17f-42c0-478e-94f6-c506cb290585 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:46.776026 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95f17f-42c0-478e-94f6-c506cb290585 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:46.776697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95f17f-42c0-478e-94f6-c506cb290585 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:46.777005 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95f17f-42c0-478e-94f6-c506cb290585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:46.778368 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95f17f-42c0-478e-94f6-c506cb290585 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:46.786850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 572/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:08:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:46.792724 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96a683-5d1c-47ac-9180-c72e2adce9af None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:46.833987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:46.889691 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96a683-5d1c-47ac-9180-c72e2adce9af None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:46.922568 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa44c2d-c914-4cc9-893b-74b9e6476493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:46.923212 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa44c2d-c914-4cc9-893b-74b9e6476493 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:46.923491 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa44c2d-c914-4cc9-893b-74b9e6476493 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:46.923765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa44c2d-c914-4cc9-893b-74b9e6476493 None admin] PATH_INFO: `/v3/users/ee08911ae1fe463e9fd5d52d900e574e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:46.936189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa44c2d-c914-4cc9-893b-74b9e6476493 None admin] RBAC: Authorizing `identity:get_user(user_id=ee08911ae1fe463e9fd5d52d900e574e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:46.937624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa44c2d-c914-4cc9-893b-74b9e6476493 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:46.939212 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 571/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:08:46 2022] GET /identity/v3/users/ee08911ae1fe463e9fd5d52d900e574e => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:46.944918 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95f17f-42c0-478e-94f6-c506cb290585 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:46.996078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:47.041987 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95f17f-42c0-478e-94f6-c506cb290585 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:47.073529 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c4416-d7a3-4ea3-814b-30be80ccf3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:47.074120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c4416-d7a3-4ea3-814b-30be80ccf3dd None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:47.074410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c4416-d7a3-4ea3-814b-30be80ccf3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:47.074685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c4416-d7a3-4ea3-814b-30be80ccf3dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:47.139493 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c4416-d7a3-4ea3-814b-30be80ccf3dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:47.140934 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c4416-d7a3-4ea3-814b-30be80ccf3dd None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:47.189728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:47.237000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 573/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:08:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:08:47.242859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa44c2d-c914-4cc9-893b-74b9e6476493 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:47.333795 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:47.337608 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa44c2d-c914-4cc9-893b-74b9e6476493 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:47.369808 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46772689-d489-4a67-b4f3-ba6830ffbf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:47.370417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46772689-d489-4a67-b4f3-ba6830ffbf2f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:47.370736 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46772689-d489-4a67-b4f3-ba6830ffbf2f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:47.371040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46772689-d489-4a67-b4f3-ba6830ffbf2f None admin] PATH_INFO: `/v3/projects/ab0ae5e6f3ad4500b2f814ba0883bc31` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:47.372142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46772689-d489-4a67-b4f3-ba6830ffbf2f None admin] RBAC: Authorizing `identity:get_project(project_id=ab0ae5e6f3ad4500b2f814ba0883bc31)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:47.373552 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46772689-d489-4a67-b4f3-ba6830ffbf2f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:47.375167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 572/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:08:47 2022] GET /identity/v3/projects/ab0ae5e6f3ad4500b2f814ba0883bc31 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:47.381699 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c4416-d7a3-4ea3-814b-30be80ccf3dd None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:47.480694 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c4416-d7a3-4ea3-814b-30be80ccf3dd None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:47.518917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb2ec1-8945-4cc7-825d-6c4264a03fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:47.519576 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb2ec1-8945-4cc7-825d-6c4264a03fdc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:47.519861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb2ec1-8945-4cc7-825d-6c4264a03fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:47.520137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb2ec1-8945-4cc7-825d-6c4264a03fdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:47.520859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb2ec1-8945-4cc7-825d-6c4264a03fdc None admin] RBAC: Adding query filter params (role.id=2613cf4a98d44744a094c7782b19b4b5, scope.project.id=ab0ae5e6f3ad4500b2f814ba0883bc31, user.id=ee08911ae1fe463e9fd5d52d900e574e) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:47.521169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb2ec1-8945-4cc7-825d-6c4264a03fdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:47.522594 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb2ec1-8945-4cc7-825d-6c4264a03fdc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:47.527832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 574/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:08:47 2022] GET /identity/v3/role_assignments?user.id=ee08911ae1fe463e9fd5d52d900e574e&scope.project.id=ab0ae5e6f3ad4500b2f814ba0883bc31&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:49.653296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5832d85-0440-4324-bc50-153f8a230ed1 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:49.653797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5832d85-0440-4324-bc50-153f8a230ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:49.653797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5832d85-0440-4324-bc50-153f8a230ed1 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:49.655207 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 573/1147] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:49.660839 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784645e5-5cfb-4b2b-9ff2-32540ce0fb94 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:49.661274 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784645e5-5cfb-4b2b-9ff2-32540ce0fb94 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:49.661417 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784645e5-5cfb-4b2b-9ff2-32540ce0fb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:49.679487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-784645e5-5cfb-4b2b-9ff2-32540ce0fb94 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:49.680654 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-784645e5-5cfb-4b2b-9ff2-32540ce0fb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:49.690843 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:49.748350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 575/1148] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:50.016615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5832d85-0440-4324-bc50-153f8a230ed1 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:50.119834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5832d85-0440-4324-bc50-153f8a230ed1 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:50.152778 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aedf0f-12b6-4892-bb39-d2ef1eca1167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:50.153395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aedf0f-12b6-4892-bb39-d2ef1eca1167 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:50.153675 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aedf0f-12b6-4892-bb39-d2ef1eca1167 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:50.153949 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aedf0f-12b6-4892-bb39-d2ef1eca1167 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:50.163647 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aedf0f-12b6-4892-bb39-d2ef1eca1167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:08:50.168387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-f1aedf0f-12b6-4892-bb39-d2ef1eca1167 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:08:50.168387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:50.168387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:50.168387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:50.168387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:50.168387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:50.168387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:50.168387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:50.168387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:50.168387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:50.168387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:50.168387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:50.168387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:08:50.168387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:08:50.168387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:08:50.168387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:08:50.169470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:08:50.169470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:08:50.169470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:08:50.169470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:08:50.169470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:50.169470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:50.169470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:50.169470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:50.169470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:50.169470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:50.169470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:50.169470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:50.169470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:50.169470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:50.169470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:50.169470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:50.170679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:50.170679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:50.170679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:50.170679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:50.170679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:08:50.170679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:08:50.170679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:08:50.170679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:08:50.170679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:08:50.170679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:08:50.170679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:08:50.170679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:50.170679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 574/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:08:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:50.175641 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784645e5-5cfb-4b2b-9ff2-32540ce0fb94 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:50.271698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784645e5-5cfb-4b2b-9ff2-32540ce0fb94 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:50.303572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9379a50-591d-4005-af61-ca8fc572c348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:50.304172 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9379a50-591d-4005-af61-ca8fc572c348 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:50.304454 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9379a50-591d-4005-af61-ca8fc572c348 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:50.304731 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9379a50-591d-4005-af61-ca8fc572c348 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:50.305397 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9379a50-591d-4005-af61-ca8fc572c348 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:50.305703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9379a50-591d-4005-af61-ca8fc572c348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:50.307098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9379a50-591d-4005-af61-ca8fc572c348 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:50.314725 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 576/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:08:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:50.320827 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aedf0f-12b6-4892-bb39-d2ef1eca1167 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:50.347794 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:50.422767 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aedf0f-12b6-4892-bb39-d2ef1eca1167 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:50.455580 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33eb33f-2ca7-4b62-95f3-e533793e056d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:50.456202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33eb33f-2ca7-4b62-95f3-e533793e056d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:50.456484 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33eb33f-2ca7-4b62-95f3-e533793e056d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:50.456762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33eb33f-2ca7-4b62-95f3-e533793e056d None admin] PATH_INFO: `/v3/users/ee08911ae1fe463e9fd5d52d900e574e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:50.458502 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33eb33f-2ca7-4b62-95f3-e533793e056d None admin] RBAC: Authorizing `identity:get_user(user_id=ee08911ae1fe463e9fd5d52d900e574e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:50.459981 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33eb33f-2ca7-4b62-95f3-e533793e056d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:50.461523 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 575/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:08:50 2022] GET /identity/v3/users/ee08911ae1fe463e9fd5d52d900e574e => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:50.467280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9379a50-591d-4005-af61-ca8fc572c348 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:50.478232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:50.564746 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9379a50-591d-4005-af61-ca8fc572c348 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:50.597314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae06d16-1754-42c7-ba4d-f10c46e8dcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:50.597961 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae06d16-1754-42c7-ba4d-f10c46e8dcfc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:50.598248 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae06d16-1754-42c7-ba4d-f10c46e8dcfc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:50.598528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae06d16-1754-42c7-ba4d-f10c46e8dcfc None admin] PATH_INFO: `/v3/projects/ab0ae5e6f3ad4500b2f814ba0883bc31` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:50.599668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae06d16-1754-42c7-ba4d-f10c46e8dcfc None admin] RBAC: Authorizing `identity:get_project(project_id=ab0ae5e6f3ad4500b2f814ba0883bc31)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:50.601104 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae06d16-1754-42c7-ba4d-f10c46e8dcfc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:50.602733 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 577/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:08:50 2022] GET /identity/v3/projects/ab0ae5e6f3ad4500b2f814ba0883bc31 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:50.608890 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33eb33f-2ca7-4b62-95f3-e533793e056d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:50.698220 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:50.705039 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33eb33f-2ca7-4b62-95f3-e533793e056d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:50.736607 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32236490-6cd7-4955-8045-5a266614d281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:50.737243 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32236490-6cd7-4955-8045-5a266614d281 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:50.737522 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32236490-6cd7-4955-8045-5a266614d281 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:50.737795 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32236490-6cd7-4955-8045-5a266614d281 None admin] PATH_INFO: `/v3/projects/ab0ae5e6f3ad4500b2f814ba0883bc31/users/ee08911ae1fe463e9fd5d52d900e574e/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:50.740234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32236490-6cd7-4955-8045-5a266614d281 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab0ae5e6f3ad4500b2f814ba0883bc31, user_id=ee08911ae1fe463e9fd5d52d900e574e, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:50.741655 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32236490-6cd7-4955-8045-5a266614d281 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:50.754794 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 576/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:08:50 2022] PUT /identity/v3/projects/ab0ae5e6f3ad4500b2f814ba0883bc31/users/ee08911ae1fe463e9fd5d52d900e574e/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:08:52.845125 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064978f-0674-4926-bef9-9ed8f45f7a85 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:52.845707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064978f-0674-4926-bef9-9ed8f45f7a85 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:52.845707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064978f-0674-4926-bef9-9ed8f45f7a85 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:52.847031 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 578/1154] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:52.852244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d7acd-36e5-4101-b304-1d8cbf57ec82 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:52.852675 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d7acd-36e5-4101-b304-1d8cbf57ec82 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:52.852782 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d7acd-36e5-4101-b304-1d8cbf57ec82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:52.871243 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ae5d7acd-36e5-4101-b304-1d8cbf57ec82 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:52.872417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ae5d7acd-36e5-4101-b304-1d8cbf57ec82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:52.935682 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 577/1155] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:08:53.202196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064978f-0674-4926-bef9-9ed8f45f7a85 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:53.276813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:53.300260 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064978f-0674-4926-bef9-9ed8f45f7a85 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:53.332485 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60eff61-918c-4b98-b1b3-d5f08ed8739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:53.333097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60eff61-918c-4b98-b1b3-d5f08ed8739a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:53.333374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60eff61-918c-4b98-b1b3-d5f08ed8739a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:53.333644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60eff61-918c-4b98-b1b3-d5f08ed8739a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:53.343237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60eff61-918c-4b98-b1b3-d5f08ed8739a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:08:53.348494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-e60eff61-918c-4b98-b1b3-d5f08ed8739a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:08:53.348494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:53.348494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:53.348494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:53.348494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:53.348494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:53.348494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:53.348494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:53.348494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:53.348494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:53.348494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:53.348494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:53.348494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:08:53.348494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:08:53.348494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:08:53.348494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:08:53.349613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:08:53.349613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:08:53.349613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:08:53.349613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:08:53.349613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:53.349613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:53.349613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:53.349613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:53.349613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:53.349613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:53.349613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:53.349613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:53.349613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:53.349613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:53.349613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:53.349613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:53.350859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:53.350859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:53.350859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:53.350859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:53.350859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:08:53.350859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:08:53.350859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:08:53.350859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:08:53.350859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:08:53.350859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:08:53.350859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:08:53.350859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:08:53.350859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 579/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:08:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:53.355659 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d7acd-36e5-4101-b304-1d8cbf57ec82 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:53.435827 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:53.452111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d7acd-36e5-4101-b304-1d8cbf57ec82 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:53.485312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b90717-b4ab-4567-ac18-9e77fe286b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:53.485853 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b90717-b4ab-4567-ac18-9e77fe286b25 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:53.486134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b90717-b4ab-4567-ac18-9e77fe286b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:53.486408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b90717-b4ab-4567-ac18-9e77fe286b25 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:53.487100 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b90717-b4ab-4567-ac18-9e77fe286b25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:53.487407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b90717-b4ab-4567-ac18-9e77fe286b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:53.488807 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b90717-b4ab-4567-ac18-9e77fe286b25 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:53.496439 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 578/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:08:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:53.502387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60eff61-918c-4b98-b1b3-d5f08ed8739a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:53.598537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60eff61-918c-4b98-b1b3-d5f08ed8739a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:53.630482 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4848ba-d9cf-47b8-a72c-aead76bad147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:53.631109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4848ba-d9cf-47b8-a72c-aead76bad147 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:53.631388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4848ba-d9cf-47b8-a72c-aead76bad147 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:53.631656 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4848ba-d9cf-47b8-a72c-aead76bad147 None admin] PATH_INFO: `/v3/users/ee08911ae1fe463e9fd5d52d900e574e` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:53.632747 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4848ba-d9cf-47b8-a72c-aead76bad147 None admin] RBAC: Authorizing `identity:get_user(user_id=ee08911ae1fe463e9fd5d52d900e574e)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:53.634163 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4848ba-d9cf-47b8-a72c-aead76bad147 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:53.635717 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 580/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:08:53 2022] GET /identity/v3/users/ee08911ae1fe463e9fd5d52d900e574e => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:53.641294 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b90717-b4ab-4567-ac18-9e77fe286b25 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:53.736826 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b90717-b4ab-4567-ac18-9e77fe286b25 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:53.767958 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417d4f1-eed9-4f2e-b5bf-95743741dbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:53.768546 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417d4f1-eed9-4f2e-b5bf-95743741dbdb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:53.768827 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417d4f1-eed9-4f2e-b5bf-95743741dbdb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:53.769101 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417d4f1-eed9-4f2e-b5bf-95743741dbdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:53.783790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:53.835760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417d4f1-eed9-4f2e-b5bf-95743741dbdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:53.837221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417d4f1-eed9-4f2e-b5bf-95743741dbdb None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:53.931147 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 579/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:08:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:08:53.937055 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4848ba-d9cf-47b8-a72c-aead76bad147 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:53.940726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:54.032928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4848ba-d9cf-47b8-a72c-aead76bad147 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:54.064481 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125afb0-8dd0-439d-84a7-2c91a8abcf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:54.065091 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125afb0-8dd0-439d-84a7-2c91a8abcf5b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:54.065369 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125afb0-8dd0-439d-84a7-2c91a8abcf5b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:54.065642 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125afb0-8dd0-439d-84a7-2c91a8abcf5b None admin] PATH_INFO: `/v3/projects/ab0ae5e6f3ad4500b2f814ba0883bc31` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:54.067318 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125afb0-8dd0-439d-84a7-2c91a8abcf5b None admin] RBAC: Authorizing `identity:get_project(project_id=ab0ae5e6f3ad4500b2f814ba0883bc31)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:54.068724 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125afb0-8dd0-439d-84a7-2c91a8abcf5b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:54.070305 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 581/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:08:53 2022] GET /identity/v3/projects/ab0ae5e6f3ad4500b2f814ba0883bc31 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:54.076510 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417d4f1-eed9-4f2e-b5bf-95743741dbdb None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:54.120724 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:54.173407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417d4f1-eed9-4f2e-b5bf-95743741dbdb None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:54.205601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ecacd-3511-489c-858e-1eb0c84bcd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:54.206176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ecacd-3511-489c-858e-1eb0c84bcd51 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:54.206455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ecacd-3511-489c-858e-1eb0c84bcd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:54.206751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ecacd-3511-489c-858e-1eb0c84bcd51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:54.208070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ecacd-3511-489c-858e-1eb0c84bcd51 None admin] RBAC: Adding query filter params (role.id=2613cf4a98d44744a094c7782b19b4b5, scope.project.id=ab0ae5e6f3ad4500b2f814ba0883bc31, user.id=ee08911ae1fe463e9fd5d52d900e574e) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:54.208381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ecacd-3511-489c-858e-1eb0c84bcd51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:54.209799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ecacd-3511-489c-858e-1eb0c84bcd51 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:54.215312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 580/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:08:54 2022] GET /identity/v3/role_assignments?user.id=ee08911ae1fe463e9fd5d52d900e574e&scope.project.id=ab0ae5e6f3ad4500b2f814ba0883bc31&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:08:56.343458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c1793-46ae-4b7d-abd9-90249f05f51b None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:56.344026 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c1793-46ae-4b7d-abd9-90249f05f51b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:56.344026 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c1793-46ae-4b7d-abd9-90249f05f51b None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:56.345343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 582/1162] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:56.350614 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812202a-b1ee-44b0-ba72-5f3be484e9c2 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:56.351070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812202a-b1ee-44b0-ba72-5f3be484e9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:56.351205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812202a-b1ee-44b0-ba72-5f3be484e9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:56.369000 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e812202a-b1ee-44b0-ba72-5f3be484e9c2 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:56.370172 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e812202a-b1ee-44b0-ba72-5f3be484e9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:56.434914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 581/1163] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:56.710465 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c1793-46ae-4b7d-abd9-90249f05f51b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:56.780037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:56.813287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c1793-46ae-4b7d-abd9-90249f05f51b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:56.846207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc90839-bbff-4bb0-b1f0-5f67be5c1350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:56.846832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc90839-bbff-4bb0-b1f0-5f67be5c1350 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:56.847126 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc90839-bbff-4bb0-b1f0-5f67be5c1350 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:56.847910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc90839-bbff-4bb0-b1f0-5f67be5c1350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:56.912786 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc90839-bbff-4bb0-b1f0-5f67be5c1350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:56.914242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc90839-bbff-4bb0-b1f0-5f67be5c1350 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:56.979289 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:57.009244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 583/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:08:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:08:57.015265 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812202a-b1ee-44b0-ba72-5f3be484e9c2 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:57.055153 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:57.110142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812202a-b1ee-44b0-ba72-5f3be484e9c2 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:57.142499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d5d57-de8e-4ce8-9e12-d0fed67c714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:57.143139 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d5d57-de8e-4ce8-9e12-d0fed67c714f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:57.143421 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d5d57-de8e-4ce8-9e12-d0fed67c714f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:57.143702 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d5d57-de8e-4ce8-9e12-d0fed67c714f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:57.150174 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d5d57-de8e-4ce8-9e12-d0fed67c714f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:57.151678 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d5d57-de8e-4ce8-9e12-d0fed67c714f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:57.163434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-804d5d57-de8e-4ce8-9e12-d0fed67c714f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 27 04:08:57.163434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:57.163434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 27 04:08:57.163434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 27 04:08:57.163434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:08:57.163434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:08:57.163434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:08:57.163434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:08:57.163434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 27 04:08:57.163434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:57.163434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:08:57.163434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:57.163434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:08:57.163434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:08:57.163434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:08:57.163434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:08:57.163434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:08:57.168602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:08:57.168602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:08:57.168602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:08:57.168602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:08:57.168602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:08:57.168602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:08:57.168602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:08:57.168602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:08:57.168602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:08:57.168602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:08:57.168602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:08:57.168602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:08:57.168602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:08:57.168602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:08:57.168602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:08:57.168602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:08:57.169740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:08:57.169740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:08:57.169740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:08:57.169740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:08:57.169740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:08:57.169740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:08:57.169740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:08:57.169740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:08:57.169740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:08:57.169740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:08:57.169740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 27 04:08:57.169740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:08:57.169740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 27 04:08:57.169740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:08:57.169740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 582/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 27 04:08:57 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:08:57.170844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc90839-bbff-4bb0-b1f0-5f67be5c1350 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:57.265778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc90839-bbff-4bb0-b1f0-5f67be5c1350 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:57.298879 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e2b84-d689-476a-bc8f-680be951cd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:57.299474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e2b84-d689-476a-bc8f-680be951cd9c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:57.299761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e2b84-d689-476a-bc8f-680be951cd9c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:57.300042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e2b84-d689-476a-bc8f-680be951cd9c None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:57.300715 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e2b84-d689-476a-bc8f-680be951cd9c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:08:57.301025 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e2b84-d689-476a-bc8f-680be951cd9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:57.302394 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e2b84-d689-476a-bc8f-680be951cd9c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:57.309319 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 584/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 27 04:08:57 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:08:59.419633 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456187a-0e0f-49b4-bd93-60d91d513895 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:59.420513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456187a-0e0f-49b4-bd93-60d91d513895 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:59.420513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456187a-0e0f-49b4-bd93-60d91d513895 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:59.421484 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 583/1167] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:08:59.426868 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f753474-22d2-4caf-89de-bb0adbafdee9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:59.427270 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f753474-22d2-4caf-89de-bb0adbafdee9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:59.427439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f753474-22d2-4caf-89de-bb0adbafdee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:59.446330 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-7f753474-22d2-4caf-89de-bb0adbafdee9 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:08:59.447565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7f753474-22d2-4caf-89de-bb0adbafdee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:08:59.480620 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:59.518953 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 585/1168] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:08:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:08:59.791306 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456187a-0e0f-49b4-bd93-60d91d513895 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:08:59.885975 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:08:59.890089 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456187a-0e0f-49b4-bd93-60d91d513895 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:08:59.922514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489b7c2-2b52-4baf-ab93-a430f4f8c8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:08:59.923131 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489b7c2-2b52-4baf-ab93-a430f4f8c8d5 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:08:59.923415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489b7c2-2b52-4baf-ab93-a430f4f8c8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:08:59.923692 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489b7c2-2b52-4baf-ab93-a430f4f8c8d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:08:59.924369 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489b7c2-2b52-4baf-ab93-a430f4f8c8d5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:08:59.926315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489b7c2-2b52-4baf-ab93-a430f4f8c8d5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:08:59.941617 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 584/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Tue Sep 27 04:08:59 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:09:02.095884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4b67b-bac3-4a41-bf16-3487a42a2b89 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:02.096431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4b67b-bac3-4a41-bf16-3487a42a2b89 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:02.096431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4b67b-bac3-4a41-bf16-3487a42a2b89 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:02.098305 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 586/1170] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:09:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:09:02.103679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d67dc-a75b-4d4a-a16b-0cf76c164381 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:02.104068 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d67dc-a75b-4d4a-a16b-0cf76c164381 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:02.104224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d67dc-a75b-4d4a-a16b-0cf76c164381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:02.122541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-401d67dc-a75b-4d4a-a16b-0cf76c164381 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:09:02.123741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-401d67dc-a75b-4d4a-a16b-0cf76c164381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:09:02.186864 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 585/1171] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:09:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:09:02.450368 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4b67b-bac3-4a41-bf16-3487a42a2b89 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:02.548815 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4b67b-bac3-4a41-bf16-3487a42a2b89 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:02.580889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c9778-2641-481f-9579-89fa4cf9dc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:02.581499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c9778-2641-481f-9579-89fa4cf9dc0a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:02.582303 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c9778-2641-481f-9579-89fa4cf9dc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:02.582579 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c9778-2641-481f-9579-89fa4cf9dc0a None admin] PATH_INFO: `/v3/domains/6214cd69c8444186ba7fc415f5e56a8f` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:02.592641 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c9778-2641-481f-9579-89fa4cf9dc0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=6214cd69c8444186ba7fc415f5e56a8f)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:09:02.594084 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c9778-2641-481f-9579-89fa4cf9dc0a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:09:02.595683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 587/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Tue Sep 27 04:09:02 2022] GET /identity/v3/domains/6214cd69c8444186ba7fc415f5e56a8f => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:09:02.601968 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d67dc-a75b-4d4a-a16b-0cf76c164381 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:02.686890 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:09:02.697691 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d67dc-a75b-4d4a-a16b-0cf76c164381 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:02.729286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956bb8e-a19a-454a-b188-025acb1c60ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:02.730129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956bb8e-a19a-454a-b188-025acb1c60ec None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:02.730406 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956bb8e-a19a-454a-b188-025acb1c60ec None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:02.730678 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956bb8e-a19a-454a-b188-025acb1c60ec None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:02.731348 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956bb8e-a19a-454a-b188-025acb1c60ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:09:02.732762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956bb8e-a19a-454a-b188-025acb1c60ec None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:09:02.759680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 586/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 27 04:09:02 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:09:04.923310 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb80b16-5305-48b9-baff-9cbacc00dbe3 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:04.923881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb80b16-5305-48b9-baff-9cbacc00dbe3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:04.923881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb80b16-5305-48b9-baff-9cbacc00dbe3 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:04.925182 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 588/1174] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:09:04.930310 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea549f2-b2ca-4f86-99f9-ef95b16ae7b2 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:04.930679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea549f2-b2ca-4f86-99f9-ef95b16ae7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:04.930894 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea549f2-b2ca-4f86-99f9-ef95b16ae7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:04.948460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-fea549f2-b2ca-4f86-99f9-ef95b16ae7b2 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:09:04.949623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fea549f2-b2ca-4f86-99f9-ef95b16ae7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:09:05.012703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 587/1175] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:09:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:09:05.287115 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb80b16-5305-48b9-baff-9cbacc00dbe3 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:05.313892 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:09:05.393364 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb80b16-5305-48b9-baff-9cbacc00dbe3 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:05.427234 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ea0ed-2923-435c-9b52-154a28e4f7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:05.427859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ea0ed-2923-435c-9b52-154a28e4f7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:05.428145 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ea0ed-2923-435c-9b52-154a28e4f7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:05.428424 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ea0ed-2923-435c-9b52-154a28e4f7d3 None admin] PATH_INFO: `/v3/domains/6214cd69c8444186ba7fc415f5e56a8f` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:05.429545 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ea0ed-2923-435c-9b52-154a28e4f7d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6214cd69c8444186ba7fc415f5e56a8f)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:09:05.431001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ea0ed-2923-435c-9b52-154a28e4f7d3 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:09:05.432569 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 589/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Tue Sep 27 04:09:05 2022] GET /identity/v3/domains/6214cd69c8444186ba7fc415f5e56a8f => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:09:05.438218 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea549f2-b2ca-4f86-99f9-ef95b16ae7b2 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:05.505243 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:09:05.533299 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea549f2-b2ca-4f86-99f9-ef95b16ae7b2 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:05.565527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71939581-6846-4bf9-b54d-da0e5fe589c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:05.566663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71939581-6846-4bf9-b54d-da0e5fe589c0 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:05.566975 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71939581-6846-4bf9-b54d-da0e5fe589c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:05.567253 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71939581-6846-4bf9-b54d-da0e5fe589c0 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:05.567899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71939581-6846-4bf9-b54d-da0e5fe589c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:09:05.569323 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71939581-6846-4bf9-b54d-da0e5fe589c0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:09:05.589378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 588/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 27 04:09:05 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:09:07.729307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48b963-84c0-429b-bc52-058c2daea5fe None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:07.730082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48b963-84c0-429b-bc52-058c2daea5fe None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:07.730082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48b963-84c0-429b-bc52-058c2daea5fe None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:07.731580 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 590/1178] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:09:07.736676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e3469-7358-4ac2-aa55-11a5bda24e4f None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:07.737098 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e3469-7358-4ac2-aa55-11a5bda24e4f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:07.737229 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e3469-7358-4ac2-aa55-11a5bda24e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:07.754975 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-090e3469-7358-4ac2-aa55-11a5bda24e4f None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:09:07.756155 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-090e3469-7358-4ac2-aa55-11a5bda24e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:09:07.819453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 589/1179] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:09:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:09:08.092076 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48b963-84c0-429b-bc52-058c2daea5fe None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:08.185013 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:09:08.193162 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48b963-84c0-429b-bc52-058c2daea5fe None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:08.225821 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68305cb7-a18e-40bb-8e06-87e254a330f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:08.226430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68305cb7-a18e-40bb-8e06-87e254a330f6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:08.226711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68305cb7-a18e-40bb-8e06-87e254a330f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:08.227011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68305cb7-a18e-40bb-8e06-87e254a330f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:08.236968 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68305cb7-a18e-40bb-8e06-87e254a330f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:09:08.241728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-68305cb7-a18e-40bb-8e06-87e254a330f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:09:08.241728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:09:08.241728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:09:08.241728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:09:08.241728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:09:08.241728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:09:08.241728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:09:08.241728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:09:08.241728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:09:08.241728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:09:08.241728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:09:08.241728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:09:08.241728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:09:08.241728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:09:08.241728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:09:08.241728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:09:08.242848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:09:08.242848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:09:08.242848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:09:08.242848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:09:08.242848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:09:08.242848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:09:08.242848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:09:08.242848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:09:08.242848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:09:08.242848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:09:08.242848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:09:08.242848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:09:08.242848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:09:08.242848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:09:08.242848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:09:08.242848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:09:08.243891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:09:08.243891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:09:08.243891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:09:08.243891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:09:08.243891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:09:08.243891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:09:08.243891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:09:08.243891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:09:08.243891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:09:08.243891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:09:08.243891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:09:08.243891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:09:08.243891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 591/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:09:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:09:08.249841 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e3469-7358-4ac2-aa55-11a5bda24e4f None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:08.305272 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:09:08.346268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e3469-7358-4ac2-aa55-11a5bda24e4f None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:08.377878 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720721f-a49c-45ff-9efc-4526e7f0b83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:08.378988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720721f-a49c-45ff-9efc-4526e7f0b83b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:08.379269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720721f-a49c-45ff-9efc-4526e7f0b83b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:08.379537 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720721f-a49c-45ff-9efc-4526e7f0b83b None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:08.380189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720721f-a49c-45ff-9efc-4526e7f0b83b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:09:08.380506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720721f-a49c-45ff-9efc-4526e7f0b83b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:09:08.381833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720721f-a49c-45ff-9efc-4526e7f0b83b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:09:08.389423 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 590/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:09:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:09:08.395845 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68305cb7-a18e-40bb-8e06-87e254a330f6 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:08.490854 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68305cb7-a18e-40bb-8e06-87e254a330f6 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:08.523162 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab702b-4f08-42ad-a76f-78969d268b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:08.523771 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab702b-4f08-42ad-a76f-78969d268b63 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:08.524051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab702b-4f08-42ad-a76f-78969d268b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:08.524327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab702b-4f08-42ad-a76f-78969d268b63 None admin] PATH_INFO: `/v3/users/4515b18a61a044e8ad7807d09ead53f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:08.537281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab702b-4f08-42ad-a76f-78969d268b63 None admin] RBAC: Authorizing `identity:get_user(user_id=4515b18a61a044e8ad7807d09ead53f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:09:08.538725 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab702b-4f08-42ad-a76f-78969d268b63 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:09:08.540286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 592/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:09:08 2022] GET /identity/v3/users/4515b18a61a044e8ad7807d09ead53f2 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:09:08.546064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720721f-a49c-45ff-9efc-4526e7f0b83b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:08.642769 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720721f-a49c-45ff-9efc-4526e7f0b83b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:08.661419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:09:08.675111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cb755-2ad7-477d-a048-e1f0dc7f0818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:08.676252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cb755-2ad7-477d-a048-e1f0dc7f0818 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:08.676531 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cb755-2ad7-477d-a048-e1f0dc7f0818 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:08.676799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cb755-2ad7-477d-a048-e1f0dc7f0818 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:08.740943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cb755-2ad7-477d-a048-e1f0dc7f0818 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:09:08.742452 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cb755-2ad7-477d-a048-e1f0dc7f0818 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:09:08.834955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 591/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:09:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:09:08.840848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab702b-4f08-42ad-a76f-78969d268b63 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:08.855793 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:09:08.938478 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab702b-4f08-42ad-a76f-78969d268b63 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:08.970281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2831ae-81ca-440e-bcbd-f5ef374f884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:08.970926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2831ae-81ca-440e-bcbd-f5ef374f884b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:08.971209 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2831ae-81ca-440e-bcbd-f5ef374f884b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:08.971483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2831ae-81ca-440e-bcbd-f5ef374f884b None admin] PATH_INFO: `/v3/projects/6da21bf6090d42b99ac85ab81c428e1b` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:08.973094 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2831ae-81ca-440e-bcbd-f5ef374f884b None admin] RBAC: Authorizing `identity:get_project(project_id=6da21bf6090d42b99ac85ab81c428e1b)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:09:08.974527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2831ae-81ca-440e-bcbd-f5ef374f884b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:09:08.976162 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 593/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:09:08 2022] GET /identity/v3/projects/6da21bf6090d42b99ac85ab81c428e1b => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:09:08.982620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cb755-2ad7-477d-a048-e1f0dc7f0818 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:09.003511 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:09:09.077546 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cb755-2ad7-477d-a048-e1f0dc7f0818 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:09.110078 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688019f-1922-4293-ab2a-2f27b8fdba89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:09.110681 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688019f-1922-4293-ab2a-2f27b8fdba89 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:09.110991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688019f-1922-4293-ab2a-2f27b8fdba89 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:09.111266 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688019f-1922-4293-ab2a-2f27b8fdba89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:09.111990 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688019f-1922-4293-ab2a-2f27b8fdba89 None admin] RBAC: Adding query filter params (role.id=2613cf4a98d44744a094c7782b19b4b5, scope.project.id=6da21bf6090d42b99ac85ab81c428e1b, user.id=4515b18a61a044e8ad7807d09ead53f2) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:09:09.112393 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688019f-1922-4293-ab2a-2f27b8fdba89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:09:09.114417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688019f-1922-4293-ab2a-2f27b8fdba89 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:09:09.119654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 592/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:09:08 2022] GET /identity/v3/role_assignments?user.id=4515b18a61a044e8ad7807d09ead53f2&scope.project.id=6da21bf6090d42b99ac85ab81c428e1b&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:09:11.205478 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d27118-de6f-4cde-9b36-8cf1eac86d60 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:11.206008 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d27118-de6f-4cde-9b36-8cf1eac86d60 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:11.206008 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d27118-de6f-4cde-9b36-8cf1eac86d60 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:11.207977 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 594/1186] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:09:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:09:11.213345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed5adc-162b-46ae-ad2d-524268814eaf None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:11.213758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed5adc-162b-46ae-ad2d-524268814eaf None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:11.213901 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed5adc-162b-46ae-ad2d-524268814eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:11.231830 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-baed5adc-162b-46ae-ad2d-524268814eaf None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:09:11.233002 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-baed5adc-162b-46ae-ad2d-524268814eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:09:11.296879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 593/1187] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:09:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:09:11.561381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d27118-de6f-4cde-9b36-8cf1eac86d60 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:11.640132 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:09:11.659535 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d27118-de6f-4cde-9b36-8cf1eac86d60 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:11.692700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf7289-c84b-4280-a941-08af51d75cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:11.693312 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf7289-c84b-4280-a941-08af51d75cda None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:11.693595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf7289-c84b-4280-a941-08af51d75cda None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:11.693872 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf7289-c84b-4280-a941-08af51d75cda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:11.703652 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf7289-c84b-4280-a941-08af51d75cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:09:11.708410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-1aaf7289-c84b-4280-a941-08af51d75cda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:09:11.708410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:09:11.708410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:09:11.708410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:09:11.708410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:09:11.708410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:09:11.708410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:09:11.708410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:09:11.708410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:09:11.708410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:09:11.708410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:09:11.708410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:09:11.708410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:09:11.708410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:09:11.708410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:09:11.708410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:09:11.709314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:09:11.709314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:09:11.709314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:09:11.709314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:09:11.709314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:09:11.709314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:09:11.709314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:09:11.709314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:09:11.709314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:09:11.709314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:09:11.709314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:09:11.709314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:09:11.709314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:09:11.709314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:09:11.709314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:09:11.709314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:09:11.710343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:09:11.710343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:09:11.710343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:09:11.710343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:09:11.710343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:09:11.710343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:09:11.710343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:09:11.710343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:09:11.710343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:09:11.710343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:09:11.710343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:09:11.710343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:09:11.710343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 595/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:09:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:09:11.715365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed5adc-162b-46ae-ad2d-524268814eaf None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:11.729983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:09:11.819046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed5adc-162b-46ae-ad2d-524268814eaf None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:11.851173 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c5a4e-c72c-41e4-ac17-84f72865fb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:11.851767 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c5a4e-c72c-41e4-ac17-84f72865fb06 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:11.852052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c5a4e-c72c-41e4-ac17-84f72865fb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:11.852329 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c5a4e-c72c-41e4-ac17-84f72865fb06 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:11.852992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c5a4e-c72c-41e4-ac17-84f72865fb06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:09:11.853298 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c5a4e-c72c-41e4-ac17-84f72865fb06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:09:11.854659 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c5a4e-c72c-41e4-ac17-84f72865fb06 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:09:11.862620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 594/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:09:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:09:11.869068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf7289-c84b-4280-a941-08af51d75cda None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:11.965106 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf7289-c84b-4280-a941-08af51d75cda None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:11.998389 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6f7c1-915f-4833-bde6-0418df335c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:11.999025 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6f7c1-915f-4833-bde6-0418df335c5a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:11.999308 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6f7c1-915f-4833-bde6-0418df335c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:11.999581 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6f7c1-915f-4833-bde6-0418df335c5a None admin] PATH_INFO: `/v3/users/4515b18a61a044e8ad7807d09ead53f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:12.000678 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6f7c1-915f-4833-bde6-0418df335c5a None admin] RBAC: Authorizing `identity:get_user(user_id=4515b18a61a044e8ad7807d09ead53f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:09:12.002103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6f7c1-915f-4833-bde6-0418df335c5a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:09:12.003704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 596/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:09:11 2022] GET /identity/v3/users/4515b18a61a044e8ad7807d09ead53f2 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:09:12.009371 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c5a4e-c72c-41e4-ac17-84f72865fb06 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:12.092519 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:09:12.116053 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c5a4e-c72c-41e4-ac17-84f72865fb06 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:12.148014 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193b1a5-aac9-48b4-9d64-fa455b0ef553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:12.148635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193b1a5-aac9-48b4-9d64-fa455b0ef553 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:12.148913 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193b1a5-aac9-48b4-9d64-fa455b0ef553 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:12.149185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193b1a5-aac9-48b4-9d64-fa455b0ef553 None admin] PATH_INFO: `/v3/projects/6da21bf6090d42b99ac85ab81c428e1b` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:12.150298 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193b1a5-aac9-48b4-9d64-fa455b0ef553 None admin] RBAC: Authorizing `identity:get_project(project_id=6da21bf6090d42b99ac85ab81c428e1b)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:09:12.151748 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193b1a5-aac9-48b4-9d64-fa455b0ef553 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:09:12.153347 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 595/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:09:12 2022] GET /identity/v3/projects/6da21bf6090d42b99ac85ab81c428e1b => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:09:12.159456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6f7c1-915f-4833-bde6-0418df335c5a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:12.170936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:09:12.257046 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6f7c1-915f-4833-bde6-0418df335c5a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:12.290693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707a653-1aa9-4771-973b-7997a8488c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:12.291361 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707a653-1aa9-4771-973b-7997a8488c2e None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:12.291645 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707a653-1aa9-4771-973b-7997a8488c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:12.291924 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707a653-1aa9-4771-973b-7997a8488c2e None admin] PATH_INFO: `/v3/projects/6da21bf6090d42b99ac85ab81c428e1b/users/4515b18a61a044e8ad7807d09ead53f2/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:12.293798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707a653-1aa9-4771-973b-7997a8488c2e None admin] RBAC: Authorizing `identity:create_grant(project_id=6da21bf6090d42b99ac85ab81c428e1b, user_id=4515b18a61a044e8ad7807d09ead53f2, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:09:12.295266 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707a653-1aa9-4771-973b-7997a8488c2e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:09:12.309170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 597/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:09:12 2022] PUT /identity/v3/projects/6da21bf6090d42b99ac85ab81c428e1b/users/4515b18a61a044e8ad7807d09ead53f2/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:09:14.391021 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a416bf7-e92b-40c0-a485-12b755f6cca9 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:14.391550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a416bf7-e92b-40c0-a485-12b755f6cca9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:14.391550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a416bf7-e92b-40c0-a485-12b755f6cca9 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:14.392865 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 596/1193] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:09:14.398673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b6477-22c3-4db5-a5b9-37c8569b0820 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:14.399148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b6477-22c3-4db5-a5b9-37c8569b0820 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:14.399307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b6477-22c3-4db5-a5b9-37c8569b0820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:14.417585 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-198b6477-22c3-4db5-a5b9-37c8569b0820 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:09:14.418829 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-198b6477-22c3-4db5-a5b9-37c8569b0820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:09:14.478365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:09:14.484972 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 598/1194] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:09:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:09:14.751202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a416bf7-e92b-40c0-a485-12b755f6cca9 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:14.846271 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a416bf7-e92b-40c0-a485-12b755f6cca9 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:14.878940 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55ec81-5c88-4121-8388-376f3467dfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:14.879547 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55ec81-5c88-4121-8388-376f3467dfaa None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:14.879827 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55ec81-5c88-4121-8388-376f3467dfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:14.880099 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55ec81-5c88-4121-8388-376f3467dfaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:14.889615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55ec81-5c88-4121-8388-376f3467dfaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:09:14.895118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-3d55ec81-5c88-4121-8388-376f3467dfaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:09:14.895118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:09:14.895118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:09:14.895118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:09:14.895118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:09:14.895118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:09:14.895118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:09:14.895118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:09:14.895118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:09:14.895118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:09:14.895118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:09:14.895118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:09:14.895118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:09:14.895118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:09:14.895118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:09:14.895118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:09:14.897126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:09:14.897126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:09:14.897126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:09:14.897126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:09:14.897126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:09:14.897126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:09:14.897126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:09:14.897126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:09:14.897126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:09:14.897126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:09:14.897126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:09:14.897126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:09:14.897126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:09:14.897126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:09:14.897126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:09:14.897126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:09:14.898914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:09:14.898914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:09:14.898914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:09:14.898914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:09:14.898914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:09:14.898914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:09:14.898914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:09:14.898914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:09:14.898914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:09:14.898914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:09:14.898914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:09:14.898914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:09:14.898914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 597/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:09:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:09:14.903306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b6477-22c3-4db5-a5b9-37c8569b0820 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:14.997303 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b6477-22c3-4db5-a5b9-37c8569b0820 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:15.030398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207fb75-63e8-42bb-8a6f-40f923bd7253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:15.030964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207fb75-63e8-42bb-8a6f-40f923bd7253 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:15.031246 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207fb75-63e8-42bb-8a6f-40f923bd7253 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:15.031519 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207fb75-63e8-42bb-8a6f-40f923bd7253 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:15.032185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207fb75-63e8-42bb-8a6f-40f923bd7253 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:09:15.032486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207fb75-63e8-42bb-8a6f-40f923bd7253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:09:15.033855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207fb75-63e8-42bb-8a6f-40f923bd7253 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:09:15.041589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 599/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:09:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:09:15.047407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55ec81-5c88-4121-8388-376f3467dfaa None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:15.051763 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:09:15.143527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55ec81-5c88-4121-8388-376f3467dfaa None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:15.175751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85407-5cd0-4131-9608-63bd5f164025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:15.176363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85407-5cd0-4131-9608-63bd5f164025 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:15.176645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85407-5cd0-4131-9608-63bd5f164025 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:15.176919 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85407-5cd0-4131-9608-63bd5f164025 None admin] PATH_INFO: `/v3/users/4515b18a61a044e8ad7807d09ead53f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:15.178035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf85407-5cd0-4131-9608-63bd5f164025 None admin] RBAC: Authorizing `identity:get_user(user_id=4515b18a61a044e8ad7807d09ead53f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:09:15.179491 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf85407-5cd0-4131-9608-63bd5f164025 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:09:15.181017 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 598/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 27 04:09:15 2022] GET /identity/v3/users/4515b18a61a044e8ad7807d09ead53f2 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:09:15.186606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207fb75-63e8-42bb-8a6f-40f923bd7253 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:15.244746 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:09:15.284123 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207fb75-63e8-42bb-8a6f-40f923bd7253 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:15.316907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598d417-d412-4392-863d-698df47b75fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:15.317512 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598d417-d412-4392-863d-698df47b75fc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:15.317800 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598d417-d412-4392-863d-698df47b75fc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:15.318078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598d417-d412-4392-863d-698df47b75fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:15.382091 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598d417-d412-4392-863d-698df47b75fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:09:15.383562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598d417-d412-4392-863d-698df47b75fc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:09:15.437632 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:09:15.477519 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 600/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:09:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:09:15.483740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85407-5cd0-4131-9608-63bd5f164025 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:15.549883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:09:15.579154 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85407-5cd0-4131-9608-63bd5f164025 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:15.611150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4736a-4c0b-4815-af3c-48657097535f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:15.611769 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4736a-4c0b-4815-af3c-48657097535f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:15.612050 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4736a-4c0b-4815-af3c-48657097535f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:15.612326 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4736a-4c0b-4815-af3c-48657097535f None admin] PATH_INFO: `/v3/projects/6da21bf6090d42b99ac85ab81c428e1b` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:15.614038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4736a-4c0b-4815-af3c-48657097535f None admin] RBAC: Authorizing `identity:get_project(project_id=6da21bf6090d42b99ac85ab81c428e1b)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:09:15.615487 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4736a-4c0b-4815-af3c-48657097535f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:09:15.617079 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 599/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 27 04:09:15 2022] GET /identity/v3/projects/6da21bf6090d42b99ac85ab81c428e1b => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:09:15.623097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598d417-d412-4392-863d-698df47b75fc None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:09:15.716207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598d417-d412-4392-863d-698df47b75fc None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:09:15.749675 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23703fb-8178-4b52-8e46-fb24dd94918a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:09:15.750265 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23703fb-8178-4b52-8e46-fb24dd94918a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:09:15.750547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23703fb-8178-4b52-8e46-fb24dd94918a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:09:15.750854 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23703fb-8178-4b52-8e46-fb24dd94918a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:09:15.751575 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23703fb-8178-4b52-8e46-fb24dd94918a None admin] RBAC: Adding query filter params (role.id=2613cf4a98d44744a094c7782b19b4b5, scope.project.id=6da21bf6090d42b99ac85ab81c428e1b, user.id=4515b18a61a044e8ad7807d09ead53f2) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:09:15.751888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23703fb-8178-4b52-8e46-fb24dd94918a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:09:15.753313 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23703fb-8178-4b52-8e46-fb24dd94918a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:09:15.758840 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 601/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:09:15 2022] GET /identity/v3/role_assignments?user.id=4515b18a61a044e8ad7807d09ead53f2&scope.project.id=6da21bf6090d42b99ac85ab81c428e1b&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:09:25.607176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=30 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:09:25.756349 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=88 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:11.474568 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2dce3-136b-40cb-834e-82aefbb952d3 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:11.475199 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2dce3-136b-40cb-834e-82aefbb952d3 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:11.475199 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2dce3-136b-40cb-834e-82aefbb952d3 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:11.476479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 600/1201] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:10:11.482516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5857e7-134e-459e-b0fe-6cd509e39acf None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:11.483014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5857e7-134e-459e-b0fe-6cd509e39acf None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:11.483186 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5857e7-134e-459e-b0fe-6cd509e39acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:11.507536 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-7b5857e7-134e-459e-b0fe-6cd509e39acf None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:10:11.509324 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7b5857e7-134e-459e-b0fe-6cd509e39acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:10:11.596535 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 602/1202] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:10:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:10:11.894459 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2dce3-136b-40cb-834e-82aefbb952d3 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:12.025494 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2dce3-136b-40cb-834e-82aefbb952d3 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:12.066556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc647b-ade9-4236-99bf-f7f097d2e44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:12.066556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc647b-ade9-4236-99bf-f7f097d2e44c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:12.066556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc647b-ade9-4236-99bf-f7f097d2e44c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:12.066960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc647b-ade9-4236-99bf-f7f097d2e44c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:12.080270 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc647b-ade9-4236-99bf-f7f097d2e44c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:12.081993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc647b-ade9-4236-99bf-f7f097d2e44c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:12.102540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-fdcc647b-ade9-4236-99bf-f7f097d2e44c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:12.102540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:12.102540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:12.102540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:12.102540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:12.102540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:12.102540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:12.102540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:12.102540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:12.102540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:12.102540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:12.102540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:12.102540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:10:12.102540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:10:12.102540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:10:12.102540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:10:12.103925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:12.103925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:12.103925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:12.103925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:12.103925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:12.103925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:12.103925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:12.103925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:12.103925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:12.103925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:12.103925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:12.103925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:12.103925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:12.103925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:12.103925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:12.103925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:12.103925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:10:12.105302 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:10:12.105302 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:12.105302 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:10:12.105302 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 601/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:12.111223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5857e7-134e-459e-b0fe-6cd509e39acf None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:12.247607 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5857e7-134e-459e-b0fe-6cd509e39acf None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:12.287692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:12.295541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec5c81-7119-407f-95a9-824892c7f180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:12.296310 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec5c81-7119-407f-95a9-824892c7f180 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:12.296601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec5c81-7119-407f-95a9-824892c7f180 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:12.296882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec5c81-7119-407f-95a9-824892c7f180 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:12.300760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec5c81-7119-407f-95a9-824892c7f180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:12.300760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec5c81-7119-407f-95a9-824892c7f180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:12.300760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec5c81-7119-407f-95a9-824892c7f180 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:12.322698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 603/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:10:12.329290 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc647b-ade9-4236-99bf-f7f097d2e44c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:12.411685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:12.479095 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc647b-ade9-4236-99bf-f7f097d2e44c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:12.526240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf25ff-60b9-4c3b-885c-a97d774c1926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:12.527194 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf25ff-60b9-4c3b-885c-a97d774c1926 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:12.527705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf25ff-60b9-4c3b-885c-a97d774c1926 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:12.528160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf25ff-60b9-4c3b-885c-a97d774c1926 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:12.528981 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf25ff-60b9-4c3b-885c-a97d774c1926 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:12.530676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf25ff-60b9-4c3b-885c-a97d774c1926 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:12.556002 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 602/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 27 04:10:12 2022] POST /identity/v3/users => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:10:15.101440 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aff913-d9b4-4e65-934f-c947aaeddfff None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:15.102116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aff913-d9b4-4e65-934f-c947aaeddfff None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:15.102116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aff913-d9b4-4e65-934f-c947aaeddfff None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:15.103782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 604/1206] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:10:15.109882 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ef315-f0d2-4340-b9a5-4b6ce1537bfd None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:15.110361 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ef315-f0d2-4340-b9a5-4b6ce1537bfd None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:15.112847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ef315-f0d2-4340-b9a5-4b6ce1537bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:15.133946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0a8ef315-f0d2-4340-b9a5-4b6ce1537bfd None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:10:15.135914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0a8ef315-f0d2-4340-b9a5-4b6ce1537bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:10:15.234755 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 603/1207] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:10:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:10:15.494059 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aff913-d9b4-4e65-934f-c947aaeddfff None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:15.621870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aff913-d9b4-4e65-934f-c947aaeddfff None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:15.663912 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35cf22-a233-43de-ba48-6811121a09d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:15.664674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35cf22-a233-43de-ba48-6811121a09d5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:15.664957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35cf22-a233-43de-ba48-6811121a09d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:15.665228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35cf22-a233-43de-ba48-6811121a09d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:15.677958 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35cf22-a233-43de-ba48-6811121a09d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:10:15.683549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-db35cf22-a233-43de-ba48-6811121a09d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:10:15.683549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:15.683549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:15.683549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:15.683549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:15.683549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:15.683549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:15.683549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:15.683549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:15.683549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:15.683549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:15.683549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:15.683549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:10:15.683549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:10:15.683549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:10:15.683549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:10:15.684726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:10:15.684726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:10:15.684726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:10:15.684726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:10:15.684726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:15.684726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:15.684726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:15.684726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:15.684726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:15.684726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:15.684726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:15.684726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:15.684726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:15.684726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:15.684726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:15.684726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:15.685762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:15.685762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:15.685762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:15.685762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:15.685762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:10:15.685762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:10:15.685762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:10:15.685762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:10:15.685762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:10:15.685762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:10:15.685762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:10:15.685762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:15.688043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 605/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:10:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:15.694691 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ef315-f0d2-4340-b9a5-4b6ce1537bfd None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:15.742096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:15.817416 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ef315-f0d2-4340-b9a5-4b6ce1537bfd None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:15.859175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d96c3-3b61-43b2-a3b1-d0ec7df559a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:15.859786 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d96c3-3b61-43b2-a3b1-d0ec7df559a8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:15.860068 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d96c3-3b61-43b2-a3b1-d0ec7df559a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:15.860358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d96c3-3b61-43b2-a3b1-d0ec7df559a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:15.861014 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d96c3-3b61-43b2-a3b1-d0ec7df559a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:15.861349 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d96c3-3b61-43b2-a3b1-d0ec7df559a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:15.862869 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d96c3-3b61-43b2-a3b1-d0ec7df559a8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:15.872739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 604/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:10:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:15.878454 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35cf22-a233-43de-ba48-6811121a09d5 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:15.935474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:15.997165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35cf22-a233-43de-ba48-6811121a09d5 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:16.042993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af5cd6-0024-4d11-8670-87db731a4a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:16.043618 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af5cd6-0024-4d11-8670-87db731a4a5c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:16.043975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af5cd6-0024-4d11-8670-87db731a4a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:16.044217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af5cd6-0024-4d11-8670-87db731a4a5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:16.055724 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af5cd6-0024-4d11-8670-87db731a4a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:16.057231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af5cd6-0024-4d11-8670-87db731a4a5c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:16.075230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-f5af5cd6-0024-4d11-8670-87db731a4a5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:16.075230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:16.075230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:16.075230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:16.075230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:16.075230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:16.075230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:16.075230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:16.075230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:16.075230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:16.075230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:16.075230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:16.075230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:10:16.075230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:10:16.075230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:10:16.075230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:10:16.076476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:16.076476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:16.076476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:16.076476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:16.076476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:16.076476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:16.076476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:16.076476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:16.076476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:16.076476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:16.076476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:16.076476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:16.076476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:16.076476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:16.076476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:16.076476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:16.076476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:10:16.077589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:10:16.077589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:16.077589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:16.078905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 606/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:10:16.082404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d96c3-3b61-43b2-a3b1-d0ec7df559a8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:16.197275 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:16.200683 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d96c3-3b61-43b2-a3b1-d0ec7df559a8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:16.238462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780019e-b9b3-407d-a755-0c8c393d2329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:16.239290 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780019e-b9b3-407d-a755-0c8c393d2329 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:16.241245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780019e-b9b3-407d-a755-0c8c393d2329 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:16.241245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780019e-b9b3-407d-a755-0c8c393d2329 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:16.241245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780019e-b9b3-407d-a755-0c8c393d2329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:16.241245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780019e-b9b3-407d-a755-0c8c393d2329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:16.242918 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780019e-b9b3-407d-a755-0c8c393d2329 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:16.257582 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 605/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:10:16.263350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af5cd6-0024-4d11-8670-87db731a4a5c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:16.379050 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af5cd6-0024-4d11-8670-87db731a4a5c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:16.381019 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:16.422326 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8c8e0-91ba-467b-b9a2-c9f6e94fb5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:16.423122 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8c8e0-91ba-467b-b9a2-c9f6e94fb5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:16.425123 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8c8e0-91ba-467b-b9a2-c9f6e94fb5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:16.425123 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8c8e0-91ba-467b-b9a2-c9f6e94fb5b9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:16.434288 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8c8e0-91ba-467b-b9a2-c9f6e94fb5b9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:16.436009 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8c8e0-91ba-467b-b9a2-c9f6e94fb5b9 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:16.451936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-34e8c8e0-91ba-467b-b9a2-c9f6e94fb5b9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 04:10:16.451936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:16.451936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:16.451936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:16.451936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:16.451936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:16.451936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:16.451936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:16.451936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:16.451936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:16.451936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:16.451936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:16.451936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:10:16.451936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:10:16.451936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:10:16.451936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:10:16.453107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:16.453107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:16.453107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:10:16.453107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:10:16.453107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:10:16.453107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:10:16.453107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:16.453107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:16.453107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:16.453107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:16.453107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:16.453107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:16.453107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:16.453107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:16.453107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:16.453107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:16.453107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:16.453107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:16.454346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:16.454346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:16.454346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:10:16.454346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:10:16.454346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:10:16.454346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:10:16.454346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:10:16.454346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:10:16.454346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 04:10:16.454346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:16.454346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 607/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:10:16.461293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780019e-b9b3-407d-a755-0c8c393d2329 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:16.572340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780019e-b9b3-407d-a755-0c8c393d2329 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:16.608265 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8615e7-9712-4b88-9894-2b5a047a0886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:16.608858 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8615e7-9712-4b88-9894-2b5a047a0886 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:16.609142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8615e7-9712-4b88-9894-2b5a047a0886 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:16.609419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8615e7-9712-4b88-9894-2b5a047a0886 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:16.610153 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8615e7-9712-4b88-9894-2b5a047a0886 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:16.610505 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8615e7-9712-4b88-9894-2b5a047a0886 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:16.612954 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8615e7-9712-4b88-9894-2b5a047a0886 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:16.631868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 606/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Sep 27 04:10:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:10:16.637445 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8c8e0-91ba-467b-b9a2-c9f6e94fb5b9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:16.753675 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8c8e0-91ba-467b-b9a2-c9f6e94fb5b9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:16.795003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818f057-3c60-4e08-9a49-4985f94aa88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:16.795665 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818f057-3c60-4e08-9a49-4985f94aa88a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:16.795980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818f057-3c60-4e08-9a49-4985f94aa88a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:16.796305 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818f057-3c60-4e08-9a49-4985f94aa88a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:16.833438 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:16.879754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818f057-3c60-4e08-9a49-4985f94aa88a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:16.881248 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818f057-3c60-4e08-9a49-4985f94aa88a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:17.010906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 608/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:10:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 04:10:17.016635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8615e7-9712-4b88-9894-2b5a047a0886 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:17.036733 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:17.124126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8615e7-9712-4b88-9894-2b5a047a0886 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:17.177779 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90d75a-ecb8-4c21-a0df-f8dfebe63624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:17.178837 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90d75a-ecb8-4c21-a0df-f8dfebe63624 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:17.179315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90d75a-ecb8-4c21-a0df-f8dfebe63624 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:17.179785 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90d75a-ecb8-4c21-a0df-f8dfebe63624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:17.195098 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90d75a-ecb8-4c21-a0df-f8dfebe63624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:17.197137 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90d75a-ecb8-4c21-a0df-f8dfebe63624 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:17.216586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-dc90d75a-ecb8-4c21-a0df-f8dfebe63624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:17.216586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:17.216586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:17.216586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:17.216586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:17.216586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:17.216586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:17.216586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:17.216586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:17.216586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:17.216586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:17.216586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:17.216586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:10:17.216586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:10:17.216586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:10:17.216586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:10:17.218086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:17.218086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:17.218086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:17.218086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:17.218086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:17.218086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:17.218086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:17.218086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:17.218086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:17.218086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:17.218086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:17.218086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:17.218086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:17.218086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:17.218086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:17.218086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:17.218086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:10:17.219027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:10:17.219027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:17.219027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:10:17.219027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 607/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:17.224537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818f057-3c60-4e08-9a49-4985f94aa88a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:17.313695 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:17.366352 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818f057-3c60-4e08-9a49-4985f94aa88a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:17.408050 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dc638-3794-46d5-a76a-a0c7551104de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:17.409417 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dc638-3794-46d5-a76a-a0c7551104de None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:17.409735 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dc638-3794-46d5-a76a-a0c7551104de None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:17.410182 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dc638-3794-46d5-a76a-a0c7551104de None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:17.410926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dc638-3794-46d5-a76a-a0c7551104de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:17.411238 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dc638-3794-46d5-a76a-a0c7551104de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:17.412602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dc638-3794-46d5-a76a-a0c7551104de None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:17.427060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 609/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:17.434146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90d75a-ecb8-4c21-a0df-f8dfebe63624 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:17.523295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:17.559432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90d75a-ecb8-4c21-a0df-f8dfebe63624 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:17.596118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b58f35-8893-4492-8df1-5b71c76cb7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:17.596670 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b58f35-8893-4492-8df1-5b71c76cb7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:17.596950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b58f35-8893-4492-8df1-5b71c76cb7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:17.597228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b58f35-8893-4492-8df1-5b71c76cb7a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:17.605758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b58f35-8893-4492-8df1-5b71c76cb7a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:17.608147 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b58f35-8893-4492-8df1-5b71c76cb7a5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:17.622316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-34b58f35-8893-4492-8df1-5b71c76cb7a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:10:17.622316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:17.622316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:17.622316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:17.622316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:17.622316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:17.622316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:17.622316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:17.622316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:17.622316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:17.622316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:17.622316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:17.622316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:10:17.622316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:10:17.622316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:10:17.623366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:10:17.623366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:17.623366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:17.623366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:17.623366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:17.623366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:17.623366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:17.623366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:17.623366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:17.623366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:17.623366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:17.623366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:17.623366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:17.623366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:17.623366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:17.623366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:17.623366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:17.624635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:10:17.624635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:10:17.624635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:10:17.624635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:10:17.624635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:10:17.624635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:10:17.624635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:10:17.624635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:10:17.624635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 608/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:10:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:10:17.631555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dc638-3794-46d5-a76a-a0c7551104de None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:17.749798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dc638-3794-46d5-a76a-a0c7551104de None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:17.777433 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:17.798660 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f9227-8a77-4e3d-a5f0-6e66da953c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:17.799303 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f9227-8a77-4e3d-a5f0-6e66da953c3b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:17.799588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f9227-8a77-4e3d-a5f0-6e66da953c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:17.799864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f9227-8a77-4e3d-a5f0-6e66da953c3b None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:17.800561 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f9227-8a77-4e3d-a5f0-6e66da953c3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:17.800872 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f9227-8a77-4e3d-a5f0-6e66da953c3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:17.802302 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f9227-8a77-4e3d-a5f0-6e66da953c3b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:17.817170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 610/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:10:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:17.823541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b58f35-8893-4492-8df1-5b71c76cb7a5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:17.937921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b58f35-8893-4492-8df1-5b71c76cb7a5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:17.969251 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:17.979541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd835b-3b99-4045-8ed5-1b83b2086dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:17.980233 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd835b-3b99-4045-8ed5-1b83b2086dfc None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:17.980571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd835b-3b99-4045-8ed5-1b83b2086dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:17.980895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd835b-3b99-4045-8ed5-1b83b2086dfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:17.981906 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd835b-3b99-4045-8ed5-1b83b2086dfc None admin] RBAC: Adding query filter params (role.id=e62613bfe0e143abbc25d60ea42a4416, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=efd209a50a994b7c8485f2996697218b) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:17.982214 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd835b-3b99-4045-8ed5-1b83b2086dfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:17.983684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd835b-3b99-4045-8ed5-1b83b2086dfc None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:17.990347 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 609/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:10:17 2022] GET /identity/v3/role_assignments?user.id=efd209a50a994b7c8485f2996697218b&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=e62613bfe0e143abbc25d60ea42a4416 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:10:20.166102 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b42678-2414-4f6e-a847-3d617f4951da None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:20.166826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b42678-2414-4f6e-a847-3d617f4951da None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:20.166826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b42678-2414-4f6e-a847-3d617f4951da None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:20.168077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 611/1220] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:10:20.173381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787b589-1b21-447f-bf46-122e04c70659 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:20.173812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787b589-1b21-447f-bf46-122e04c70659 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:20.173936 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787b589-1b21-447f-bf46-122e04c70659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:20.193591 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e787b589-1b21-447f-bf46-122e04c70659 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:10:20.195228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e787b589-1b21-447f-bf46-122e04c70659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:10:20.270558 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 610/1221] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:10:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:10:20.554307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b42678-2414-4f6e-a847-3d617f4951da None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:20.662002 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b42678-2414-4f6e-a847-3d617f4951da None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:20.702399 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf78ab-51ed-40c3-992a-e0620af58299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:20.703066 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf78ab-51ed-40c3-992a-e0620af58299 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:20.703350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf78ab-51ed-40c3-992a-e0620af58299 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:20.703624 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf78ab-51ed-40c3-992a-e0620af58299 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:20.714975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf78ab-51ed-40c3-992a-e0620af58299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:10:20.720048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-28cf78ab-51ed-40c3-992a-e0620af58299 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:10:20.720048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:20.720048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:20.720048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:20.720048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:20.720048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:20.720048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:20.720048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:20.720048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:20.720048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:20.720048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:20.720048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:20.720048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:10:20.720048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:10:20.720048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:10:20.720048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:10:20.721242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:10:20.721242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:10:20.721242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:10:20.721242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:10:20.721242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:20.721242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:20.721242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:20.721242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:20.721242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:20.721242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:20.721242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:20.721242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:20.721242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:20.721242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:20.721242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:20.721242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:20.722276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:20.722276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:20.722276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:20.722276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:20.722276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:10:20.722276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:10:20.722276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:10:20.722276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:10:20.722276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:10:20.722276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:10:20.722276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:10:20.722276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:20.722276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 612/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:10:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:10:20.729795 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787b589-1b21-447f-bf46-122e04c70659 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:20.845584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787b589-1b21-447f-bf46-122e04c70659 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:20.873117 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:20.885454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b1634-ae01-4488-9815-dd3abb4af004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:20.886405 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b1634-ae01-4488-9815-dd3abb4af004 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:20.886682 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b1634-ae01-4488-9815-dd3abb4af004 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:20.887155 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b1634-ae01-4488-9815-dd3abb4af004 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:20.887824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b1634-ae01-4488-9815-dd3abb4af004 None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:20.888409 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b1634-ae01-4488-9815-dd3abb4af004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:20.890334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b1634-ae01-4488-9815-dd3abb4af004 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:20.900472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 611/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:10:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:20.906401 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf78ab-51ed-40c3-992a-e0620af58299 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:20.955137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:21.015920 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf78ab-51ed-40c3-992a-e0620af58299 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:21.054177 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d486c4-d2e3-4564-b3eb-84fb7d304cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:21.054844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d486c4-d2e3-4564-b3eb-84fb7d304cbb None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:21.055131 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d486c4-d2e3-4564-b3eb-84fb7d304cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:21.055408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d486c4-d2e3-4564-b3eb-84fb7d304cbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:21.066666 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d486c4-d2e3-4564-b3eb-84fb7d304cbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:21.068151 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d486c4-d2e3-4564-b3eb-84fb7d304cbb None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:21.083136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-d0d486c4-d2e3-4564-b3eb-84fb7d304cbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:21.083136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:21.083136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:21.083136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:21.083136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:21.083136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:21.083136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:21.083136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:21.083136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:21.083136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:21.083136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:21.083136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:21.083136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:10:21.083136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:10:21.083136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:10:21.083136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:10:21.084365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:21.084365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:21.084365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:21.084365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:21.084365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:21.084365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:21.084365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:21.084365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:21.084365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:21.084365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:21.084365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:21.084365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:21.084365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:21.084365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:21.084365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:21.084365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:21.084365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:10:21.085712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:10:21.085712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:21.085712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:21.085712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 613/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:21.090463 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b1634-ae01-4488-9815-dd3abb4af004 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:21.223155 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b1634-ae01-4488-9815-dd3abb4af004 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:21.259950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae232b1-d3d7-437b-93ae-89562c030540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:21.260555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae232b1-d3d7-437b-93ae-89562c030540 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:21.260837 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae232b1-d3d7-437b-93ae-89562c030540 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:21.261112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae232b1-d3d7-437b-93ae-89562c030540 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:21.261753 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae232b1-d3d7-437b-93ae-89562c030540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:21.262057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae232b1-d3d7-437b-93ae-89562c030540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:21.263472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae232b1-d3d7-437b-93ae-89562c030540 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:21.278160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 612/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:10:21.284363 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d486c4-d2e3-4564-b3eb-84fb7d304cbb None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:21.384564 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:21.391714 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d486c4-d2e3-4564-b3eb-84fb7d304cbb None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:21.437952 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38e747-fd1f-45b7-979f-4e088e623973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:21.439331 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38e747-fd1f-45b7-979f-4e088e623973 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:21.439650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38e747-fd1f-45b7-979f-4e088e623973 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:21.439933 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38e747-fd1f-45b7-979f-4e088e623973 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:21.448878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38e747-fd1f-45b7-979f-4e088e623973 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:21.450311 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38e747-fd1f-45b7-979f-4e088e623973 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:21.462565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-ea38e747-fd1f-45b7-979f-4e088e623973 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 04:10:21.462565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:21.462565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:21.462565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:21.462565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:21.462565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:21.462565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:21.462565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:21.462565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:21.462565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:21.462565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:21.462565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:21.462565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:10:21.462565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:10:21.462565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:10:21.462565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:10:21.464175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:21.464175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:21.464175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:10:21.464175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:10:21.464175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:10:21.464175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:10:21.464175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:21.464175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:21.464175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:21.464175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:21.464175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:21.464175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:21.464175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:21.464175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:21.464175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:21.464175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:21.464175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:21.464175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:21.465353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:21.465353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:21.465353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:10:21.465353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:10:21.465353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:10:21.465353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:10:21.465353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:10:21.465353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:10:21.465353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 04:10:21.465353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:21.465353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 614/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:21.469890 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae232b1-d3d7-437b-93ae-89562c030540 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:21.523159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:21.578846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae232b1-d3d7-437b-93ae-89562c030540 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:21.614773 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed1451-30bc-4625-9b09-111ab88e92a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:21.615392 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed1451-30bc-4625-9b09-111ab88e92a0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:21.615679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed1451-30bc-4625-9b09-111ab88e92a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:21.615955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed1451-30bc-4625-9b09-111ab88e92a0 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:21.616699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed1451-30bc-4625-9b09-111ab88e92a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:21.617010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed1451-30bc-4625-9b09-111ab88e92a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:21.618525 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed1451-30bc-4625-9b09-111ab88e92a0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:21.635581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 613/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Sep 27 04:10:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:21.641471 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38e747-fd1f-45b7-979f-4e088e623973 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:21.758246 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38e747-fd1f-45b7-979f-4e088e623973 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:21.796754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a801e-6cbd-447b-9978-319e24f5f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:21.797327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a801e-6cbd-447b-9978-319e24f5f94f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:21.797657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a801e-6cbd-447b-9978-319e24f5f94f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:21.797954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a801e-6cbd-447b-9978-319e24f5f94f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:21.808897 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a801e-6cbd-447b-9978-319e24f5f94f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:21.810547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a801e-6cbd-447b-9978-319e24f5f94f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:21.826272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-889a801e-6cbd-447b-9978-319e24f5f94f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:21.826272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:21.826272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:21.826272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:21.826272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:21.826272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:21.826272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:21.826272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:21.826272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:21.826272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:21.826272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:21.826272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:21.826272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:10:21.826272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:10:21.826272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:10:21.826272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:10:21.827373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:21.827373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:21.827373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:21.827373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:21.827373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:21.827373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:21.827373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:21.827373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:21.827373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:21.827373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:21.827373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:21.827373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:21.827373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:21.827373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:21.827373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:21.827373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:21.827373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:10:21.828337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:10:21.828337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:21.828337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:21.828337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 615/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:21.833934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed1451-30bc-4625-9b09-111ab88e92a0 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:21.947249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed1451-30bc-4625-9b09-111ab88e92a0 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:21.950072 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:21.988168 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0c076-a2d9-4a05-9b49-9df8e9bbcaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:21.988875 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0c076-a2d9-4a05-9b49-9df8e9bbcaf5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:21.989160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0c076-a2d9-4a05-9b49-9df8e9bbcaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:21.989435 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0c076-a2d9-4a05-9b49-9df8e9bbcaf5 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:21.990082 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0c076-a2d9-4a05-9b49-9df8e9bbcaf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:21.990388 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0c076-a2d9-4a05-9b49-9df8e9bbcaf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:21.991789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0c076-a2d9-4a05-9b49-9df8e9bbcaf5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:22.008442 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 614/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:22.009648 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a801e-6cbd-447b-9978-319e24f5f94f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:22.019869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:22.125166 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a801e-6cbd-447b-9978-319e24f5f94f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:22.165585 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f4121-d4e8-46e8-9f65-5175daab6c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:22.166357 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f4121-d4e8-46e8-9f65-5175daab6c29 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:22.166683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f4121-d4e8-46e8-9f65-5175daab6c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:22.167039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f4121-d4e8-46e8-9f65-5175daab6c29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:22.174457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f4121-d4e8-46e8-9f65-5175daab6c29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:22.176042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f4121-d4e8-46e8-9f65-5175daab6c29 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:22.188355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-3e4f4121-d4e8-46e8-9f65-5175daab6c29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:10:22.188355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:22.188355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:22.188355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:22.188355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:22.188355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:22.188355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:22.188355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:22.188355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:22.188355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:22.188355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:22.188355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:22.188355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:10:22.188355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:10:22.188355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:10:22.189491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:10:22.189491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:22.189491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:22.189491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:22.189491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:22.189491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:22.189491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:22.189491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:22.189491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:22.189491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:22.189491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:22.189491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:22.189491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:22.189491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:22.189491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:22.189491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:22.189491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:22.191116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:10:22.191116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:10:22.191116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:10:22.191116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:10:22.191116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:10:22.191116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:10:22.191116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:10:22.191116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:22.191116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 616/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:10:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:22.195815 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0c076-a2d9-4a05-9b49-9df8e9bbcaf5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:22.305316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0c076-a2d9-4a05-9b49-9df8e9bbcaf5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:22.341773 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c9227-fcf0-4506-9633-38e7e6a2f7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:22.342386 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c9227-fcf0-4506-9633-38e7e6a2f7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:22.342687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c9227-fcf0-4506-9633-38e7e6a2f7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:22.342991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c9227-fcf0-4506-9633-38e7e6a2f7e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:22.343719 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c9227-fcf0-4506-9633-38e7e6a2f7e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:22.344004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c9227-fcf0-4506-9633-38e7e6a2f7e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:22.345444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c9227-fcf0-4506-9633-38e7e6a2f7e5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:22.357832 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 615/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:10:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:22.364134 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f4121-d4e8-46e8-9f65-5175daab6c29 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:22.444483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:22.478673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f4121-d4e8-46e8-9f65-5175daab6c29 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:22.515071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd1873-7c44-4c85-a089-277848ff1c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:22.515724 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1873-7c44-4c85-a089-277848ff1c91 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:22.516007 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1873-7c44-4c85-a089-277848ff1c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:22.516283 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1873-7c44-4c85-a089-277848ff1c91 None admin] PATH_INFO: `/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/efd209a50a994b7c8485f2996697218b/roles/e62613bfe0e143abbc25d60ea42a4416` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:22.530555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd1873-7c44-4c85-a089-277848ff1c91 None admin] RBAC: Authorizing `identity:create_grant(project_id=37e7a8d1446d4cdea0ba00124411cd93, user_id=efd209a50a994b7c8485f2996697218b, role_id=e62613bfe0e143abbc25d60ea42a4416)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:22.532066 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd1873-7c44-4c85-a089-277848ff1c91 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:22.544379 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 617/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:10:22 2022] PUT /identity/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/efd209a50a994b7c8485f2996697218b/roles/e62613bfe0e143abbc25d60ea42a4416 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:10:24.844233 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af730c93-8f47-4ad6-b6c3-52a426730eec None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:24.845096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af730c93-8f47-4ad6-b6c3-52a426730eec None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:24.845285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af730c93-8f47-4ad6-b6c3-52a426730eec None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:24.847616 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 616/1233] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:10:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:10:24.854096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972797-03a1-4d34-90f1-2f0b525e0127 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:24.856466 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972797-03a1-4d34-90f1-2f0b525e0127 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:24.856466 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972797-03a1-4d34-90f1-2f0b525e0127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:24.875533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d5972797-03a1-4d34-90f1-2f0b525e0127 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:10:24.876724 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d5972797-03a1-4d34-90f1-2f0b525e0127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:10:24.948218 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 618/1234] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:10:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:10:25.235582 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af730c93-8f47-4ad6-b6c3-52a426730eec None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:25.263066 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:25.345522 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af730c93-8f47-4ad6-b6c3-52a426730eec None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:25.382426 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd640a-a5e7-4652-96fd-3fe423e3ec9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:25.383146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd640a-a5e7-4652-96fd-3fe423e3ec9c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:25.383429 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd640a-a5e7-4652-96fd-3fe423e3ec9c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:25.383720 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd640a-a5e7-4652-96fd-3fe423e3ec9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:25.395839 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd640a-a5e7-4652-96fd-3fe423e3ec9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:10:25.400644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-8dbd640a-a5e7-4652-96fd-3fe423e3ec9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:10:25.400644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:25.400644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:25.400644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:25.400644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:25.400644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:25.400644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:25.400644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:25.400644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:25.400644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:25.400644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:25.400644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:25.400644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:10:25.400644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:10:25.400644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:10:25.400644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:10:25.401783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:10:25.401783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:10:25.401783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:10:25.401783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:10:25.401783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:25.401783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:25.401783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:25.401783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:25.401783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:25.401783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:25.401783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:25.401783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:25.401783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:25.401783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:25.401783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:25.401783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:25.402860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:25.402860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:25.402860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:25.402860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:25.402860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:10:25.402860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:10:25.402860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:10:25.402860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:10:25.402860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:10:25.402860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:10:25.402860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:10:25.402860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:10:25.402860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 617/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 27 04:10:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:25.407948 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5972797-03a1-4d34-90f1-2f0b525e0127 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:25.457228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:25.516041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5972797-03a1-4d34-90f1-2f0b525e0127 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:25.551296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f982c5-69c4-4040-b67a-4c9a5a880766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:25.551954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f982c5-69c4-4040-b67a-4c9a5a880766 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:25.552237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f982c5-69c4-4040-b67a-4c9a5a880766 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:25.552540 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f982c5-69c4-4040-b67a-4c9a5a880766 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:25.553218 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f982c5-69c4-4040-b67a-4c9a5a880766 None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:25.553522 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f982c5-69c4-4040-b67a-4c9a5a880766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:25.554985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f982c5-69c4-4040-b67a-4c9a5a880766 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:25.562726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 619/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 27 04:10:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:25.569073 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd640a-a5e7-4652-96fd-3fe423e3ec9c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:25.658358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:25.676498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd640a-a5e7-4652-96fd-3fe423e3ec9c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:25.712459 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc10486-e34f-4475-9373-eba00af0a527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:25.713164 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc10486-e34f-4475-9373-eba00af0a527 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:25.713447 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc10486-e34f-4475-9373-eba00af0a527 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:25.713727 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc10486-e34f-4475-9373-eba00af0a527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:25.724974 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc10486-e34f-4475-9373-eba00af0a527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:25.726494 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc10486-e34f-4475-9373-eba00af0a527 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:25.742296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-ecc10486-e34f-4475-9373-eba00af0a527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:25.742296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:25.742296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:25.742296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:25.742296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:25.742296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:25.742296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:25.742296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:25.742296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:25.742296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:25.742296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:25.742296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:25.742296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:10:25.742296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:10:25.742296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:10:25.742296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:10:25.748583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:25.748583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:25.748583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:25.748583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:25.748583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:25.748583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:25.748583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:25.748583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:25.748583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:25.748583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:25.748583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:25.748583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:25.748583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:25.748583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:25.748583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:25.748583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:25.748583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:10:25.749584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:10:25.749584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:25.749584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:10:25.749584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 618/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:25.749824 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f982c5-69c4-4040-b67a-4c9a5a880766 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:25.864152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f982c5-69c4-4040-b67a-4c9a5a880766 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:25.874233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:25.902738 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22146800-a511-450b-a441-e79341ad0cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:25.903469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22146800-a511-450b-a441-e79341ad0cdc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:25.903758 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22146800-a511-450b-a441-e79341ad0cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:25.904041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22146800-a511-450b-a441-e79341ad0cdc None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:25.904699 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22146800-a511-450b-a441-e79341ad0cdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:25.905089 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22146800-a511-450b-a441-e79341ad0cdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:25.906801 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22146800-a511-450b-a441-e79341ad0cdc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:25.925293 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 620/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:25.926663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc10486-e34f-4475-9373-eba00af0a527 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:26.041610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc10486-e34f-4475-9373-eba00af0a527 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:26.080898 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74ee3b-e6c0-419c-b458-fe2fdae7a66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:26.081652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74ee3b-e6c0-419c-b458-fe2fdae7a66e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:26.081966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74ee3b-e6c0-419c-b458-fe2fdae7a66e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:26.082248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74ee3b-e6c0-419c-b458-fe2fdae7a66e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:26.085303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:26.091276 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74ee3b-e6c0-419c-b458-fe2fdae7a66e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:26.092827 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74ee3b-e6c0-419c-b458-fe2fdae7a66e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:26.103950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-1a74ee3b-e6c0-419c-b458-fe2fdae7a66e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 04:10:26.103950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:26.103950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:26.103950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:26.103950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:26.103950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:26.103950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:26.103950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:26.103950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:26.103950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:26.103950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:26.103950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:26.103950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:10:26.103950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:10:26.103950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:10:26.103950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:10:26.105240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:26.105240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:26.105240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:10:26.105240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:10:26.105240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:10:26.105240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:10:26.105240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:26.105240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:26.105240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:26.105240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:26.105240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:26.105240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:26.105240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:26.105240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:26.105240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:26.105240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:26.105240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:26.105240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:26.106684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:26.106684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:26.106684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:10:26.106684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:10:26.106684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:10:26.106684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:10:26.106684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:10:26.106684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:10:26.106684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 04:10:26.106684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:10:26.106684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 619/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:26.111575 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22146800-a511-450b-a441-e79341ad0cdc None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:26.222647 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22146800-a511-450b-a441-e79341ad0cdc None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:26.261614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d11203-c3b8-4909-ab67-9a56c95b087c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:26.262310 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d11203-c3b8-4909-ab67-9a56c95b087c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:26.262692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d11203-c3b8-4909-ab67-9a56c95b087c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:26.263041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d11203-c3b8-4909-ab67-9a56c95b087c None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:26.263916 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d11203-c3b8-4909-ab67-9a56c95b087c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:26.264297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d11203-c3b8-4909-ab67-9a56c95b087c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:26.265952 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d11203-c3b8-4909-ab67-9a56c95b087c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:26.286520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 621/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Sep 27 04:10:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:26.292384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74ee3b-e6c0-419c-b458-fe2fdae7a66e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:26.403447 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74ee3b-e6c0-419c-b458-fe2fdae7a66e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:26.440060 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a00a21-72df-47d3-bca1-1adced52f1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:26.440693 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a00a21-72df-47d3-bca1-1adced52f1fb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:26.441036 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a00a21-72df-47d3-bca1-1adced52f1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:26.441248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a00a21-72df-47d3-bca1-1adced52f1fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:26.510114 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:26.517456 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a00a21-72df-47d3-bca1-1adced52f1fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:26.519489 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a00a21-72df-47d3-bca1-1adced52f1fb None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:26.629155 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 620/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:10:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:10:26.635323 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d11203-c3b8-4909-ab67-9a56c95b087c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:26.666107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:26.744939 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d11203-c3b8-4909-ab67-9a56c95b087c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:26.782749 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c3776-05e2-4bf1-bbc6-9d0a89409a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:26.783391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c3776-05e2-4bf1-bbc6-9d0a89409a3d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:26.783622 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c3776-05e2-4bf1-bbc6-9d0a89409a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:26.783933 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c3776-05e2-4bf1-bbc6-9d0a89409a3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:26.794424 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c3776-05e2-4bf1-bbc6-9d0a89409a3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:26.796014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c3776-05e2-4bf1-bbc6-9d0a89409a3d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:26.811199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-842c3776-05e2-4bf1-bbc6-9d0a89409a3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:26.811199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:26.811199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:26.811199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:26.811199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:26.811199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:26.811199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:26.811199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:26.811199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:26.811199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:26.811199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:26.811199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:26.811199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:10:26.811199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:10:26.811199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:10:26.811199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:10:26.812287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:26.812287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:26.812287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:26.812287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:26.812287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:26.812287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:26.812287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:26.812287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:26.812287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:26.812287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:26.812287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:26.812287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:26.812287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:26.812287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:26.812287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:26.812287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:26.812287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:10:26.813518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:10:26.813518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:26.813518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:26.813518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 622/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:26.819049 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a00a21-72df-47d3-bca1-1adced52f1fb None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:26.922218 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:26.929111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a00a21-72df-47d3-bca1-1adced52f1fb None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:26.963703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51667e3a-5b3b-49a6-9807-9efc71a214a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:26.964360 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51667e3a-5b3b-49a6-9807-9efc71a214a5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:26.964597 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51667e3a-5b3b-49a6-9807-9efc71a214a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:26.964911 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51667e3a-5b3b-49a6-9807-9efc71a214a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:26.965514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51667e3a-5b3b-49a6-9807-9efc71a214a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:26.965836 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51667e3a-5b3b-49a6-9807-9efc71a214a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:26.967236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51667e3a-5b3b-49a6-9807-9efc71a214a5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:26.983693 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 621/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:26.984991 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c3776-05e2-4bf1-bbc6-9d0a89409a3d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:27.073260 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:27.097874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c3776-05e2-4bf1-bbc6-9d0a89409a3d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:27.143822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52363529-0b77-4e0d-b75e-44cc615f1ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:27.144561 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52363529-0b77-4e0d-b75e-44cc615f1ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:27.144947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52363529-0b77-4e0d-b75e-44cc615f1ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:27.145683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52363529-0b77-4e0d-b75e-44cc615f1ad2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:27.154051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52363529-0b77-4e0d-b75e-44cc615f1ad2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:27.156015 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52363529-0b77-4e0d-b75e-44cc615f1ad2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:27.170367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-52363529-0b77-4e0d-b75e-44cc615f1ad2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:10:27.170367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:27.170367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:27.170367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:27.170367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:27.170367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:27.170367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:27.170367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:27.170367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:27.170367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:27.170367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:27.170367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:27.170367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:10:27.170367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:10:27.170367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:10:27.171500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:10:27.171500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:27.171500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:27.171500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:27.171500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:27.171500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:27.171500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:27.171500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:27.171500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:27.171500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:27.171500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:27.171500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:27.171500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:27.171500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:27.171500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:27.171500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:27.171500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:27.172423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:10:27.172423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:10:27.172423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:10:27.172423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:10:27.172423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:10:27.172423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:10:27.172423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:10:27.172423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:27.172423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 623/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:10:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:27.178330 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51667e3a-5b3b-49a6-9807-9efc71a214a5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:27.292744 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51667e3a-5b3b-49a6-9807-9efc71a214a5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:27.330922 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a69b0-8470-4358-954d-87aa20b66c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:27.332046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a69b0-8470-4358-954d-87aa20b66c26 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:27.332332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a69b0-8470-4358-954d-87aa20b66c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:27.332628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a69b0-8470-4358-954d-87aa20b66c26 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:27.333461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a69b0-8470-4358-954d-87aa20b66c26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:27.333779 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a69b0-8470-4358-954d-87aa20b66c26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:27.335576 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a69b0-8470-4358-954d-87aa20b66c26 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:27.351441 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 622/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:10:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:27.358193 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52363529-0b77-4e0d-b75e-44cc615f1ad2 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:27.464857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52363529-0b77-4e0d-b75e-44cc615f1ad2 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:27.500956 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad081a-c2fd-445c-944b-f7f004138235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:27.501591 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad081a-c2fd-445c-944b-f7f004138235 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:27.501936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad081a-c2fd-445c-944b-f7f004138235 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:27.502241 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad081a-c2fd-445c-944b-f7f004138235 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:27.503100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad081a-c2fd-445c-944b-f7f004138235 None admin] RBAC: Adding query filter params (role.id=e62613bfe0e143abbc25d60ea42a4416, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=efd209a50a994b7c8485f2996697218b) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:27.503484 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad081a-c2fd-445c-944b-f7f004138235 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:27.505145 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad081a-c2fd-445c-944b-f7f004138235 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:27.511543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 624/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:10:27 2022] GET /identity/v3/role_assignments?user.id=efd209a50a994b7c8485f2996697218b&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=e62613bfe0e143abbc25d60ea42a4416 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:29.932116 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7f4a4-c9d0-479b-b876-8427a354a57b None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:29.932686 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7f4a4-c9d0-479b-b876-8427a354a57b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:29.932686 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7f4a4-c9d0-479b-b876-8427a354a57b None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:29.933991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 623/1247] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:10:29.940513 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc7ac8-1e54-416c-8aa3-dfa2fa1e3b41 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:29.940952 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc7ac8-1e54-416c-8aa3-dfa2fa1e3b41 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:29.941069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc7ac8-1e54-416c-8aa3-dfa2fa1e3b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:29.947345 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:29.962072 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-bfcc7ac8-1e54-416c-8aa3-dfa2fa1e3b41 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:10:29.963397 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-bfcc7ac8-1e54-416c-8aa3-dfa2fa1e3b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:10:30.035359 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 625/1248] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:10:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:10:30.319723 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7f4a4-c9d0-479b-b876-8427a354a57b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:30.339544 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:30.438079 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7f4a4-c9d0-479b-b876-8427a354a57b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:30.476099 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709580ff-6aca-4739-afb5-6b1004d4b1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:30.477013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709580ff-6aca-4739-afb5-6b1004d4b1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:30.477298 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709580ff-6aca-4739-afb5-6b1004d4b1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:30.477668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709580ff-6aca-4739-afb5-6b1004d4b1e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:30.490040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709580ff-6aca-4739-afb5-6b1004d4b1e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:10:30.495159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-709580ff-6aca-4739-afb5-6b1004d4b1e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:10:30.495159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:30.495159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:30.495159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:30.495159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:30.495159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:30.495159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:30.495159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:30.495159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:30.495159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:30.495159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:30.495159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:30.495159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:10:30.495159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:10:30.495159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:10:30.495159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:10:30.496328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:10:30.496328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:10:30.496328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:10:30.496328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:10:30.496328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:30.496328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:30.496328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:30.496328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:30.496328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:30.496328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:30.496328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:30.496328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:30.496328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:30.496328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:30.496328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:30.496328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:30.497418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:30.497418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:30.497418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:30.497418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:30.497418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:10:30.497418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:10:30.497418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:10:30.497418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:10:30.497418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:10:30.497418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:10:30.497418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:10:30.497418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:10:30.497418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 624/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:10:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:10:30.502541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc7ac8-1e54-416c-8aa3-dfa2fa1e3b41 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:30.612991 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc7ac8-1e54-416c-8aa3-dfa2fa1e3b41 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:30.644410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:30.652945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d664fd7-7b64-4f81-9553-4ec67804e2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:30.653561 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d664fd7-7b64-4f81-9553-4ec67804e2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:30.653843 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d664fd7-7b64-4f81-9553-4ec67804e2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:30.654121 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d664fd7-7b64-4f81-9553-4ec67804e2e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:30.654822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d664fd7-7b64-4f81-9553-4ec67804e2e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:30.655130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d664fd7-7b64-4f81-9553-4ec67804e2e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:30.656860 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d664fd7-7b64-4f81-9553-4ec67804e2e7 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:30.666087 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 626/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:10:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:30.672006 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709580ff-6aca-4739-afb5-6b1004d4b1e2 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:30.757970 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:30.784456 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709580ff-6aca-4739-afb5-6b1004d4b1e2 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:30.819340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb641c3-72c0-4064-8302-ad398d4bb114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:30.819993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb641c3-72c0-4064-8302-ad398d4bb114 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:30.820269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb641c3-72c0-4064-8302-ad398d4bb114 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:30.820541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb641c3-72c0-4064-8302-ad398d4bb114 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:30.832412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb641c3-72c0-4064-8302-ad398d4bb114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:30.833892 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb641c3-72c0-4064-8302-ad398d4bb114 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:30.851264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-5bb641c3-72c0-4064-8302-ad398d4bb114 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:30.851264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:30.851264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:30.851264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:30.851264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:30.851264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:30.851264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:30.851264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:30.851264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:30.851264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:30.851264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:30.851264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:30.851264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:10:30.851264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:10:30.851264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:10:30.851264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:10:30.852513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:30.852513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:30.852513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:30.852513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:30.852513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:30.852513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:30.852513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:30.852513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:30.852513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:30.852513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:30.852513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:30.852513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:30.852513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:30.852513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:30.852513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:30.852513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:30.852513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:10:30.853461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:10:30.853461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:30.853461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:10:30.853461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 625/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:30.858901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d664fd7-7b64-4f81-9553-4ec67804e2e7 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:30.970045 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d664fd7-7b64-4f81-9553-4ec67804e2e7 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:31.006077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7467db-2106-4502-8a2d-69ae511b690b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:31.006705 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7467db-2106-4502-8a2d-69ae511b690b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:31.007015 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7467db-2106-4502-8a2d-69ae511b690b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:31.007293 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7467db-2106-4502-8a2d-69ae511b690b None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:31.007964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7467db-2106-4502-8a2d-69ae511b690b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:31.008273 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7467db-2106-4502-8a2d-69ae511b690b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:31.009674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7467db-2106-4502-8a2d-69ae511b690b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:31.028015 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 627/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:31.029196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb641c3-72c0-4064-8302-ad398d4bb114 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:31.136797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb641c3-72c0-4064-8302-ad398d4bb114 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:31.171726 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:31.181437 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13496433-728d-4781-b451-bc642e49fbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:31.182264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13496433-728d-4781-b451-bc642e49fbe7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:31.182639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13496433-728d-4781-b451-bc642e49fbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:31.183067 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13496433-728d-4781-b451-bc642e49fbe7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:31.194046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13496433-728d-4781-b451-bc642e49fbe7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:31.196330 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13496433-728d-4781-b451-bc642e49fbe7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:31.210202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-13496433-728d-4781-b451-bc642e49fbe7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 04:10:31.210202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:31.210202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:31.210202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:31.210202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:31.210202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:31.210202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:31.210202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:31.210202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:31.210202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:31.210202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:31.210202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:31.210202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:10:31.210202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:10:31.210202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:10:31.210202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:10:31.211292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:31.211292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:31.211292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:10:31.211292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:10:31.211292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:10:31.211292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:10:31.211292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:31.211292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:31.211292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:31.211292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:31.211292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:31.211292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:31.211292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:31.211292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:31.211292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:31.211292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:31.211292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:31.211292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:31.212224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:31.212224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:31.212224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:10:31.212224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:10:31.212224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:10:31.212224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:10:31.212224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:10:31.212224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:10:31.212224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 04:10:31.212224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:10:31.212224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 626/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:31.222530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7467db-2106-4502-8a2d-69ae511b690b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:31.279985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:31.325166 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7467db-2106-4502-8a2d-69ae511b690b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:31.359574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1ab3f-0b69-4606-955c-75d6d32edb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:31.360181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1ab3f-0b69-4606-955c-75d6d32edb9d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:31.360514 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1ab3f-0b69-4606-955c-75d6d32edb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:31.360793 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1ab3f-0b69-4606-955c-75d6d32edb9d None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:31.361684 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1ab3f-0b69-4606-955c-75d6d32edb9d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:31.362273 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1ab3f-0b69-4606-955c-75d6d32edb9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:31.364342 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1ab3f-0b69-4606-955c-75d6d32edb9d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:31.382133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 628/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Sep 27 04:10:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:31.388146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13496433-728d-4781-b451-bc642e49fbe7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:31.491010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13496433-728d-4781-b451-bc642e49fbe7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:31.522994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21fb25-c14b-4d6d-9b21-e17f13e9b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:31.523588 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21fb25-c14b-4d6d-9b21-e17f13e9b28a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:31.523870 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21fb25-c14b-4d6d-9b21-e17f13e9b28a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:31.524144 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21fb25-c14b-4d6d-9b21-e17f13e9b28a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:31.575628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:31.588396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21fb25-c14b-4d6d-9b21-e17f13e9b28a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:31.589832 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21fb25-c14b-4d6d-9b21-e17f13e9b28a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:31.683034 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 627/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:10:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:10:31.688983 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1ab3f-0b69-4606-955c-75d6d32edb9d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:31.783947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1ab3f-0b69-4606-955c-75d6d32edb9d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:31.796140 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:31.816693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e4b4e-969a-410f-afc4-1c272f032b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:31.817302 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e4b4e-969a-410f-afc4-1c272f032b51 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:31.817581 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e4b4e-969a-410f-afc4-1c272f032b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:31.817853 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e4b4e-969a-410f-afc4-1c272f032b51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:31.827285 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e4b4e-969a-410f-afc4-1c272f032b51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:31.828707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e4b4e-969a-410f-afc4-1c272f032b51 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:31.843229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-c08e4b4e-969a-410f-afc4-1c272f032b51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:31.843229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:31.843229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:31.843229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:31.843229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:31.843229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:31.843229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:31.843229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:31.843229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:31.843229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:31.843229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:31.843229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:31.843229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:10:31.843229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:10:31.843229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:10:31.843229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:10:31.844170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:31.844170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:31.844170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:31.844170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:31.844170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:31.844170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:31.844170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:31.844170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:31.844170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:31.844170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:31.844170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:31.844170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:31.844170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:31.844170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:31.844170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:31.844170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:31.844170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:10:31.845207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:10:31.845207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:31.845207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:31.845207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 629/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:31.849957 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21fb25-c14b-4d6d-9b21-e17f13e9b28a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:31.932828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:31.945335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21fb25-c14b-4d6d-9b21-e17f13e9b28a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:31.977658 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e85db1-8792-4a69-b157-33c449ebf86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:31.978251 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e85db1-8792-4a69-b157-33c449ebf86d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:31.978533 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e85db1-8792-4a69-b157-33c449ebf86d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:31.978845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e85db1-8792-4a69-b157-33c449ebf86d None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:31.979483 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e85db1-8792-4a69-b157-33c449ebf86d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:31.979789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e85db1-8792-4a69-b157-33c449ebf86d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:31.981146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e85db1-8792-4a69-b157-33c449ebf86d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:31.992131 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 628/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:31.997555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e4b4e-969a-410f-afc4-1c272f032b51 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:32.092784 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e4b4e-969a-410f-afc4-1c272f032b51 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:32.128184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c59f7-9850-4603-8b8d-272a5d621cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:32.128831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c59f7-9850-4603-8b8d-272a5d621cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:32.129152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c59f7-9850-4603-8b8d-272a5d621cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:32.129426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c59f7-9850-4603-8b8d-272a5d621cf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:32.136703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c59f7-9850-4603-8b8d-272a5d621cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:32.138203 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c59f7-9850-4603-8b8d-272a5d621cf4 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:32.150954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-950c59f7-9850-4603-8b8d-272a5d621cf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:10:32.150954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:32.150954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:32.150954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:32.150954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:32.150954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:32.150954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:32.150954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:32.150954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:32.150954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:32.150954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:32.150954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:32.150954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:10:32.150954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:10:32.150954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:10:32.152051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:10:32.152051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:32.152051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:32.152051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:32.152051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:32.152051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:32.152051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:32.152051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:32.152051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:32.152051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:32.152051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:32.152051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:32.152051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:32.152051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:32.152051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:32.152051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:32.152051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:32.153139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:10:32.153139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:10:32.153139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:10:32.153139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:10:32.153139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:10:32.153139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:10:32.153139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:10:32.153139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:32.153139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 630/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:10:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:32.158217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e85db1-8792-4a69-b157-33c449ebf86d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:32.258300 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e85db1-8792-4a69-b157-33c449ebf86d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:32.290774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf223d8c-716e-4bb9-8267-b6a0913207f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:32.291373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf223d8c-716e-4bb9-8267-b6a0913207f7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:32.291662 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf223d8c-716e-4bb9-8267-b6a0913207f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:32.291940 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf223d8c-716e-4bb9-8267-b6a0913207f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:32.292632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf223d8c-716e-4bb9-8267-b6a0913207f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:32.292943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf223d8c-716e-4bb9-8267-b6a0913207f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:32.294366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf223d8c-716e-4bb9-8267-b6a0913207f7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:32.306308 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 629/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:10:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:10:32.312439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c59f7-9850-4603-8b8d-272a5d621cf4 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:32.337174 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:32.409456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c59f7-9850-4603-8b8d-272a5d621cf4 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:32.441938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87348667-8460-4bc2-a16c-25671ea766e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:32.442528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87348667-8460-4bc2-a16c-25671ea766e2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:32.442834 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87348667-8460-4bc2-a16c-25671ea766e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:32.443107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87348667-8460-4bc2-a16c-25671ea766e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:32.443827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87348667-8460-4bc2-a16c-25671ea766e2 None admin] RBAC: Adding query filter params (role.id=2613cf4a98d44744a094c7782b19b4b5, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=efd209a50a994b7c8485f2996697218b) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:32.444135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87348667-8460-4bc2-a16c-25671ea766e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:32.445539 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87348667-8460-4bc2-a16c-25671ea766e2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:32.450649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 631/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:10:32 2022] GET /identity/v3/role_assignments?user.id=efd209a50a994b7c8485f2996697218b&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:34.565362 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386503d2-59d2-4b85-a8b3-f3953f996c1b None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:34.565908 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386503d2-59d2-4b85-a8b3-f3953f996c1b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:34.565908 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386503d2-59d2-4b85-a8b3-f3953f996c1b None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:34.567279 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 630/1261] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:10:34.572389 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e74e4-0337-4621-8680-3f4133e3b352 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:34.572812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e74e4-0337-4621-8680-3f4133e3b352 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:34.572938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e74e4-0337-4621-8680-3f4133e3b352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:34.591012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-378e74e4-0337-4621-8680-3f4133e3b352 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:10:34.592188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-378e74e4-0337-4621-8680-3f4133e3b352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:10:34.656448 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 632/1262] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:10:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:10:34.927948 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386503d2-59d2-4b85-a8b3-f3953f996c1b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:34.940168 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:35.027808 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386503d2-59d2-4b85-a8b3-f3953f996c1b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:35.059220 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f38b5-54cc-4b5e-8eb3-47d3d6ea0d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:35.059829 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f38b5-54cc-4b5e-8eb3-47d3d6ea0d94 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:35.060107 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f38b5-54cc-4b5e-8eb3-47d3d6ea0d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:35.060377 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f38b5-54cc-4b5e-8eb3-47d3d6ea0d94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:35.070409 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f38b5-54cc-4b5e-8eb3-47d3d6ea0d94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:10:35.075134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-c08f38b5-54cc-4b5e-8eb3-47d3d6ea0d94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:10:35.075134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:35.075134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:35.075134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:35.075134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:35.075134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:35.075134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:35.075134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:35.075134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:35.075134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:35.075134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:35.075134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:35.075134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:10:35.075134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:10:35.075134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:10:35.075134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:10:35.076217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:10:35.076217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:10:35.076217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:10:35.076217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:10:35.076217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:35.076217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:35.076217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:35.076217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:35.076217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:35.076217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:35.076217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:35.076217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:35.076217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:35.076217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:35.076217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:35.076217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:35.077449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:35.077449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:35.077449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:35.077449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:35.077449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:10:35.077449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:10:35.077449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:10:35.077449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:10:35.077449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:10:35.077449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:10:35.077449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:10:35.077449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:10:35.077449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 631/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:10:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:35.082610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e74e4-0337-4621-8680-3f4133e3b352 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:35.100032 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:35.209055 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e74e4-0337-4621-8680-3f4133e3b352 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:35.242874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f3840-5411-469e-a44d-fc9c9b10b4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:35.243482 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f3840-5411-469e-a44d-fc9c9b10b4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:35.243767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f3840-5411-469e-a44d-fc9c9b10b4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:35.244047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f3840-5411-469e-a44d-fc9c9b10b4c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:35.244716 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f3840-5411-469e-a44d-fc9c9b10b4c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:35.245022 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f3840-5411-469e-a44d-fc9c9b10b4c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:35.246393 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f3840-5411-469e-a44d-fc9c9b10b4c2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:35.254913 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 633/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:10:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:35.260695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f38b5-54cc-4b5e-8eb3-47d3d6ea0d94 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:35.324223 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:35.355735 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f38b5-54cc-4b5e-8eb3-47d3d6ea0d94 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:35.388896 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b480bcc-fde8-424b-bd5b-327ba320cba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:35.389503 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b480bcc-fde8-424b-bd5b-327ba320cba5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:35.389781 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b480bcc-fde8-424b-bd5b-327ba320cba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:35.390051 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b480bcc-fde8-424b-bd5b-327ba320cba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:35.400049 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b480bcc-fde8-424b-bd5b-327ba320cba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:35.401516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b480bcc-fde8-424b-bd5b-327ba320cba5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:35.415977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-9b480bcc-fde8-424b-bd5b-327ba320cba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:35.415977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:35.415977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:35.415977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:35.415977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:35.415977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:35.415977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:35.415977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:35.415977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:35.415977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:35.415977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:35.415977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:35.415977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:10:35.415977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:10:35.415977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:10:35.415977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:10:35.417076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:35.417076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:35.417076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:35.417076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:35.417076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:35.417076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:35.417076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:35.417076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:35.417076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:35.417076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:35.417076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:35.417076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:35.417076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:35.417076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:35.417076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:35.417076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:35.417076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:10:35.418334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:10:35.418334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:35.418334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:10:35.418334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 632/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:35.422857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f3840-5411-469e-a44d-fc9c9b10b4c2 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:35.510802 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:35.532909 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f3840-5411-469e-a44d-fc9c9b10b4c2 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:35.572309 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd71bc6-a987-45b9-a5bb-78cd1f01258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:35.572912 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd71bc6-a987-45b9-a5bb-78cd1f01258e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:35.573487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd71bc6-a987-45b9-a5bb-78cd1f01258e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:35.573487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd71bc6-a987-45b9-a5bb-78cd1f01258e None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:35.574072 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd71bc6-a987-45b9-a5bb-78cd1f01258e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:35.574372 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd71bc6-a987-45b9-a5bb-78cd1f01258e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:35.575752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd71bc6-a987-45b9-a5bb-78cd1f01258e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:35.587058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 634/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:35.592755 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b480bcc-fde8-424b-bd5b-327ba320cba5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:35.688760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b480bcc-fde8-424b-bd5b-327ba320cba5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:35.707366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:35.721530 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0765756-1f42-4ce9-aa57-186f64f736c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:35.722134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0765756-1f42-4ce9-aa57-186f64f736c3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:35.722410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0765756-1f42-4ce9-aa57-186f64f736c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:35.722679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0765756-1f42-4ce9-aa57-186f64f736c3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:35.729678 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0765756-1f42-4ce9-aa57-186f64f736c3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:35.731145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0765756-1f42-4ce9-aa57-186f64f736c3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:35.742620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-b0765756-1f42-4ce9-aa57-186f64f736c3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 04:10:35.742620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:35.742620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:35.742620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:35.742620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:35.742620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:35.742620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:35.742620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:35.742620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:35.742620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:35.742620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:35.742620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:35.742620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:10:35.742620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:10:35.742620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:10:35.742620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:10:35.743701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:35.743701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:35.743701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:10:35.743701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:10:35.743701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:10:35.743701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:10:35.743701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:35.743701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:35.743701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:35.743701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:35.743701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:35.743701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:35.743701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:35.743701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:35.743701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:35.743701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:35.743701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:35.743701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:35.744992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:35.744992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:35.744992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:10:35.744992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:10:35.744992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:10:35.744992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:10:35.744992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:10:35.744992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:10:35.744992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 04:10:35.744992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:10:35.744992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 633/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:35.749407 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd71bc6-a987-45b9-a5bb-78cd1f01258e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:35.844869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd71bc6-a987-45b9-a5bb-78cd1f01258e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:35.883288 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce353e-27a1-433f-b521-2331bb485950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:35.883893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce353e-27a1-433f-b521-2331bb485950 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:35.884181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce353e-27a1-433f-b521-2331bb485950 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:35.884457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce353e-27a1-433f-b521-2331bb485950 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:35.885195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce353e-27a1-433f-b521-2331bb485950 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:35.885506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce353e-27a1-433f-b521-2331bb485950 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:35.886971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce353e-27a1-433f-b521-2331bb485950 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:35.896124 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:35.904762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 635/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Sep 27 04:10:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:35.911238 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0765756-1f42-4ce9-aa57-186f64f736c3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:36.007349 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0765756-1f42-4ce9-aa57-186f64f736c3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:36.039902 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a0896-efbb-4815-bfad-2fcdf457a063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:36.040510 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a0896-efbb-4815-bfad-2fcdf457a063 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:36.040793 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a0896-efbb-4815-bfad-2fcdf457a063 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:36.041068 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a0896-efbb-4815-bfad-2fcdf457a063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:36.051228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a0896-efbb-4815-bfad-2fcdf457a063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:36.052664 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a0896-efbb-4815-bfad-2fcdf457a063 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:36.066118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-613a0896-efbb-4815-bfad-2fcdf457a063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:36.066118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:36.066118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:36.066118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:36.066118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:36.066118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:36.066118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:36.066118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:36.066118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:36.066118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:36.066118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:36.066118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:36.066118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:10:36.066118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:10:36.066118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:10:36.066118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:10:36.067274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:36.067274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:36.067274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:36.067274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:36.067274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:36.067274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:36.067274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:36.067274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:36.067274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:36.067274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:36.067274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:36.067274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:36.067274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:36.067274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:36.067274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:36.067274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:36.067274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:10:36.068337 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:10:36.068337 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:36.068337 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:10:36.068337 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 634/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:36.072905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce353e-27a1-433f-b521-2331bb485950 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:36.178850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce353e-27a1-433f-b521-2331bb485950 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:36.211333 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452c070-3107-4d9c-818a-0f35623186f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:36.212030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452c070-3107-4d9c-818a-0f35623186f2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:36.212309 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452c070-3107-4d9c-818a-0f35623186f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:36.212580 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452c070-3107-4d9c-818a-0f35623186f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:36.213215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452c070-3107-4d9c-818a-0f35623186f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:36.213516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452c070-3107-4d9c-818a-0f35623186f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:36.214894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452c070-3107-4d9c-818a-0f35623186f2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:36.226180 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 636/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:36.232112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a0896-efbb-4815-bfad-2fcdf457a063 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:36.262369 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:36.328311 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a0896-efbb-4815-bfad-2fcdf457a063 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:36.360429 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603fb4e-002c-42a8-a203-d6a884761d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:36.361031 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603fb4e-002c-42a8-a203-d6a884761d6c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:36.361333 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603fb4e-002c-42a8-a203-d6a884761d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:36.361601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603fb4e-002c-42a8-a203-d6a884761d6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:36.367937 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603fb4e-002c-42a8-a203-d6a884761d6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:36.369355 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603fb4e-002c-42a8-a203-d6a884761d6c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:36.380712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-3603fb4e-002c-42a8-a203-d6a884761d6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:10:36.380712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:36.380712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:36.380712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:36.380712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:36.380712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:36.380712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:36.380712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:36.380712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:36.380712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:36.380712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:36.380712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:36.380712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:10:36.380712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:10:36.380712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:10:36.381774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:10:36.381774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:36.381774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:36.381774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:36.381774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:36.381774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:36.381774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:36.381774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:36.381774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:36.381774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:36.381774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:36.381774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:36.381774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:36.381774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:36.381774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:36.381774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:36.381774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:36.383189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:10:36.383189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:10:36.383189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:10:36.383189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:10:36.383189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:10:36.383189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:10:36.383189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:10:36.383189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:10:36.383189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 635/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:10:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:36.387428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452c070-3107-4d9c-818a-0f35623186f2 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:36.444530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:36.486056 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452c070-3107-4d9c-818a-0f35623186f2 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:36.519932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f413be-fa60-4b8f-ae41-088facaadffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:36.520547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f413be-fa60-4b8f-ae41-088facaadffd None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:36.520826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f413be-fa60-4b8f-ae41-088facaadffd None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:36.521099 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f413be-fa60-4b8f-ae41-088facaadffd None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:36.521801 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f413be-fa60-4b8f-ae41-088facaadffd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:36.522105 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f413be-fa60-4b8f-ae41-088facaadffd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:36.523569 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f413be-fa60-4b8f-ae41-088facaadffd None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:36.536030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 637/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:10:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:36.542212 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603fb4e-002c-42a8-a203-d6a884761d6c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:36.628461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:36.637485 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603fb4e-002c-42a8-a203-d6a884761d6c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:36.670055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e630a62-bb57-4862-a1b2-750786363f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:36.670711 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e630a62-bb57-4862-a1b2-750786363f75 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:36.671019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e630a62-bb57-4862-a1b2-750786363f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:36.671299 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e630a62-bb57-4862-a1b2-750786363f75 None admin] PATH_INFO: `/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/efd209a50a994b7c8485f2996697218b/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:36.673247 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e630a62-bb57-4862-a1b2-750786363f75 None admin] RBAC: Authorizing `identity:create_grant(project_id=37e7a8d1446d4cdea0ba00124411cd93, user_id=efd209a50a994b7c8485f2996697218b, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:36.675402 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e630a62-bb57-4862-a1b2-750786363f75 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:36.688802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 636/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 27 04:10:36 2022] PUT /identity/v3/projects/37e7a8d1446d4cdea0ba00124411cd93/users/efd209a50a994b7c8485f2996697218b/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:10:38.817818 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62684fa2-1d4c-4ff1-82d2-663a9cd0f6f3 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:38.818348 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62684fa2-1d4c-4ff1-82d2-663a9cd0f6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:38.818468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62684fa2-1d4c-4ff1-82d2-663a9cd0f6f3 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:38.819752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 638/1274] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:10:38.824967 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dc51c-a60b-4a11-a2cd-bcabe72836f9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:38.825386 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dc51c-a60b-4a11-a2cd-bcabe72836f9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:38.825517 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dc51c-a60b-4a11-a2cd-bcabe72836f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:38.843189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-df9dc51c-a60b-4a11-a2cd-bcabe72836f9 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:10:38.844354 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-df9dc51c-a60b-4a11-a2cd-bcabe72836f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:10:38.909390 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 637/1275] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:10:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:10:39.179779 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62684fa2-1d4c-4ff1-82d2-663a9cd0f6f3 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:39.286465 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62684fa2-1d4c-4ff1-82d2-663a9cd0f6f3 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:39.303021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:39.319836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88077c5-57eb-42d7-b103-011e48c50073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:39.320453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88077c5-57eb-42d7-b103-011e48c50073 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:39.320733 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88077c5-57eb-42d7-b103-011e48c50073 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:39.321007 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88077c5-57eb-42d7-b103-011e48c50073 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:39.331429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88077c5-57eb-42d7-b103-011e48c50073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:10:39.336181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-c88077c5-57eb-42d7-b103-011e48c50073 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:10:39.336181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:39.336181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:39.336181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:39.336181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:39.336181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:39.336181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:39.336181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:39.336181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:39.336181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:39.336181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:39.336181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:39.336181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 04:10:39.336181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 04:10:39.336181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 04:10:39.336181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 04:10:39.337258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 04:10:39.337258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 04:10:39.337258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 04:10:39.337258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 04:10:39.337258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:39.337258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:39.337258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:39.337258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:39.337258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:39.337258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:39.337258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:39.337258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:39.337258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:39.337258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:39.337258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:39.337258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:39.338474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:39.338474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:39.338474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:39.338474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:39.338474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 04:10:39.338474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 04:10:39.338474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 04:10:39.338474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 04:10:39.338474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 04:10:39.338474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 04:10:39.338474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:10:39.338474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:39.338474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 639/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 27 04:10:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:10:39.343328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dc51c-a60b-4a11-a2cd-bcabe72836f9 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:39.423407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:39.442343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dc51c-a60b-4a11-a2cd-bcabe72836f9 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:39.474624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e22875-78ce-453e-87c6-76667bc3cf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:39.475256 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e22875-78ce-453e-87c6-76667bc3cf5e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:39.475536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e22875-78ce-453e-87c6-76667bc3cf5e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:39.475814 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e22875-78ce-453e-87c6-76667bc3cf5e None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:39.476475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e22875-78ce-453e-87c6-76667bc3cf5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:39.476782 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e22875-78ce-453e-87c6-76667bc3cf5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:39.478141 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e22875-78ce-453e-87c6-76667bc3cf5e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:39.486070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 638/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 27 04:10:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:39.491948 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88077c5-57eb-42d7-b103-011e48c50073 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:39.587927 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88077c5-57eb-42d7-b103-011e48c50073 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:39.620117 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d21b23-f1c5-43a7-bc39-75c25a9dadbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:39.620737 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d21b23-f1c5-43a7-bc39-75c25a9dadbe None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:39.621019 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d21b23-f1c5-43a7-bc39-75c25a9dadbe None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:39.621324 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d21b23-f1c5-43a7-bc39-75c25a9dadbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:39.631462 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d21b23-f1c5-43a7-bc39-75c25a9dadbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:39.632899 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d21b23-f1c5-43a7-bc39-75c25a9dadbe None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:39.648169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-b4d21b23-f1c5-43a7-bc39-75c25a9dadbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:39.648169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:39.648169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:39.648169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:39.648169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:39.648169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:39.648169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:39.648169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:39.648169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:39.648169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:39.648169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:39.648169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:39.648169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:10:39.648169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:10:39.648169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:10:39.648169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:10:39.649388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:39.649388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:39.649388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:39.649388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:39.649388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:39.649388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:39.649388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:39.649388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:39.649388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:39.649388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:39.649388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:39.649388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:39.649388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:39.649388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:39.649388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:39.649388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:39.649388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:10:39.650534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:10:39.650534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:39.650534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:39.650534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 640/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:39.654824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e22875-78ce-453e-87c6-76667bc3cf5e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:39.750444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e22875-78ce-453e-87c6-76667bc3cf5e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:39.782142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5879f-9df9-426c-93f9-5a117f0822f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:39.782757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5879f-9df9-426c-93f9-5a117f0822f7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:39.783062 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5879f-9df9-426c-93f9-5a117f0822f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:39.783340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5879f-9df9-426c-93f9-5a117f0822f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:39.783980 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5879f-9df9-426c-93f9-5a117f0822f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:39.784289 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5879f-9df9-426c-93f9-5a117f0822f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:39.785644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5879f-9df9-426c-93f9-5a117f0822f7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:39.796723 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 639/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:39.802706 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d21b23-f1c5-43a7-bc39-75c25a9dadbe None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:39.832858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:39.902078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d21b23-f1c5-43a7-bc39-75c25a9dadbe None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:39.934404 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745578a-de98-4657-89a9-0d0e78c140cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:39.935051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745578a-de98-4657-89a9-0d0e78c140cc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:39.935338 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745578a-de98-4657-89a9-0d0e78c140cc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:39.935612 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745578a-de98-4657-89a9-0d0e78c140cc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:39.943312 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745578a-de98-4657-89a9-0d0e78c140cc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:39.944751 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745578a-de98-4657-89a9-0d0e78c140cc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:39.955572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-c745578a-de98-4657-89a9-0d0e78c140cc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 04:10:39.955572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:39.955572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:39.955572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:39.955572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:39.955572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:39.955572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:39.955572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:39.955572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:39.955572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:39.955572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:39.955572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:39.955572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 04:10:39.955572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 04:10:39.955572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 04:10:39.955572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 04:10:39.956676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:39.956676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:39.956676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 04:10:39.956676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:10:39.956676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 04:10:39.956676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 04:10:39.956676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:39.956676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:39.956676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:39.956676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:39.956676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:39.956676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:39.956676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:39.956676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:39.956676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:39.956676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:39.956676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:39.956676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:39.957869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:39.957869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:39.957869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 04:10:39.957869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 04:10:39.957869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 04:10:39.957869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 04:10:39.957869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 04:10:39.957869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 04:10:39.957869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 04:10:39.957869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:39.957869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 641/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:39.962535 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5879f-9df9-426c-93f9-5a117f0822f7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:39.966233 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:40.059183 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5879f-9df9-426c-93f9-5a117f0822f7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:40.091994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce85571-825b-492a-bd75-7101a0136673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:40.092596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce85571-825b-492a-bd75-7101a0136673 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:40.092878 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce85571-825b-492a-bd75-7101a0136673 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:40.093156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce85571-825b-492a-bd75-7101a0136673 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:40.093880 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce85571-825b-492a-bd75-7101a0136673 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:40.094191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce85571-825b-492a-bd75-7101a0136673 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:40.096167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce85571-825b-492a-bd75-7101a0136673 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:40.112870 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 640/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Sep 27 04:10:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:40.119155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745578a-de98-4657-89a9-0d0e78c140cc None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:40.211370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:40.221545 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745578a-de98-4657-89a9-0d0e78c140cc None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:40.254162 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa77eb-5280-43cd-bf2a-0e3c660eb9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:40.254779 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa77eb-5280-43cd-bf2a-0e3c660eb9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:40.255067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa77eb-5280-43cd-bf2a-0e3c660eb9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:40.255345 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa77eb-5280-43cd-bf2a-0e3c660eb9d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:40.319426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa77eb-5280-43cd-bf2a-0e3c660eb9d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:40.320811 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa77eb-5280-43cd-bf2a-0e3c660eb9d1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:40.405892 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:40.416697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 642/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 27 04:10:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 04:10:40.422620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce85571-825b-492a-bd75-7101a0136673 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:40.481183 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:40.519034 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce85571-825b-492a-bd75-7101a0136673 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:40.551391 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40296c-864c-404c-9908-d9396f8a81e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:40.552006 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40296c-864c-404c-9908-d9396f8a81e4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:40.552287 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40296c-864c-404c-9908-d9396f8a81e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:40.552560 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40296c-864c-404c-9908-d9396f8a81e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:40.562110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40296c-864c-404c-9908-d9396f8a81e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:40.563586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40296c-864c-404c-9908-d9396f8a81e4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:40.578136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-6a40296c-864c-404c-9908-d9396f8a81e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:40.578136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:40.578136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:40.578136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:40.578136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:40.578136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:40.578136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:40.578136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:40.578136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:40.578136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:40.578136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:40.578136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:40.578136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 04:10:40.578136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 04:10:40.578136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 04:10:40.578136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 04:10:40.579288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:40.579288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:40.579288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:40.579288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:40.579288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:40.579288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:40.579288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:40.579288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:40.579288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:40.579288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:40.579288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:40.579288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:40.579288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:40.579288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:40.579288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:40.579288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:40.579288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 04:10:40.580460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 04:10:40.580460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:10:40.580460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:10:40.580460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 641/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:40.585135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa77eb-5280-43cd-bf2a-0e3c660eb9d1 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:40.679835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa77eb-5280-43cd-bf2a-0e3c660eb9d1 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:40.712061 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4cd66-3a1c-48d6-947e-57524cecc6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:40.712649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4cd66-3a1c-48d6-947e-57524cecc6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:40.712927 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4cd66-3a1c-48d6-947e-57524cecc6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:40.713202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4cd66-3a1c-48d6-947e-57524cecc6c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:40.713835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4cd66-3a1c-48d6-947e-57524cecc6c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:40.714136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4cd66-3a1c-48d6-947e-57524cecc6c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:40.715523 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4cd66-3a1c-48d6-947e-57524cecc6c4 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:40.726377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 643/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 27 04:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:40.732074 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40296c-864c-404c-9908-d9396f8a81e4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:40.827507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40296c-864c-404c-9908-d9396f8a81e4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:40.840277 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:40.860351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfa5e0-9f25-4763-a3ff-3a0fabce21f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:40.860971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfa5e0-9f25-4763-a3ff-3a0fabce21f1 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:40.861865 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfa5e0-9f25-4763-a3ff-3a0fabce21f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:40.862146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfa5e0-9f25-4763-a3ff-3a0fabce21f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:40.868466 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfa5e0-9f25-4763-a3ff-3a0fabce21f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:40.869895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfa5e0-9f25-4763-a3ff-3a0fabce21f1 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:40.880749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-eddfa5e0-9f25-4763-a3ff-3a0fabce21f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:10:40.880749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:40.880749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:40.880749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:40.880749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:40.880749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:40.880749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:40.880749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:40.880749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:40.880749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:40.880749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:40.880749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:40.880749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 04:10:40.880749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 04:10:40.880749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 04:10:40.881765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 04:10:40.881765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:40.881765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:40.881765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:40.881765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:40.881765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:40.881765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:40.881765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:40.881765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:40.881765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:40.881765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:40.881765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:40.881765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:40.881765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:40.881765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:40.881765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:40.881765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:40.883013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 04:10:40.883013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 04:10:40.883013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 04:10:40.883013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 04:10:40.883013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 04:10:40.883013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 04:10:40.883013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:10:40.883013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 27 04:10:40.883013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 642/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 27 04:10:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:40.887596 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4cd66-3a1c-48d6-947e-57524cecc6c4 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:40.935713 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:40.985634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4cd66-3a1c-48d6-947e-57524cecc6c4 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:41.017997 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e5980-f657-48ba-967c-f941def756f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:41.018593 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e5980-f657-48ba-967c-f941def756f4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:41.018908 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e5980-f657-48ba-967c-f941def756f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:41.019188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e5980-f657-48ba-967c-f941def756f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:41.019881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e5980-f657-48ba-967c-f941def756f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:41.020193 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e5980-f657-48ba-967c-f941def756f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:41.021620 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e5980-f657-48ba-967c-f941def756f4 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:41.033640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 644/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 27 04:10:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:10:41.039560 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfa5e0-9f25-4763-a3ff-3a0fabce21f1 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:41.137771 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfa5e0-9f25-4763-a3ff-3a0fabce21f1 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:41.170385 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9d1a6-51a0-4a4c-afb8-7e9deb8e1098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:41.171007 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9d1a6-51a0-4a4c-afb8-7e9deb8e1098 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:41.171292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9d1a6-51a0-4a4c-afb8-7e9deb8e1098 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:41.171568 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9d1a6-51a0-4a4c-afb8-7e9deb8e1098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:41.172297 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9d1a6-51a0-4a4c-afb8-7e9deb8e1098 None admin] RBAC: Adding query filter params (role.id=2613cf4a98d44744a094c7782b19b4b5, scope.project.id=37e7a8d1446d4cdea0ba00124411cd93, user.id=efd209a50a994b7c8485f2996697218b) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:41.172609 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9d1a6-51a0-4a4c-afb8-7e9deb8e1098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:41.174031 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9d1a6-51a0-4a4c-afb8-7e9deb8e1098 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:41.179593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 643/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 27 04:10:41 2022] GET /identity/v3/role_assignments?user.id=efd209a50a994b7c8485f2996697218b&scope.project.id=37e7a8d1446d4cdea0ba00124411cd93&role.id=2613cf4a98d44744a094c7782b19b4b5 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:43.323290 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a346a7-9e47-46e7-b8e1-bba125ade279 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:43.323859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a346a7-9e47-46e7-b8e1-bba125ade279 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:43.323859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a346a7-9e47-46e7-b8e1-bba125ade279 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:43.325182 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 645/1288] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:10:43.330449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58940ecd-92e9-453d-9378-7341d1d179da None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:43.330872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58940ecd-92e9-453d-9378-7341d1d179da None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:43.331027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58940ecd-92e9-453d-9378-7341d1d179da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:43.349055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-58940ecd-92e9-453d-9378-7341d1d179da None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:10:43.350221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-58940ecd-92e9-453d-9378-7341d1d179da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:10:43.378685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:43.415556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 644/1289] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:10:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:10:43.682075 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a346a7-9e47-46e7-b8e1-bba125ade279 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:43.779745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a346a7-9e47-46e7-b8e1-bba125ade279 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:43.790486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:43.813393 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda4870-345f-4d39-aea8-337aeeebf7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:43.814005 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda4870-345f-4d39-aea8-337aeeebf7ad None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:43.814829 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda4870-345f-4d39-aea8-337aeeebf7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:43.815103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda4870-345f-4d39-aea8-337aeeebf7ad None admin] PATH_INFO: `/v3/services/placement` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:43.815681 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda4870-345f-4d39-aea8-337aeeebf7ad None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:43.817033 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda4870-345f-4d39-aea8-337aeeebf7ad None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:43.825472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-5dda4870-345f-4d39-aea8-337aeeebf7ad None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 04:10:43.825472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:43.825472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:10:43.825472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:10:43.825472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:10:43.825472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:10:43.825472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:10:43.825472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:10:43.825472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 04:10:43.825472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:43.825472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:10:43.825472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:43.825472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:43.825472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:43.825472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:43.825472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:43.825472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:43.826813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:43.826813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:43.826813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:43.826813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:43.826813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:43.826813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:43.826813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:10:43.826813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:10:43.826813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:10:43.826813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:10:43.826813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:43.826813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:43.826813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:43.826813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:43.826813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:43.826813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:43.827978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:43.827978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:43.827978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:43.827978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:43.827978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:43.827978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:43.827978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:43.827978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:43.827978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:43.827978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:43.827978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:10:43.827978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:10:43.827978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 04:10:43.827978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:43.827978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 646/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 27 04:10:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:43.833093 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58940ecd-92e9-453d-9378-7341d1d179da None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:43.928560 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58940ecd-92e9-453d-9378-7341d1d179da None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:43.961441 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b549ec4-0d50-4006-b7af-3a4cfd175154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:43.961972 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b549ec4-0d50-4006-b7af-3a4cfd175154 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:43.962254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b549ec4-0d50-4006-b7af-3a4cfd175154 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:43.962530 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b549ec4-0d50-4006-b7af-3a4cfd175154 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:43.963187 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b549ec4-0d50-4006-b7af-3a4cfd175154 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:43.963492 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b549ec4-0d50-4006-b7af-3a4cfd175154 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:43.964851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b549ec4-0d50-4006-b7af-3a4cfd175154 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:43.969437 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 645/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Sep 27 04:10:43 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:43.975330 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda4870-345f-4d39-aea8-337aeeebf7ad None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:44.070390 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda4870-345f-4d39-aea8-337aeeebf7ad None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:44.102016 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2352cf-909f-4fb1-978d-11725d164847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:44.102598 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2352cf-909f-4fb1-978d-11725d164847 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:44.102905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2352cf-909f-4fb1-978d-11725d164847 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:44.103179 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2352cf-909f-4fb1-978d-11725d164847 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:44.103797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2352cf-909f-4fb1-978d-11725d164847 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:44.104096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2352cf-909f-4fb1-978d-11725d164847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:44.105452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2352cf-909f-4fb1-978d-11725d164847 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:44.109881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 647/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Sep 27 04:10:43 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:46.243163 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c63cc-9fdb-4c5d-912b-c99d381d0e10 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:46.243721 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c63cc-9fdb-4c5d-912b-c99d381d0e10 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:46.243721 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c63cc-9fdb-4c5d-912b-c99d381d0e10 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:46.245027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 646/1293] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:10:46.250223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4955ee-4075-4ebe-8e36-4d5f15862855 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:46.250620 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4955ee-4075-4ebe-8e36-4d5f15862855 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:46.250799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4955ee-4075-4ebe-8e36-4d5f15862855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:46.269446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1c4955ee-4075-4ebe-8e36-4d5f15862855 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:10:46.270620 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1c4955ee-4075-4ebe-8e36-4d5f15862855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:10:46.298404 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:46.334484 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 648/1294] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:10:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:10:46.600022 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c63cc-9fdb-4c5d-912b-c99d381d0e10 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:46.629744 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:46.697870 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c63cc-9fdb-4c5d-912b-c99d381d0e10 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:46.731170 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa70a5-9412-4831-8623-924c19138651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:46.732026 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa70a5-9412-4831-8623-924c19138651 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:46.732311 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa70a5-9412-4831-8623-924c19138651 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:46.732589 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa70a5-9412-4831-8623-924c19138651 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:46.733234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa70a5-9412-4831-8623-924c19138651 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:46.734598 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa70a5-9412-4831-8623-924c19138651 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:46.748347 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 647/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 27 04:10:46 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:10:48.859371 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019a4d0-2705-43f1-ab4f-defd99477f8d None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:48.859902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019a4d0-2705-43f1-ab4f-defd99477f8d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:48.859902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019a4d0-2705-43f1-ab4f-defd99477f8d None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:48.861280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 649/1296] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:10:48.866353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235ce3d-a0ee-45c8-ab31-7d4d9cd94f6f None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:48.866813 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235ce3d-a0ee-45c8-ab31-7d4d9cd94f6f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:48.866941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235ce3d-a0ee-45c8-ab31-7d4d9cd94f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:48.884691 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-a235ce3d-a0ee-45c8-ab31-7d4d9cd94f6f None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:10:48.885896 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a235ce3d-a0ee-45c8-ab31-7d4d9cd94f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:10:48.960267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 648/1297] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:10:48 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:10:49.237238 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019a4d0-2705-43f1-ab4f-defd99477f8d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:49.338984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019a4d0-2705-43f1-ab4f-defd99477f8d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:49.371602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2520e9f-e752-4eff-b88f-29311ffc5ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:49.372221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2520e9f-e752-4eff-b88f-29311ffc5ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:49.372504 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2520e9f-e752-4eff-b88f-29311ffc5ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:49.372780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2520e9f-e752-4eff-b88f-29311ffc5ad4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:49.373365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2520e9f-e752-4eff-b88f-29311ffc5ad4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:49.374763 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2520e9f-e752-4eff-b88f-29311ffc5ad4 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:49.383889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-d2520e9f-e752-4eff-b88f-29311ffc5ad4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 04:10:49.383889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:49.383889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:10:49.383889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:10:49.383889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:10:49.383889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:10:49.383889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:10:49.383889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:10:49.383889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 04:10:49.383889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:49.383889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:10:49.383889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:49.383889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:49.383889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:49.383889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:49.383889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:49.383889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:49.385071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:49.385071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:49.385071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:49.385071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:49.385071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:49.385071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:49.385071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:10:49.385071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:10:49.385071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:10:49.385071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:10:49.385071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:49.385071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:49.385071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:49.385071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:49.385071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:49.385071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:49.386128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:49.386128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:49.386128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:49.386128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:49.386128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:49.386128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:49.386128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:49.386128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:49.386128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:49.386128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:49.386128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:10:49.386128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:10:49.386128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 04:10:49.386128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:49.386128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 650/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 27 04:10:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:10:49.391179 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235ce3d-a0ee-45c8-ab31-7d4d9cd94f6f None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:49.409412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:49.487746 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235ce3d-a0ee-45c8-ab31-7d4d9cd94f6f None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:49.519987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6cf9d-478e-448f-abc7-846cf8eb974f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:49.520576 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6cf9d-478e-448f-abc7-846cf8eb974f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:49.520859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6cf9d-478e-448f-abc7-846cf8eb974f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:49.521135 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6cf9d-478e-448f-abc7-846cf8eb974f None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:49.521763 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6cf9d-478e-448f-abc7-846cf8eb974f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:49.522069 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6cf9d-478e-448f-abc7-846cf8eb974f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:49.523461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6cf9d-478e-448f-abc7-846cf8eb974f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:49.528324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 649/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Sep 27 04:10:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:49.534251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2520e9f-e752-4eff-b88f-29311ffc5ad4 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:49.565608 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:49.632503 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2520e9f-e752-4eff-b88f-29311ffc5ad4 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:49.664334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a54de6-74d1-4f74-acd8-55e9aeb7fea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:49.664928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a54de6-74d1-4f74-acd8-55e9aeb7fea9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:49.665212 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a54de6-74d1-4f74-acd8-55e9aeb7fea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:49.665491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a54de6-74d1-4f74-acd8-55e9aeb7fea9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:49.666198 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a54de6-74d1-4f74-acd8-55e9aeb7fea9 None admin] RBAC: Adding query filter params (interface=public, service_id=a55885ac08dd4a8aa54f1a8479e6ce8d, region_id=RegionOne) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:49.666511 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a54de6-74d1-4f74-acd8-55e9aeb7fea9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:49.668052 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a54de6-74d1-4f74-acd8-55e9aeb7fea9 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:49.672933 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 651/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 27 04:10:49 2022] GET /identity/v3/endpoints?service_id=a55885ac08dd4a8aa54f1a8479e6ce8d&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:49.679206 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6cf9d-478e-448f-abc7-846cf8eb974f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:49.759323 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:49.777135 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6cf9d-478e-448f-abc7-846cf8eb974f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:49.809576 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76341d31-ce58-4794-a974-82493948ef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:49.810177 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76341d31-ce58-4794-a974-82493948ef81 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:49.810457 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76341d31-ce58-4794-a974-82493948ef81 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:49.810751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76341d31-ce58-4794-a974-82493948ef81 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:49.811359 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76341d31-ce58-4794-a974-82493948ef81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:49.812712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76341d31-ce58-4794-a974-82493948ef81 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:49.819231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 650/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 27 04:10:49 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:10:51.955780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9ac31-fc54-4e11-968c-3dc9071af1ad None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:51.956312 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9ac31-fc54-4e11-968c-3dc9071af1ad None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:51.956312 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9ac31-fc54-4e11-968c-3dc9071af1ad None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:51.957663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 652/1302] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:10:51.962685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbde86f-640f-4885-9bac-1b7bd806862b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:51.963114 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbde86f-640f-4885-9bac-1b7bd806862b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:51.963273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbde86f-640f-4885-9bac-1b7bd806862b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:51.980886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0cbde86f-640f-4885-9bac-1b7bd806862b None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:10:51.982317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0cbde86f-640f-4885-9bac-1b7bd806862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:10:52.045869 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 651/1303] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:10:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:10:52.322683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9ac31-fc54-4e11-968c-3dc9071af1ad None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:52.415588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:52.422698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9ac31-fc54-4e11-968c-3dc9071af1ad None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:52.454645 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235abf7f-0110-44ea-9e95-1e23ad802f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:52.455792 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235abf7f-0110-44ea-9e95-1e23ad802f47 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:52.461262 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235abf7f-0110-44ea-9e95-1e23ad802f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:52.461262 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235abf7f-0110-44ea-9e95-1e23ad802f47 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:52.461262 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235abf7f-0110-44ea-9e95-1e23ad802f47 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:52.461262 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235abf7f-0110-44ea-9e95-1e23ad802f47 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:52.468693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-235abf7f-0110-44ea-9e95-1e23ad802f47 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 04:10:52.468693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:52.468693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 04:10:52.468693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 04:10:52.468693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 04:10:52.468693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 04:10:52.468693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 04:10:52.468693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:10:52.468693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 04:10:52.468693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:52.468693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 04:10:52.468693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:52.468693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 04:10:52.468693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 04:10:52.468693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 04:10:52.468693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 04:10:52.468693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 04:10:52.469884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 04:10:52.469884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 04:10:52.469884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 04:10:52.469884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 04:10:52.469884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 04:10:52.469884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 04:10:52.469884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 04:10:52.469884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 04:10:52.469884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 04:10:52.469884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 04:10:52.469884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 04:10:52.469884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 04:10:52.469884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 04:10:52.469884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 04:10:52.469884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 04:10:52.469884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 04:10:52.471439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 04:10:52.471439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 27 04:10:52.471439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 04:10:52.471439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 27 04:10:52.471439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 04:10:52.471439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 04:10:52.471439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 04:10:52.471439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 27 04:10:52.471439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 04:10:52.471439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 27 04:10:52.471439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 04:10:52.471439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 04:10:52.471439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 04:10:52.471439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 27 04:10:52.471439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 653/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 27 04:10:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:10:52.478109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbde86f-640f-4885-9bac-1b7bd806862b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:52.551812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:10:52.573577 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbde86f-640f-4885-9bac-1b7bd806862b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:52.606173 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8443be-fba5-4473-b17b-ac157a91cafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:52.607038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8443be-fba5-4473-b17b-ac157a91cafc None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:52.607316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8443be-fba5-4473-b17b-ac157a91cafc None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:52.607590 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8443be-fba5-4473-b17b-ac157a91cafc None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:52.608213 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8443be-fba5-4473-b17b-ac157a91cafc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:10:52.608515 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8443be-fba5-4473-b17b-ac157a91cafc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:52.609876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8443be-fba5-4473-b17b-ac157a91cafc None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:52.614786 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 652/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Sep 27 04:10:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:10:52.620533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235abf7f-0110-44ea-9e95-1e23ad802f47 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:10:52.715974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235abf7f-0110-44ea-9e95-1e23ad802f47 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:10:52.748523 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f869c6d-345f-4661-9e9f-f334c5191c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:10:52.749111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f869c6d-345f-4661-9e9f-f334c5191c72 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:10:52.749390 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f869c6d-345f-4661-9e9f-f334c5191c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:10:52.749661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f869c6d-345f-4661-9e9f-f334c5191c72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:10:52.750339 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f869c6d-345f-4661-9e9f-f334c5191c72 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:10:52.751748 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f869c6d-345f-4661-9e9f-f334c5191c72 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:10:52.770910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 654/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:10:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:11:02.611982 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=30 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:11:02.766502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:11:56.657905 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993af4d2-454f-485a-ac70-12afdfb96146 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:11:56.661231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993af4d2-454f-485a-ac70-12afdfb96146 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:11:56.661769 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993af4d2-454f-485a-ac70-12afdfb96146 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:11:56.663875 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 653/1307] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:11:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:11:56.669431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53e94c-228c-41c7-97f5-4737c8cb2770 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:11:56.669895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53e94c-228c-41c7-97f5-4737c8cb2770 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:11:56.669979 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53e94c-228c-41c7-97f5-4737c8cb2770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:11:56.748377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9e53e94c-228c-41c7-97f5-4737c8cb2770 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:11:56.750044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9e53e94c-228c-41c7-97f5-4737c8cb2770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:11:56.889877 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 655/1308] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:11:57.200365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1716936-4b35-4672-9817-c683433072ff None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:11:57.201040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1716936-4b35-4672-9817-c683433072ff None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:11:57.201520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1716936-4b35-4672-9817-c683433072ff None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:11:57.203678 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 654/1309] 10.222.0.48 () {54 vars in 964 bytes} [Tue Sep 27 04:11:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:11:57.209728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5f4f6-a14f-45d7-9901-6f175001a4fa None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:11:57.210366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5f4f6-a14f-45d7-9901-6f175001a4fa None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:11:57.210948 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5f4f6-a14f-45d7-9901-6f175001a4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:11:57.296986 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8ba5f4f6-a14f-45d7-9901-6f175001a4fa None None] MFA Rules not processed for user `e94f9a63cb4847c6916a84735d00b48f`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:11:57.298827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8ba5f4f6-a14f-45d7-9901-6f175001a4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:11:57.321635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:11:57.385777 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 656/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Tue Sep 27 04:11:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:11:57.395221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1716936-4b35-4672-9817-c683433072ff None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:11:57.397530 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c1716936-4b35-4672-9817-c683433072ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:11:57.544229 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1716936-4b35-4672-9817-c683433072ff None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:11:57.652671 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b7567-5f8e-40ed-92e0-09417e9e03f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:11:57.653292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b7567-5f8e-40ed-92e0-09417e9e03f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:11:57.653572 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b7567-5f8e-40ed-92e0-09417e9e03f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:11:57.653844 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b7567-5f8e-40ed-92e0-09417e9e03f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:11:57.655723 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-643b7567-5f8e-40ed-92e0-09417e9e03f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:11:57.726689 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:11:57.792875 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b7567-5f8e-40ed-92e0-09417e9e03f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:11:57.794364 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b7567-5f8e-40ed-92e0-09417e9e03f5 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:11:57.815508 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 655/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:12:00.279014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5558b-bedd-4927-911d-fb587c7bbaf3 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:00.279612 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5558b-bedd-4927-911d-fb587c7bbaf3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:00.279612 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5558b-bedd-4927-911d-fb587c7bbaf3 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:00.281070 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 657/1312] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:12:00.286465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9217268-5719-4c8d-9435-5ee8c567451a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:00.287063 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9217268-5719-4c8d-9435-5ee8c567451a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:00.287063 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9217268-5719-4c8d-9435-5ee8c567451a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:00.367630 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c9217268-5719-4c8d-9435-5ee8c567451a None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:00.368822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c9217268-5719-4c8d-9435-5ee8c567451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:00.467592 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 656/1313] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:12:00.752652 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5558b-bedd-4927-911d-fb587c7bbaf3 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:12:00.754169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a7c5558b-bedd-4927-911d-fb587c7bbaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:00.855056 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5558b-bedd-4927-911d-fb587c7bbaf3 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:12:00.925620 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:00.927942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2158c0f-5414-427c-9548-dcd0d2819e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:12:00.928766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2158c0f-5414-427c-9548-dcd0d2819e3d service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:00.929220 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2158c0f-5414-427c-9548-dcd0d2819e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:00.929684 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2158c0f-5414-427c-9548-dcd0d2819e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:00.931341 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f2158c0f-5414-427c-9548-dcd0d2819e3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:01.039766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2158c0f-5414-427c-9548-dcd0d2819e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:12:01.041109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2158c0f-5414-427c-9548-dcd0d2819e3d service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:12:01.059412 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 658/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:12:03.511769 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143c7e0-d5e6-49d3-92ef-713637f54690 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:03.512315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143c7e0-d5e6-49d3-92ef-713637f54690 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:03.512315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143c7e0-d5e6-49d3-92ef-713637f54690 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:03.513655 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 657/1315] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:12:03.518832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a555524-1ccb-4e9c-aaf3-2c1387016a34 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:03.519213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a555524-1ccb-4e9c-aaf3-2c1387016a34 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:03.519382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a555524-1ccb-4e9c-aaf3-2c1387016a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:03.586930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5a555524-1ccb-4e9c-aaf3-2c1387016a34 None None] MFA Rules not processed for user `90a852f3923340a1a1dbce5574e80268`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:03.588150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5a555524-1ccb-4e9c-aaf3-2c1387016a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:03.640373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:03.683660 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 659/1316] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:12:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:12:03.972801 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143c7e0-d5e6-49d3-92ef-713637f54690 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:12:03.974350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2143c7e0-d5e6-49d3-92ef-713637f54690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:03.985364 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:04.076751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143c7e0-d5e6-49d3-92ef-713637f54690 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:12:04.151135 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199eb909-bbc8-481e-8848-442468d2bd66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:12:04.151738 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199eb909-bbc8-481e-8848-442468d2bd66 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:04.152018 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199eb909-bbc8-481e-8848-442468d2bd66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:04.152290 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199eb909-bbc8-481e-8848-442468d2bd66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:04.153943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-199eb909-bbc8-481e-8848-442468d2bd66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:04.213962 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:04.259727 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199eb909-bbc8-481e-8848-442468d2bd66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:12:04.261093 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199eb909-bbc8-481e-8848-442468d2bd66 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:12:04.279381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 658/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:12:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:12:06.937539 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37a21a-4b60-4643-a08f-2bd8e95799e2 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:06.938103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37a21a-4b60-4643-a08f-2bd8e95799e2 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:06.938103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37a21a-4b60-4643-a08f-2bd8e95799e2 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:06.939967 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 660/1318] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:12:06.945188 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd401d5-d4a2-4d15-8f13-fd031b8e79fd None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:06.945601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd401d5-d4a2-4d15-8f13-fd031b8e79fd None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:06.945771 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd401d5-d4a2-4d15-8f13-fd031b8e79fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:07.015629 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-4cd401d5-d4a2-4d15-8f13-fd031b8e79fd None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:07.016837 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4cd401d5-d4a2-4d15-8f13-fd031b8e79fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:07.110338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 659/1319] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:12:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:12:07.413195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d234593-12be-4630-8c96-6a63dede4de2 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:07.413486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d234593-12be-4630-8c96-6a63dede4de2 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:07.413764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d234593-12be-4630-8c96-6a63dede4de2 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:07.415223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 661/1320] 10.222.0.48 () {54 vars in 964 bytes} [Tue Sep 27 04:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:12:07.420999 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa5fbd-40a4-46af-af5e-8552076059f6 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:07.421285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa5fbd-40a4-46af-af5e-8552076059f6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:07.421563 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa5fbd-40a4-46af-af5e-8552076059f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:07.444187 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:07.497615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-9bfa5fbd-40a4-46af-af5e-8552076059f6 None None] MFA Rules not processed for user `e94f9a63cb4847c6916a84735d00b48f`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:07.498833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9bfa5fbd-40a4-46af-af5e-8552076059f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:07.570575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 660/1321] 10.222.0.48 () {58 vars in 1061 bytes} [Tue Sep 27 04:12:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:12:07.579626 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d234593-12be-4630-8c96-6a63dede4de2 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:12:07.581382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9d234593-12be-4630-8c96-6a63dede4de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:07.697449 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d234593-12be-4630-8c96-6a63dede4de2 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:12:07.769006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d8832-deee-4953-9233-8e36a2b302c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:12:07.769602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d8832-deee-4953-9233-8e36a2b302c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:07.769881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d8832-deee-4953-9233-8e36a2b302c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:07.770147 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d8832-deee-4953-9233-8e36a2b302c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:07.771748 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c25d8832-deee-4953-9233-8e36a2b302c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:07.778454 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:07.877016 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d8832-deee-4953-9233-8e36a2b302c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:12:07.878455 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d8832-deee-4953-9233-8e36a2b302c7 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:12:07.896210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 662/1322] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:12:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:12:11.146257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9859ff4-51c9-4133-84bd-151a1d97bced None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:11.146819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9859ff4-51c9-4133-84bd-151a1d97bced None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:11.146936 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9859ff4-51c9-4133-84bd-151a1d97bced None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:11.148181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 661/1323] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:12:11.153444 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0f4aa-de5a-4a9c-9848-23d7f70e7fcf None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:11.153878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0f4aa-de5a-4a9c-9848-23d7f70e7fcf None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:11.154011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0f4aa-de5a-4a9c-9848-23d7f70e7fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:11.228003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-10b0f4aa-de5a-4a9c-9848-23d7f70e7fcf None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:11.229279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-10b0f4aa-de5a-4a9c-9848-23d7f70e7fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:11.291825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:11.334157 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 663/1324] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:12:11.620651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9859ff4-51c9-4133-84bd-151a1d97bced None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:12:11.622190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f9859ff4-51c9-4133-84bd-151a1d97bced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:11.728500 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9859ff4-51c9-4133-84bd-151a1d97bced None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:12:11.740793 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:11.801200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ec350-1889-4bee-a92e-09d69bd36774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:12:11.801809 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ec350-1889-4bee-a92e-09d69bd36774 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:11.802094 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ec350-1889-4bee-a92e-09d69bd36774 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:11.802377 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ec350-1889-4bee-a92e-09d69bd36774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:11.804003 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-482ec350-1889-4bee-a92e-09d69bd36774 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:11.911835 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ec350-1889-4bee-a92e-09d69bd36774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:12:11.913288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ec350-1889-4bee-a92e-09d69bd36774 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:12:11.930817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 662/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:12:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:12:14.128518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8838df-09f7-4bf6-95a9-5d8d143c4156 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:14.129076 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8838df-09f7-4bf6-95a9-5d8d143c4156 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:14.129076 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8838df-09f7-4bf6-95a9-5d8d143c4156 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:14.130400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 664/1326] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:12:14.135776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537b600-af1d-4abe-8a0a-14979c3e3d96 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:14.136198 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537b600-af1d-4abe-8a0a-14979c3e3d96 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:14.136377 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537b600-af1d-4abe-8a0a-14979c3e3d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:14.184396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:14.203253 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e537b600-af1d-4abe-8a0a-14979c3e3d96 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:14.204462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e537b600-af1d-4abe-8a0a-14979c3e3d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:14.303761 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 663/1327] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:12:14.580685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8838df-09f7-4bf6-95a9-5d8d143c4156 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:12:14.582272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3f8838df-09f7-4bf6-95a9-5d8d143c4156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:14.683921 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8838df-09f7-4bf6-95a9-5d8d143c4156 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:12:14.756438 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b302f3-6193-49bc-809b-5ec260d39de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:12:14.757045 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b302f3-6193-49bc-809b-5ec260d39de7 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:14.757327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b302f3-6193-49bc-809b-5ec260d39de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:14.757602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b302f3-6193-49bc-809b-5ec260d39de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:14.759223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b0b302f3-6193-49bc-809b-5ec260d39de7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:14.776288 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:14.870270 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b302f3-6193-49bc-809b-5ec260d39de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:12:14.871663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b302f3-6193-49bc-809b-5ec260d39de7 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:12:14.889406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 665/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:12:17.097254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d442b-b54d-49fc-bde2-2a113903bb5e None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:17.097741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d442b-b54d-49fc-bde2-2a113903bb5e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:17.097830 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d442b-b54d-49fc-bde2-2a113903bb5e None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:17.099271 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 664/1329] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:12:17.104558 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6396faa-69f3-4163-bdf0-9dd581fd65e5 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:17.104964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6396faa-69f3-4163-bdf0-9dd581fd65e5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:17.105114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6396faa-69f3-4163-bdf0-9dd581fd65e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:17.171097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f6396faa-69f3-4163-bdf0-9dd581fd65e5 None None] MFA Rules not processed for user `90a852f3923340a1a1dbce5574e80268`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:17.172327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f6396faa-69f3-4163-bdf0-9dd581fd65e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:17.239935 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:17.271008 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 666/1330] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:12:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:12:17.553405 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d442b-b54d-49fc-bde2-2a113903bb5e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:12:17.554993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3e2d442b-b54d-49fc-bde2-2a113903bb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:17.662864 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d442b-b54d-49fc-bde2-2a113903bb5e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:12:17.682694 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:17.735990 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c415c4b-1306-489d-9676-b925646cb65e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:12:17.736501 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c415c4b-1306-489d-9676-b925646cb65e service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:17.736779 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c415c4b-1306-489d-9676-b925646cb65e service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:17.737053 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c415c4b-1306-489d-9676-b925646cb65e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:17.738650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3c415c4b-1306-489d-9676-b925646cb65e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:17.855160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c415c4b-1306-489d-9676-b925646cb65e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:12:17.856846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c415c4b-1306-489d-9676-b925646cb65e service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:12:17.881518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 665/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:12:17 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:12:20.285593 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b154023-2443-4528-9d6a-e1e5bed7ef88 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:20.286196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b154023-2443-4528-9d6a-e1e5bed7ef88 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:20.286196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b154023-2443-4528-9d6a-e1e5bed7ef88 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:20.287613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 667/1332] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:12:20.292735 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359512d-771a-4dc8-9c7b-4614b8dfa852 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:20.293142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359512d-771a-4dc8-9c7b-4614b8dfa852 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:20.293267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359512d-771a-4dc8-9c7b-4614b8dfa852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:20.355151 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:20.358335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-4359512d-771a-4dc8-9c7b-4614b8dfa852 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:20.360379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4359512d-771a-4dc8-9c7b-4614b8dfa852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:20.458832 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 666/1333] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:12:20.743357 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b154023-2443-4528-9d6a-e1e5bed7ef88 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:12:20.744887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7b154023-2443-4528-9d6a-e1e5bed7ef88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:20.846903 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b154023-2443-4528-9d6a-e1e5bed7ef88 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:12:20.918479 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823d719-0440-4f4c-8a92-490bf0e26439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:12:20.919213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823d719-0440-4f4c-8a92-490bf0e26439 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:20.919490 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823d719-0440-4f4c-8a92-490bf0e26439 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:20.919759 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823d719-0440-4f4c-8a92-490bf0e26439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:20.921333 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6823d719-0440-4f4c-8a92-490bf0e26439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:20.948985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:21.029408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823d719-0440-4f4c-8a92-490bf0e26439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:12:21.030913 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823d719-0440-4f4c-8a92-490bf0e26439 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:12:21.055600 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 668/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:12:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:12:23.245980 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bc1d2-94f4-4f7f-9c7c-099ecebb23ac None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:23.246518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bc1d2-94f4-4f7f-9c7c-099ecebb23ac None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:23.246518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bc1d2-94f4-4f7f-9c7c-099ecebb23ac None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:23.247904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 667/1335] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:12:23.253587 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31224281-d23f-4fe7-b25a-aaeec6d1089c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:23.253990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31224281-d23f-4fe7-b25a-aaeec6d1089c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:23.254136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31224281-d23f-4fe7-b25a-aaeec6d1089c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:23.319950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-31224281-d23f-4fe7-b25a-aaeec6d1089c None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:23.321168 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-31224281-d23f-4fe7-b25a-aaeec6d1089c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:23.396370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:23.418693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 669/1336] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:12:23.702820 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bc1d2-94f4-4f7f-9c7c-099ecebb23ac None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:12:23.704408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f22bc1d2-94f4-4f7f-9c7c-099ecebb23ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:23.807065 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bc1d2-94f4-4f7f-9c7c-099ecebb23ac None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:12:23.835908 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:23.881941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839fe8b-285f-4d2a-add3-9fb554d633ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:12:23.882552 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839fe8b-285f-4d2a-add3-9fb554d633ad service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:23.882872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839fe8b-285f-4d2a-add3-9fb554d633ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:23.883150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839fe8b-285f-4d2a-add3-9fb554d633ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:23.884761 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3839fe8b-285f-4d2a-add3-9fb554d633ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:23.994928 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839fe8b-285f-4d2a-add3-9fb554d633ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:12:23.996288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839fe8b-285f-4d2a-add3-9fb554d633ad service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:12:24.014848 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 668/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:12:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:12:26.484607 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf525fa-36ca-46bb-a5ff-b44b260596eb None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:26.485119 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf525fa-36ca-46bb-a5ff-b44b260596eb None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:26.485223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf525fa-36ca-46bb-a5ff-b44b260596eb None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:26.486495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 670/1338] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:12:26.492195 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538f4c6-0644-419d-932b-52685734ad11 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:26.492602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538f4c6-0644-419d-932b-52685734ad11 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:26.492738 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538f4c6-0644-419d-932b-52685734ad11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:26.557331 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0538f4c6-0644-419d-932b-52685734ad11 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:26.558526 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0538f4c6-0644-419d-932b-52685734ad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:26.566644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:26.653370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 669/1339] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:12:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:12:26.933017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf525fa-36ca-46bb-a5ff-b44b260596eb None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:12:26.934538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ecf525fa-36ca-46bb-a5ff-b44b260596eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:27.036652 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf525fa-36ca-46bb-a5ff-b44b260596eb None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:12:27.109627 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36128934-dfcb-4ffa-8641-bf1de6d2a0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:12:27.110229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36128934-dfcb-4ffa-8641-bf1de6d2a0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:27.110510 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36128934-dfcb-4ffa-8641-bf1de6d2a0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:27.110816 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36128934-dfcb-4ffa-8641-bf1de6d2a0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:27.112473 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-36128934-dfcb-4ffa-8641-bf1de6d2a0b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:27.149590 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:27.221432 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36128934-dfcb-4ffa-8641-bf1de6d2a0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:12:27.222834 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36128934-dfcb-4ffa-8641-bf1de6d2a0b2 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:12:27.240856 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 671/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:12:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:12:31.299036 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bc62b-89df-4e55-a02e-02d1c55c8f88 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:31.300081 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bc62b-89df-4e55-a02e-02d1c55c8f88 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:31.300176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bc62b-89df-4e55-a02e-02d1c55c8f88 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:31.301810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 670/1341] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:12:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:12:31.307034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd434d33-5f7d-48c4-a83d-6e439b10ca02 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:31.307452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd434d33-5f7d-48c4-a83d-6e439b10ca02 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:31.307734 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd434d33-5f7d-48c4-a83d-6e439b10ca02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:31.375474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-fd434d33-5f7d-48c4-a83d-6e439b10ca02 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:31.376767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fd434d33-5f7d-48c4-a83d-6e439b10ca02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:31.474252 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:31.486340 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 672/1342] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:12:31.769649 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bc62b-89df-4e55-a02e-02d1c55c8f88 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:12:31.771242 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-352bc62b-89df-4e55-a02e-02d1c55c8f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:31.874847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bc62b-89df-4e55-a02e-02d1c55c8f88 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:12:31.913372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:31.948817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180bc09-2537-48dd-a969-01755d69806d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:12:31.949465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180bc09-2537-48dd-a969-01755d69806d service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:31.949749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180bc09-2537-48dd-a969-01755d69806d service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:31.950025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180bc09-2537-48dd-a969-01755d69806d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:31.951788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b180bc09-2537-48dd-a969-01755d69806d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:32.061148 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180bc09-2537-48dd-a969-01755d69806d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:12:32.062511 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180bc09-2537-48dd-a969-01755d69806d service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:12:32.080514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 671/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:12:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:12:34.828380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4d3a-d14b-4c42-9071-7c072c485823 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:34.828973 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4d3a-d14b-4c42-9071-7c072c485823 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:34.828973 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4d3a-d14b-4c42-9071-7c072c485823 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:34.830295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 673/1344] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:12:34.836131 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2c6aa-ec0f-405e-9baf-5120184bed42 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:34.836583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2c6aa-ec0f-405e-9baf-5120184bed42 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:34.836705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2c6aa-ec0f-405e-9baf-5120184bed42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:34.902937 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-92f2c6aa-ec0f-405e-9baf-5120184bed42 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:34.904146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-92f2c6aa-ec0f-405e-9baf-5120184bed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:34.922925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:35.003659 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 672/1345] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:12:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:12:35.288715 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd4d3a-d14b-4c42-9071-7c072c485823 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:12:35.290228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a0fd4d3a-d14b-4c42-9071-7c072c485823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:35.400580 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd4d3a-d14b-4c42-9071-7c072c485823 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:12:35.473244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8b53c-52f1-476a-9be9-9e3fa2efc9f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:12:35.473767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8b53c-52f1-476a-9be9-9e3fa2efc9f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:35.474044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8b53c-52f1-476a-9be9-9e3fa2efc9f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:35.474314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8b53c-52f1-476a-9be9-9e3fa2efc9f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:35.475935 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-60c8b53c-52f1-476a-9be9-9e3fa2efc9f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:35.518829 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:35.585674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8b53c-52f1-476a-9be9-9e3fa2efc9f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:12:35.587149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8b53c-52f1-476a-9be9-9e3fa2efc9f1 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:12:35.605601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 674/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:12:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:12:39.713791 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454a3e8-1d4a-4c1b-96a1-7dc342f2ddb9 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:39.714244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454a3e8-1d4a-4c1b-96a1-7dc342f2ddb9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:39.714334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454a3e8-1d4a-4c1b-96a1-7dc342f2ddb9 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:39.715641 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 673/1347] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:12:39.720794 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0d446-3005-4c40-83a1-c1d92a5a5b76 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:39.721700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0d446-3005-4c40-83a1-c1d92a5a5b76 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:39.721874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0d446-3005-4c40-83a1-c1d92a5a5b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:39.787509 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a7e0d446-3005-4c40-83a1-c1d92a5a5b76 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:39.788722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a7e0d446-3005-4c40-83a1-c1d92a5a5b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:39.882547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:39.885458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 675/1348] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:12:40.180695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454a3e8-1d4a-4c1b-96a1-7dc342f2ddb9 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:12:40.182240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3454a3e8-1d4a-4c1b-96a1-7dc342f2ddb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:40.283464 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454a3e8-1d4a-4c1b-96a1-7dc342f2ddb9 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:12:40.330421 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:40.356791 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0288626-bd50-4b7f-9728-557397c7060c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:12:40.357392 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0288626-bd50-4b7f-9728-557397c7060c service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:40.357675 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0288626-bd50-4b7f-9728-557397c7060c service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:40.357950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0288626-bd50-4b7f-9728-557397c7060c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:40.359860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d0288626-bd50-4b7f-9728-557397c7060c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:40.482243 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0288626-bd50-4b7f-9728-557397c7060c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:12:40.483739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0288626-bd50-4b7f-9728-557397c7060c service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:12:40.505168 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 674/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:12:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:12:45.555427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c605aee-248b-4f84-bce9-28cffec5048d None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:45.555883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c605aee-248b-4f84-bce9-28cffec5048d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:45.555980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c605aee-248b-4f84-bce9-28cffec5048d None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:45.557345 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 676/1350] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 27 04:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:12:45.562661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5783c72-be1c-4c2c-8077-ccb1ac584838 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:45.563089 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5783c72-be1c-4c2c-8077-ccb1ac584838 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:45.563260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5783c72-be1c-4c2c-8077-ccb1ac584838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:45.659382 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d5783c72-be1c-4c2c-8077-ccb1ac584838 None None] MFA Rules not processed for user `efd209a50a994b7c8485f2996697218b`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:45.661197 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d5783c72-be1c-4c2c-8077-ccb1ac584838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:45.691826 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:45.824798 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 675/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 27 04:12:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:12:49.909230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab228b9e-c904-4432-a5d3-96e64dbed6fa None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:49.909775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab228b9e-c904-4432-a5d3-96e64dbed6fa None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:49.909775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab228b9e-c904-4432-a5d3-96e64dbed6fa None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:49.911314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 677/1352] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 27 04:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:12:49.916217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2336352-6300-4064-a7f0-238559f2d8ec None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:49.916693 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2336352-6300-4064-a7f0-238559f2d8ec None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:49.916799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2336352-6300-4064-a7f0-238559f2d8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:49.999365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-a2336352-6300-4064-a7f0-238559f2d8ec None None] MFA Rules not processed for user `efd209a50a994b7c8485f2996697218b`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:50.000584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a2336352-6300-4064-a7f0-238559f2d8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:50.079107 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:50.117143 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 676/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 27 04:12:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:12:51.397976 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f341c-7dcb-4207-9b16-c049cc5cc385 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:51.398897 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f341c-7dcb-4207-9b16-c049cc5cc385 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:51.399316 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f341c-7dcb-4207-9b16-c049cc5cc385 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:51.400995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 678/1354] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 27 04:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:12:51.407145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b1b84-c730-4258-b705-702d0b46ce04 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:51.407706 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b1b84-c730-4258-b705-702d0b46ce04 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:51.407803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b1b84-c730-4258-b705-702d0b46ce04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:51.482917 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0e6b1b84-c730-4258-b705-702d0b46ce04 None None] MFA Rules not processed for user `efd209a50a994b7c8485f2996697218b`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:51.484110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0e6b1b84-c730-4258-b705-702d0b46ce04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:51.589340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 677/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 27 04:12:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:12:55.280530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c696-0c51-4cfe-b3f2-bf68a2a03077 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:55.281049 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c696-0c51-4cfe-b3f2-bf68a2a03077 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:55.281049 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c696-0c51-4cfe-b3f2-bf68a2a03077 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:55.282492 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 679/1356] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:12:55.288105 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6411a-7c7c-44aa-b98e-f615dd7772df None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:55.288504 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6411a-7c7c-44aa-b98e-f615dd7772df None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:55.288674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6411a-7c7c-44aa-b98e-f615dd7772df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:55.327674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:55.361272 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-09d6411a-7c7c-44aa-b98e-f615dd7772df None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:55.363014 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-09d6411a-7c7c-44aa-b98e-f615dd7772df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:55.467293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 678/1357] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:12:55.774960 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b03bf-164c-4405-b3d9-15bbb807d7e8 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:55.775549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b03bf-164c-4405-b3d9-15bbb807d7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:55.776674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b03bf-164c-4405-b3d9-15bbb807d7e8 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:55.780478 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 680/1358] 10.222.0.48 () {54 vars in 961 bytes} [Tue Sep 27 04:12:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:12:55.792180 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190241c6-d619-4591-986c-543ec05a6753 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:55.793060 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190241c6-d619-4591-986c-543ec05a6753 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:55.793558 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190241c6-d619-4591-986c-543ec05a6753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:55.891805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-190241c6-d619-4591-986c-543ec05a6753 None None] MFA Rules not processed for user `3960d52dee8443cf9ec8930a389a7b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:55.893592 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-190241c6-d619-4591-986c-543ec05a6753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:55.944488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:56.016419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 679/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Sep 27 04:12:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:12:56.024684 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b03bf-164c-4405-b3d9-15bbb807d7e8 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:12:56.026194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2e7b03bf-164c-4405-b3d9-15bbb807d7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:56.189188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b03bf-164c-4405-b3d9-15bbb807d7e8 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:12:56.267919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:56.308963 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b64b1-cb5f-42d4-b575-a36ebe5c0cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:12:56.309593 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b64b1-cb5f-42d4-b575-a36ebe5c0cf5 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:56.309862 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b64b1-cb5f-42d4-b575-a36ebe5c0cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:56.310122 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b64b1-cb5f-42d4-b575-a36ebe5c0cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:56.311744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ba9b64b1-cb5f-42d4-b575-a36ebe5c0cf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:56.414477 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b64b1-cb5f-42d4-b575-a36ebe5c0cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:12:56.416173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b64b1-cb5f-42d4-b575-a36ebe5c0cf5 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:12:56.438487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 681/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:12:58.828241 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc7cab-1a9c-4143-80c9-03181b985f03 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:58.828793 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc7cab-1a9c-4143-80c9-03181b985f03 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:58.828793 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc7cab-1a9c-4143-80c9-03181b985f03 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:58.830213 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 680/1361] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:12:58.836431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2eb5a-cc57-4f20-a0d9-7ce5a1901e92 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:58.837209 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2eb5a-cc57-4f20-a0d9-7ce5a1901e92 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:58.837666 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2eb5a-cc57-4f20-a0d9-7ce5a1901e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:58.912115 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-70c2eb5a-cc57-4f20-a0d9-7ce5a1901e92 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:12:58.913403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-70c2eb5a-cc57-4f20-a0d9-7ce5a1901e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:58.955839 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:59.022245 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 682/1362] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:12:59.309959 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc7cab-1a9c-4143-80c9-03181b985f03 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:12:59.311852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-40bc7cab-1a9c-4143-80c9-03181b985f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:59.483623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc7cab-1a9c-4143-80c9-03181b985f03 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:12:59.495689 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:12:59.639551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771e67f-8b6a-4dd9-bf2c-ff08e0b50f9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:12:59.640610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771e67f-8b6a-4dd9-bf2c-ff08e0b50f9b service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:12:59.640610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771e67f-8b6a-4dd9-bf2c-ff08e0b50f9b service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:12:59.640610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771e67f-8b6a-4dd9-bf2c-ff08e0b50f9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:12:59.642784 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7771e67f-8b6a-4dd9-bf2c-ff08e0b50f9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:12:59.739281 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771e67f-8b6a-4dd9-bf2c-ff08e0b50f9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:12:59.740947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771e67f-8b6a-4dd9-bf2c-ff08e0b50f9b service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:12:59.760301 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 681/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:13:02.245077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69349bf5-dfb9-4cea-be60-5d1463ad599d None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:02.245703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69349bf5-dfb9-4cea-be60-5d1463ad599d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:02.245703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69349bf5-dfb9-4cea-be60-5d1463ad599d None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:02.247049 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 683/1364] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:02.252564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed899f5-9c01-4d77-a0f1-283177b7575a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:02.252997 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed899f5-9c01-4d77-a0f1-283177b7575a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:02.253168 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed899f5-9c01-4d77-a0f1-283177b7575a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:02.268833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:02.322819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-4ed899f5-9c01-4d77-a0f1-283177b7575a None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:02.324044 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4ed899f5-9c01-4d77-a0f1-283177b7575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:02.424788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 682/1365] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:02.716935 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ed260-cdb2-4367-b533-2b10f5247e09 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:02.717453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ed260-cdb2-4367-b533-2b10f5247e09 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:02.717744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ed260-cdb2-4367-b533-2b10f5247e09 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:02.719272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 684/1366] 10.222.0.48 () {54 vars in 961 bytes} [Tue Sep 27 04:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:02.724867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68767740-6622-4f36-94af-900de1322519 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:02.725249 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68767740-6622-4f36-94af-900de1322519 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:02.725608 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68767740-6622-4f36-94af-900de1322519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:02.810206 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-68767740-6622-4f36-94af-900de1322519 None None] MFA Rules not processed for user `3960d52dee8443cf9ec8930a389a7b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:02.811837 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-68767740-6622-4f36-94af-900de1322519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:02.853165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:02.944178 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 683/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Sep 27 04:13:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:02.952128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ed260-cdb2-4367-b533-2b10f5247e09 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:02.953716 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ef8ed260-cdb2-4367-b533-2b10f5247e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:03.110811 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ed260-cdb2-4367-b533-2b10f5247e09 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:03.133158 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:03.235260 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf27ea-a1fe-40a3-a396-a03c76173db8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:03.235786 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf27ea-a1fe-40a3-a396-a03c76173db8 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:03.236058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf27ea-a1fe-40a3-a396-a03c76173db8 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:03.236342 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf27ea-a1fe-40a3-a396-a03c76173db8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:03.238565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-facf27ea-a1fe-40a3-a396-a03c76173db8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:03.335662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf27ea-a1fe-40a3-a396-a03c76173db8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:13:03.337329 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf27ea-a1fe-40a3-a396-a03c76173db8 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:13:03.356916 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 685/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:13:03.520594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37520d57-5dd3-41e5-85dc-c6e5680cadc3 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:03.521105 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37520d57-5dd3-41e5-85dc-c6e5680cadc3 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:03.521105 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37520d57-5dd3-41e5-85dc-c6e5680cadc3 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:03.522391 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 684/1369] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:03.528180 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257bd50-af39-4347-9d04-eb5b6d906691 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:03.528462 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257bd50-af39-4347-9d04-eb5b6d906691 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:03.528738 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257bd50-af39-4347-9d04-eb5b6d906691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:03.563247 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:03.603923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-7257bd50-af39-4347-9d04-eb5b6d906691 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:03.605353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7257bd50-af39-4347-9d04-eb5b6d906691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:03.731370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 686/1370] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:04.054486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c730a04-d19a-4629-a099-3a0b0f47cdde None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:04.054799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c730a04-d19a-4629-a099-3a0b0f47cdde None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:04.055080 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c730a04-d19a-4629-a099-3a0b0f47cdde None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:04.056943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 685/1371] 10.222.0.48 () {54 vars in 963 bytes} [Tue Sep 27 04:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:04.061358 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0771a-82b3-48d4-b128-5eaf7e8f6129 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:04.061721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0771a-82b3-48d4-b128-5eaf7e8f6129 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:04.062067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0771a-82b3-48d4-b128-5eaf7e8f6129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:04.145421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b9d0771a-82b3-48d4-b128-5eaf7e8f6129 None None] MFA Rules not processed for user `de5ccc88318a4b96969facf8df7bd504`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:04.146826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b9d0771a-82b3-48d4-b128-5eaf7e8f6129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:04.197889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:04.230502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 687/1372] 10.222.0.48 () {58 vars in 1060 bytes} [Tue Sep 27 04:13:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:04.239303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c730a04-d19a-4629-a099-3a0b0f47cdde None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:04.240843 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5c730a04-d19a-4629-a099-3a0b0f47cdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:04.349799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c730a04-d19a-4629-a099-3a0b0f47cdde None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:04.405706 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:04.449975 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6cada-44f2-46b8-8924-3b8ec1c7482c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:04.450596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6cada-44f2-46b8-8924-3b8ec1c7482c service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:04.450926 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6cada-44f2-46b8-8924-3b8ec1c7482c service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:04.451371 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6cada-44f2-46b8-8924-3b8ec1c7482c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:04.453056 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4ae6cada-44f2-46b8-8924-3b8ec1c7482c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:04.576498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6cada-44f2-46b8-8924-3b8ec1c7482c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:13:04.577926 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6cada-44f2-46b8-8924-3b8ec1c7482c service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:13:04.599197 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 686/1373] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:13:05.647881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546f592-76c6-4292-8950-e1535eb3f474 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:05.648431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546f592-76c6-4292-8950-e1535eb3f474 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:05.648431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546f592-76c6-4292-8950-e1535eb3f474 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:05.649722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 688/1374] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:05.654957 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312150e6-7618-4ccd-acb9-d2b1cf556d87 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:05.655342 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312150e6-7618-4ccd-acb9-d2b1cf556d87 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:05.655520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312150e6-7618-4ccd-acb9-d2b1cf556d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:05.721125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-312150e6-7618-4ccd-acb9-d2b1cf556d87 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:05.722414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-312150e6-7618-4ccd-acb9-d2b1cf556d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:05.744107 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:05.820882 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 687/1375] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:06.110737 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546f592-76c6-4292-8950-e1535eb3f474 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:06.112468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7546f592-76c6-4292-8950-e1535eb3f474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:06.274040 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546f592-76c6-4292-8950-e1535eb3f474 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:06.326604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:06.391267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79e0bf-aa2d-4f04-acdb-0f504178ada1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:06.391872 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79e0bf-aa2d-4f04-acdb-0f504178ada1 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:06.392156 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79e0bf-aa2d-4f04-acdb-0f504178ada1 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:06.392432 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79e0bf-aa2d-4f04-acdb-0f504178ada1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:06.394052 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3a79e0bf-aa2d-4f04-acdb-0f504178ada1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:06.486535 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79e0bf-aa2d-4f04-acdb-0f504178ada1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:13:06.488208 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79e0bf-aa2d-4f04-acdb-0f504178ada1 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:13:06.506933 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 689/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:13:08.722148 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be564d2c-e732-4786-9c80-340e08151d67 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:08.723071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be564d2c-e732-4786-9c80-340e08151d67 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:08.723357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be564d2c-e732-4786-9c80-340e08151d67 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:08.724824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 688/1377] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:13:08.729969 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03536646-d6d8-422f-8462-05b38e5e3140 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:08.730400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03536646-d6d8-422f-8462-05b38e5e3140 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:08.730570 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03536646-d6d8-422f-8462-05b38e5e3140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:08.798483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-03536646-d6d8-422f-8462-05b38e5e3140 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:08.799767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-03536646-d6d8-422f-8462-05b38e5e3140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:08.808990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:08.911398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 690/1378] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:09.199512 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be564d2c-e732-4786-9c80-340e08151d67 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:09.201219 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-be564d2c-e732-4786-9c80-340e08151d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:09.356696 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be564d2c-e732-4786-9c80-340e08151d67 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:09.361003 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:09.485094 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea1ea1-3795-4959-acd9-1f7ad6a76667 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:09.485758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea1ea1-3795-4959-acd9-1f7ad6a76667 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:09.486255 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea1ea1-3795-4959-acd9-1f7ad6a76667 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:09.487159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea1ea1-3795-4959-acd9-1f7ad6a76667 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:09.488864 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-90ea1ea1-3795-4959-acd9-1f7ad6a76667 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:09.584832 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea1ea1-3795-4959-acd9-1f7ad6a76667 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:13:09.586748 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea1ea1-3795-4959-acd9-1f7ad6a76667 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:13:09.606729 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 689/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:13:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:13:11.807660 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24d77c-1263-4773-ba66-3a781fbc8115 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:11.808232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24d77c-1263-4773-ba66-3a781fbc8115 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:11.808514 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24d77c-1263-4773-ba66-3a781fbc8115 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:11.810909 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 691/1380] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:11.815207 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1551-b40c-461a-a2d1-75a0cb178bd4 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:11.815707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1551-b40c-461a-a2d1-75a0cb178bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:11.815881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1551-b40c-461a-a2d1-75a0cb178bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:11.827699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:11.896997 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-90dc1551-b40c-461a-a2d1-75a0cb178bd4 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:11.898322 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-90dc1551-b40c-461a-a2d1-75a0cb178bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:12.005404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 690/1381] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:12.308690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24d77c-1263-4773-ba66-3a781fbc8115 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:12.310087 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2e24d77c-1263-4773-ba66-3a781fbc8115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:12.455466 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:12.465812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24d77c-1263-4773-ba66-3a781fbc8115 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:12.601733 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27923f82-42db-40ea-962d-e8951f1f1ec4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:12.602199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27923f82-42db-40ea-962d-e8951f1f1ec4 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:12.602526 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27923f82-42db-40ea-962d-e8951f1f1ec4 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:12.602770 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27923f82-42db-40ea-962d-e8951f1f1ec4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:12.604375 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-27923f82-42db-40ea-962d-e8951f1f1ec4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:12.696422 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27923f82-42db-40ea-962d-e8951f1f1ec4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:13:12.698119 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27923f82-42db-40ea-962d-e8951f1f1ec4 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:13:12.709269 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:12.718538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 692/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:13:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:13:14.900313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60abfb2-9477-499a-9cc3-eee9a1acd303 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:14.900841 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60abfb2-9477-499a-9cc3-eee9a1acd303 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:14.900841 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60abfb2-9477-499a-9cc3-eee9a1acd303 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:14.902188 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 691/1383] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:14.908164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3c1f1-e979-4145-8a7f-495e7633cd33 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:14.908633 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3c1f1-e979-4145-8a7f-495e7633cd33 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:14.908797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3c1f1-e979-4145-8a7f-495e7633cd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:14.975486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-6fa3c1f1-e979-4145-8a7f-495e7633cd33 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:14.976694 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6fa3c1f1-e979-4145-8a7f-495e7633cd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:15.071839 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 693/1384] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:15.367123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60abfb2-9477-499a-9cc3-eee9a1acd303 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:15.368691 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b60abfb2-9477-499a-9cc3-eee9a1acd303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:15.456654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:15.525215 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60abfb2-9477-499a-9cc3-eee9a1acd303 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:15.664945 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d821a-6fc6-4c5c-b1a3-ffd459bcdf25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:15.665592 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d821a-6fc6-4c5c-b1a3-ffd459bcdf25 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:15.665891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d821a-6fc6-4c5c-b1a3-ffd459bcdf25 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:15.666180 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d821a-6fc6-4c5c-b1a3-ffd459bcdf25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:15.667902 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-af5d821a-6fc6-4c5c-b1a3-ffd459bcdf25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:15.721718 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:15.764687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d821a-6fc6-4c5c-b1a3-ffd459bcdf25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:13:15.766399 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d821a-6fc6-4c5c-b1a3-ffd459bcdf25 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:13:15.788532 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 692/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:13:18.025744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56223fbf-a51b-43cc-a13e-10c4bc69d2e1 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:18.026313 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56223fbf-a51b-43cc-a13e-10c4bc69d2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:18.026313 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56223fbf-a51b-43cc-a13e-10c4bc69d2e1 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:18.027747 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 694/1386] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:18.033693 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976682d-120c-4bbc-b8aa-de229d747c59 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:18.034122 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976682d-120c-4bbc-b8aa-de229d747c59 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:18.034376 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976682d-120c-4bbc-b8aa-de229d747c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:18.108615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0976682d-120c-4bbc-b8aa-de229d747c59 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:18.110201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0976682d-120c-4bbc-b8aa-de229d747c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:18.242758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 693/1387] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:18.574127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56223fbf-a51b-43cc-a13e-10c4bc69d2e1 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:18.576118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-56223fbf-a51b-43cc-a13e-10c4bc69d2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:18.671527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:18.754090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56223fbf-a51b-43cc-a13e-10c4bc69d2e1 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:18.878366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e655fb5-a9d1-4f2c-9685-4ea6b68d39bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:18.879221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e655fb5-a9d1-4f2c-9685-4ea6b68d39bb service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:18.880050 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e655fb5-a9d1-4f2c-9685-4ea6b68d39bb service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:18.880320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e655fb5-a9d1-4f2c-9685-4ea6b68d39bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:18.882778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5e655fb5-a9d1-4f2c-9685-4ea6b68d39bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:18.930340 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:18.981710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e655fb5-a9d1-4f2c-9685-4ea6b68d39bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:13:18.983282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e655fb5-a9d1-4f2c-9685-4ea6b68d39bb service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:13:19.001919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 695/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:13:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:13:21.201394 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063d29f-7be2-4249-a05c-ecb0bb571e5c None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:21.201987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063d29f-7be2-4249-a05c-ecb0bb571e5c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:21.201987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063d29f-7be2-4249-a05c-ecb0bb571e5c None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:21.203292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 694/1389] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:13:21.208442 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5c2fe-0b12-43fd-bf7b-f4cee4c8c3a2 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:21.208894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5c2fe-0b12-43fd-bf7b-f4cee4c8c3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:21.209000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5c2fe-0b12-43fd-bf7b-f4cee4c8c3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:21.274053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-02e5c2fe-0b12-43fd-bf7b-f4cee4c8c3a2 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:21.275277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-02e5c2fe-0b12-43fd-bf7b-f4cee4c8c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:21.376518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 696/1390] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:21.662875 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063d29f-7be2-4249-a05c-ecb0bb571e5c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:21.664541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1063d29f-7be2-4249-a05c-ecb0bb571e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:21.696451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:21.810223 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063d29f-7be2-4249-a05c-ecb0bb571e5c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:21.914251 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:21.927615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2cd3e-7108-4254-bb32-08dede8bca88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:21.928253 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2cd3e-7108-4254-bb32-08dede8bca88 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:21.928531 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2cd3e-7108-4254-bb32-08dede8bca88 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:21.928804 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2cd3e-7108-4254-bb32-08dede8bca88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:21.930540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c8d2cd3e-7108-4254-bb32-08dede8bca88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:22.024546 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2cd3e-7108-4254-bb32-08dede8bca88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:13:22.026152 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2cd3e-7108-4254-bb32-08dede8bca88 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:13:22.042010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39239252-2a81-4af9-ab21-c04e206e5aee None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:22.042298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39239252-2a81-4af9-ab21-c04e206e5aee None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:22.042572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39239252-2a81-4af9-ab21-c04e206e5aee None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:22.043872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 695/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:13:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:13:22.044025 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 697/1392] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:13:22.049244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193feff8-3053-4889-b198-74c154c24fe7 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:22.049857 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193feff8-3053-4889-b198-74c154c24fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:22.049857 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193feff8-3053-4889-b198-74c154c24fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:22.119793 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-193feff8-3053-4889-b198-74c154c24fe7 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:22.121052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-193feff8-3053-4889-b198-74c154c24fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:22.188453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:22.229821 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 696/1393] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:22.536932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394836a-b793-401c-98d0-7869f13fe1f0 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:22.537406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394836a-b793-401c-98d0-7869f13fe1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:22.537648 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394836a-b793-401c-98d0-7869f13fe1f0 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:22.539102 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 698/1394] 10.222.0.48 () {54 vars in 962 bytes} [Tue Sep 27 04:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:22.545129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80913d5-99dd-4b2c-992b-61f87bde89fc None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:22.545580 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80913d5-99dd-4b2c-992b-61f87bde89fc None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:22.545861 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80913d5-99dd-4b2c-992b-61f87bde89fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:22.626896 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d80913d5-99dd-4b2c-992b-61f87bde89fc None None] MFA Rules not processed for user `405499a1b5dc4fb6ac7af73910c3d992`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:22.628101 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d80913d5-99dd-4b2c-992b-61f87bde89fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:22.702658 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 697/1395] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Sep 27 04:13:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:22.711649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394836a-b793-401c-98d0-7869f13fe1f0 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:22.713141 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b394836a-b793-401c-98d0-7869f13fe1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:22.727516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:22.819818 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394836a-b793-401c-98d0-7869f13fe1f0 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:22.894730 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414f06b-3ae0-4796-bff5-c136e4e31f5e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '405499a1b5dc4fb6ac7af73910c3d992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:22.895351 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414f06b-3ae0-4796-bff5-c136e4e31f5e service glance] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:22.895634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414f06b-3ae0-4796-bff5-c136e4e31f5e service glance] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:22.895907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414f06b-3ae0-4796-bff5-c136e4e31f5e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:22.897502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3414f06b-3ae0-4796-bff5-c136e4e31f5e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:22.977724 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:23.019120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414f06b-3ae0-4796-bff5-c136e4e31f5e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:13:23.020570 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414f06b-3ae0-4796-bff5-c136e4e31f5e service glance] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:13:23.038750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 699/1396] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:13:23.794414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7a2ae-83e5-4642-b771-ce6defda4f7f None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:23.794899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7a2ae-83e5-4642-b771-ce6defda4f7f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:23.795061 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7a2ae-83e5-4642-b771-ce6defda4f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:23.977584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-4df7a2ae-83e5-4642-b771-ce6defda4f7f None None] MFA Rules not processed for user `71c7a54c598642a4b9219ae21c34f0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:23.979292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4df7a2ae-83e5-4642-b771-ce6defda4f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:23.987854 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:24.065968 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 698/1397] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 27 04:13:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:24.113488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95327191-e242-4bc4-9536-392e7ec0e197 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:24.114079 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95327191-e242-4bc4-9536-392e7ec0e197 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:24.114079 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95327191-e242-4bc4-9536-392e7ec0e197 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:24.115507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 700/1398] 10.222.0.48 () {54 vars in 943 bytes} [Tue Sep 27 04:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:24.122428 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a1083-e6b2-4775-a878-6d3889aad285 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:24.122827 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a1083-e6b2-4775-a878-6d3889aad285 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:24.123106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a1083-e6b2-4775-a878-6d3889aad285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:24.200540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-7f1a1083-e6b2-4775-a878-6d3889aad285 None None] MFA Rules not processed for user `c295a3063c3b45be96b406f586180142`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:24.201749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7f1a1083-e6b2-4775-a878-6d3889aad285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:24.216073 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2e221-9cbd-4324-a814-8e0eee13ab9d None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:24.216847 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2e221-9cbd-4324-a814-8e0eee13ab9d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:24.217132 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2e221-9cbd-4324-a814-8e0eee13ab9d None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:24.218499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 701/1399] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:13:24.223812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c25ed7-9448-48ba-a8f9-c50ba84b5f6b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:24.224101 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c25ed7-9448-48ba-a8f9-c50ba84b5f6b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:24.224380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c25ed7-9448-48ba-a8f9-c50ba84b5f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:24.286737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:24.291295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b1c25ed7-9448-48ba-a8f9-c50ba84b5f6b None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:24.292515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b1c25ed7-9448-48ba-a8f9-c50ba84b5f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:24.308850 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 699/1400] 10.222.0.48 () {58 vars in 1040 bytes} [Tue Sep 27 04:13:24 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:24.318516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a1083-e6b2-4775-a878-6d3889aad285 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:24.327721 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a1083-e6b2-4775-a878-6d3889aad285 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:24.391431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 702/1401] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:13:24.439208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ea863-8670-448b-8c8e-44279297c3e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c295a3063c3b45be96b406f586180142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:24.439840 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ea863-8670-448b-8c8e-44279297c3e6 service swift] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:24.440117 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ea863-8670-448b-8c8e-44279297c3e6 service swift] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:24.440383 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ea863-8670-448b-8c8e-44279297c3e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:24.442810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fb0ea863-8670-448b-8c8e-44279297c3e6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:24.523295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ea863-8670-448b-8c8e-44279297c3e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:13:24.524877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ea863-8670-448b-8c8e-44279297c3e6 service swift] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:13:24.532646 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 700/1402] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 27 04:13:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 27 04:13:24.681414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c25ed7-9448-48ba-a8f9-c50ba84b5f6b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:24.682782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b1c25ed7-9448-48ba-a8f9-c50ba84b5f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:24.713730 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:24.809828 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c25ed7-9448-48ba-a8f9-c50ba84b5f6b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:24.931928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ebe35-76bf-4963-b7f9-91da9666d2d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:24.932543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ebe35-76bf-4963-b7f9-91da9666d2d8 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:24.932825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ebe35-76bf-4963-b7f9-91da9666d2d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:24.933100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ebe35-76bf-4963-b7f9-91da9666d2d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:24.934706 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4f1ebe35-76bf-4963-b7f9-91da9666d2d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:24.953416 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:25.038874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ebe35-76bf-4963-b7f9-91da9666d2d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:13:25.040516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ebe35-76bf-4963-b7f9-91da9666d2d8 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:13:25.059313 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 703/1403] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:13:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:13:27.289626 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290fde1-c576-4acf-9659-bc17fbaa6d1b None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:27.290145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290fde1-c576-4acf-9659-bc17fbaa6d1b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:27.290145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290fde1-c576-4acf-9659-bc17fbaa6d1b None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:27.291689 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 701/1404] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:27.296587 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5021d9b-a875-4bcc-a057-a4139fcb20d8 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:27.297005 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5021d9b-a875-4bcc-a057-a4139fcb20d8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:27.297185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5021d9b-a875-4bcc-a057-a4139fcb20d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:27.367366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b5021d9b-a875-4bcc-a057-a4139fcb20d8 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:27.368704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b5021d9b-a875-4bcc-a057-a4139fcb20d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:27.475201 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:27.481877 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 704/1405] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:27.781113 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290fde1-c576-4acf-9659-bc17fbaa6d1b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:27.783680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4290fde1-c576-4acf-9659-bc17fbaa6d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:27.793793 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:27.961782 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290fde1-c576-4acf-9659-bc17fbaa6d1b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:28.055144 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:28.095920 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678f1f9-9908-4222-907a-873f90b92bc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:28.096979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678f1f9-9908-4222-907a-873f90b92bc9 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:28.097443 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678f1f9-9908-4222-907a-873f90b92bc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:28.097725 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678f1f9-9908-4222-907a-873f90b92bc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:28.099415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3678f1f9-9908-4222-907a-873f90b92bc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:28.196131 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678f1f9-9908-4222-907a-873f90b92bc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:13:28.197763 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678f1f9-9908-4222-907a-873f90b92bc9 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:13:28.219625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 702/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:13:30.434032 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dc35d-9e40-4130-8a8d-2f576d12e26b None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:30.434596 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dc35d-9e40-4130-8a8d-2f576d12e26b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:30.434596 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dc35d-9e40-4130-8a8d-2f576d12e26b None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:30.438766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 705/1407] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:30.441340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e28735-c7e2-4265-a72f-1d0610dd332f None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:30.441766 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e28735-c7e2-4265-a72f-1d0610dd332f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:30.441895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e28735-c7e2-4265-a72f-1d0610dd332f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:30.512329 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-33e28735-c7e2-4265-a72f-1d0610dd332f None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:30.513558 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-33e28735-c7e2-4265-a72f-1d0610dd332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:30.563717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:30.626870 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 703/1408] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:30.911325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3dc35d-9e40-4130-8a8d-2f576d12e26b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:30.912844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5d3dc35d-9e40-4130-8a8d-2f576d12e26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:31.082574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3dc35d-9e40-4130-8a8d-2f576d12e26b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:31.158704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:31.207600 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2544bb4-3a64-4455-b433-ba97cc5fcb8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:31.208422 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2544bb4-3a64-4455-b433-ba97cc5fcb8b service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:31.208710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2544bb4-3a64-4455-b433-ba97cc5fcb8b service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:31.208985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2544bb4-3a64-4455-b433-ba97cc5fcb8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:31.210632 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d2544bb4-3a64-4455-b433-ba97cc5fcb8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:31.305544 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2544bb4-3a64-4455-b433-ba97cc5fcb8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:13:31.307196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2544bb4-3a64-4455-b433-ba97cc5fcb8b service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:13:31.326209 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 706/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:13:40.622567 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=23 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:41.323950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=64 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:47.059002 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328e897-6924-46bd-8fbd-cd10bc2d1139 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:47.059592 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328e897-6924-46bd-8fbd-cd10bc2d1139 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:47.059592 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328e897-6924-46bd-8fbd-cd10bc2d1139 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:47.060944 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 704/1410] 10.222.0.48 () {54 vars in 918 bytes} [Tue Sep 27 04:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:47.066072 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02db991-061d-4fe9-a1d0-eb516816e3db None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:47.066505 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02db991-061d-4fe9-a1d0-eb516816e3db None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:47.066609 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02db991-061d-4fe9-a1d0-eb516816e3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:47.256988 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d02db991-061d-4fe9-a1d0-eb516816e3db None None] MFA Rules not processed for user `efd209a50a994b7c8485f2996697218b`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:47.258108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d02db991-061d-4fe9-a1d0-eb516816e3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:47.361421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 707/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Sep 27 04:13:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:47.380244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d575d-338e-488c-a4a7-a9bb73427d39 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:47.380533 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d575d-338e-488c-a4a7-a9bb73427d39 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:47.380811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d575d-338e-488c-a4a7-a9bb73427d39 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:47.382114 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 705/1412] 10.222.0.48 () {54 vars in 918 bytes} [Tue Sep 27 04:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:47.386680 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa16a8-c1e9-4b32-8714-2f0c23f7e72a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:47.387004 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa16a8-c1e9-4b32-8714-2f0c23f7e72a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:47.387298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa16a8-c1e9-4b32-8714-2f0c23f7e72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:47.459722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:47.462246 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-93aa16a8-c1e9-4b32-8714-2f0c23f7e72a None None] MFA Rules not processed for user `3960d52dee8443cf9ec8930a389a7b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:47.464182 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-93aa16a8-c1e9-4b32-8714-2f0c23f7e72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:47.578425 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 708/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Sep 27 04:13:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:13:50.149498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab332593-5bc3-46b1-a0fe-9fe04f560116 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:50.150061 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab332593-5bc3-46b1-a0fe-9fe04f560116 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:50.150061 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab332593-5bc3-46b1-a0fe-9fe04f560116 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:50.151430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 04:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:50.156786 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956a691-149e-4711-bb7a-80e5c9773735 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:50.157206 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956a691-149e-4711-bb7a-80e5c9773735 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:50.157346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956a691-149e-4711-bb7a-80e5c9773735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:50.222835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-4956a691-149e-4711-bb7a-80e5c9773735 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:50.224036 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4956a691-149e-4711-bb7a-80e5c9773735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:50.278322 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:50.319793 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 04:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:50.610317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab332593-5bc3-46b1-a0fe-9fe04f560116 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:50.612555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ab332593-5bc3-46b1-a0fe-9fe04f560116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:50.755362 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab332593-5bc3-46b1-a0fe-9fe04f560116 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:50.826305 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:50.866487 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22185ac-1428-4cf9-9f31-8581e34e0c1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:50.867120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22185ac-1428-4cf9-9f31-8581e34e0c1a service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:50.867401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22185ac-1428-4cf9-9f31-8581e34e0c1a service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:50.867674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22185ac-1428-4cf9-9f31-8581e34e0c1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:50.869275 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d22185ac-1428-4cf9-9f31-8581e34e0c1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:50.958929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22185ac-1428-4cf9-9f31-8581e34e0c1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:13:50.960528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22185ac-1428-4cf9-9f31-8581e34e0c1a service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:13:50.978010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 707/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:13:52.119930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f262701-a627-457c-8c35-ddbe22fac24d None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:52.120492 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f262701-a627-457c-8c35-ddbe22fac24d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:52.120492 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f262701-a627-457c-8c35-ddbe22fac24d None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:52.121834 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:52.128111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8248b-39b7-4909-87f5-ba6721b79a4c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:52.128546 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8248b-39b7-4909-87f5-ba6721b79a4c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:52.128650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8248b-39b7-4909-87f5-ba6721b79a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:52.202160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-03a8248b-39b7-4909-87f5-ba6721b79a4c None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:52.203373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-03a8248b-39b7-4909-87f5-ba6721b79a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:52.230235 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:52.299362 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:52.449678 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f262701-a627-457c-8c35-ddbe22fac24d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:52.451254 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1f262701-a627-457c-8c35-ddbe22fac24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:52.596014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f262701-a627-457c-8c35-ddbe22fac24d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:52.636377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:52.707404 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f429c3-9ffa-4141-85d0-2be502ddb92d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:52.708006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f429c3-9ffa-4141-85d0-2be502ddb92d service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:52.708284 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f429c3-9ffa-4141-85d0-2be502ddb92d service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:52.708551 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f429c3-9ffa-4141-85d0-2be502ddb92d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:52.710134 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e6f429c3-9ffa-4141-85d0-2be502ddb92d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:52.798359 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f429c3-9ffa-4141-85d0-2be502ddb92d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:13:52.799981 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f429c3-9ffa-4141-85d0-2be502ddb92d service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:13:52.818303 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 711/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:13:53.955470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb9604-7e88-474f-917e-1af2c87ee4be None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:53.956048 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb9604-7e88-474f-917e-1af2c87ee4be None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:53.956048 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb9604-7e88-474f-917e-1af2c87ee4be None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:53.957363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:53.964184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d6563-63b9-4832-9d11-6616e5dae8cf None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:53.964679 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d6563-63b9-4832-9d11-6616e5dae8cf None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:53.964787 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d6563-63b9-4832-9d11-6616e5dae8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:54.021999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:54.043580 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-722d6563-63b9-4832-9d11-6616e5dae8cf None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:54.044799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-722d6563-63b9-4832-9d11-6616e5dae8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:54.138452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:54.296996 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb9604-7e88-474f-917e-1af2c87ee4be None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:54.299020 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5ffb9604-7e88-474f-917e-1af2c87ee4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:54.442693 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb9604-7e88-474f-917e-1af2c87ee4be None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:54.454637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:54.556066 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782b89b-dcb5-4291-83d9-dcd063c69990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:54.556604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782b89b-dcb5-4291-83d9-dcd063c69990 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:54.556886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782b89b-dcb5-4291-83d9-dcd063c69990 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:54.557156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782b89b-dcb5-4291-83d9-dcd063c69990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:54.558781 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2782b89b-dcb5-4291-83d9-dcd063c69990 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:54.656242 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782b89b-dcb5-4291-83d9-dcd063c69990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:13:54.658370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782b89b-dcb5-4291-83d9-dcd063c69990 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:13:54.676577 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 710/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:13:55.772138 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df936436-71bd-473c-bfb2-d3f9252761b1 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:55.772629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df936436-71bd-473c-bfb2-d3f9252761b1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:55.772746 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df936436-71bd-473c-bfb2-d3f9252761b1 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:55.774107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:55.780422 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48151f85-916f-4ea0-9369-8a9b227e9381 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:55.780831 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48151f85-916f-4ea0-9369-8a9b227e9381 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:55.780978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48151f85-916f-4ea0-9369-8a9b227e9381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:55.800651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:55.855586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-48151f85-916f-4ea0-9369-8a9b227e9381 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:55.856810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-48151f85-916f-4ea0-9369-8a9b227e9381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:55.950850 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:13:56.100157 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df936436-71bd-473c-bfb2-d3f9252761b1 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:56.101589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-df936436-71bd-473c-bfb2-d3f9252761b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:56.209384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:56.245234 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df936436-71bd-473c-bfb2-d3f9252761b1 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:56.353461 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bff16-f4e4-4e1a-8664-6e35cbc7b801 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:56.353996 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bff16-f4e4-4e1a-8664-6e35cbc7b801 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:56.354277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bff16-f4e4-4e1a-8664-6e35cbc7b801 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:56.354547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bff16-f4e4-4e1a-8664-6e35cbc7b801 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:56.356170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c96bff16-f4e4-4e1a-8664-6e35cbc7b801 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:56.433903 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:56.447538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bff16-f4e4-4e1a-8664-6e35cbc7b801 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:13:56.449131 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bff16-f4e4-4e1a-8664-6e35cbc7b801 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:13:56.466318 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 714/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:13:57.578438 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61682cea-9752-4ec9-83e8-13326949c8cf None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:57.578997 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61682cea-9752-4ec9-83e8-13326949c8cf None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:57.579114 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61682cea-9752-4ec9-83e8-13326949c8cf None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:57.580354 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:57.586355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562d51f-5bb3-4604-b405-f97e52c6944a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:57.586819 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562d51f-5bb3-4604-b405-f97e52c6944a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:57.586917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562d51f-5bb3-4604-b405-f97e52c6944a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:57.674865 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5562d51f-5bb3-4604-b405-f97e52c6944a None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:57.676074 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5562d51f-5bb3-4604-b405-f97e52c6944a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:57.770291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:13:57.921227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61682cea-9752-4ec9-83e8-13326949c8cf None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:57.923381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-61682cea-9752-4ec9-83e8-13326949c8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:58.017046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:58.077605 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61682cea-9752-4ec9-83e8-13326949c8cf None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:58.187874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11149b3e-6218-4d80-bb04-4cd0675cb213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:58.188489 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11149b3e-6218-4d80-bb04-4cd0675cb213 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:58.188766 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11149b3e-6218-4d80-bb04-4cd0675cb213 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:58.189035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11149b3e-6218-4d80-bb04-4cd0675cb213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:58.190614 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-11149b3e-6218-4d80-bb04-4cd0675cb213 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:58.237453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:58.278627 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11149b3e-6218-4d80-bb04-4cd0675cb213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:13:58.280202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11149b3e-6218-4d80-bb04-4cd0675cb213 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:13:58.301607 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 713/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:13:59.359692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37be07-b826-47b9-9276-0bb5d368ccf0 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:59.360861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37be07-b826-47b9-9276-0bb5d368ccf0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:59.360861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37be07-b826-47b9-9276-0bb5d368ccf0 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:59.362108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:13:59.368364 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dec675-3d92-4ce0-a9a1-25389e18faa0 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:59.368819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dec675-3d92-4ce0-a9a1-25389e18faa0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:59.368917 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dec675-3d92-4ce0-a9a1-25389e18faa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:59.444123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-25dec675-3d92-4ce0-a9a1-25389e18faa0 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:13:59.445331 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-25dec675-3d92-4ce0-a9a1-25389e18faa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:59.540085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:13:59.689399 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37be07-b826-47b9-9276-0bb5d368ccf0 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:13:59.691046 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4d37be07-b826-47b9-9276-0bb5d368ccf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:59.739337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:13:59.834500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37be07-b826-47b9-9276-0bb5d368ccf0 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:13:59.944635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878ddcc-9c5d-486d-b389-dd6c8c9d09e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:13:59.945134 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878ddcc-9c5d-486d-b389-dd6c8c9d09e1 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:13:59.945414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878ddcc-9c5d-486d-b389-dd6c8c9d09e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:13:59.945685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878ddcc-9c5d-486d-b389-dd6c8c9d09e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:13:59.947298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1878ddcc-9c5d-486d-b389-dd6c8c9d09e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:13:59.954012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:00.036755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878ddcc-9c5d-486d-b389-dd6c8c9d09e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:14:00.038340 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878ddcc-9c5d-486d-b389-dd6c8c9d09e1 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:14:00.056507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 717/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:14:01.101452 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03131559-536b-4640-af2c-71bb755ee39e None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:01.101997 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03131559-536b-4640-af2c-71bb755ee39e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:01.101997 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03131559-536b-4640-af2c-71bb755ee39e None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:01.103352 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:14:01.109583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7424970-9952-403a-a072-e58a5ea6d929 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:01.110533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7424970-9952-403a-a072-e58a5ea6d929 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:01.110745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7424970-9952-403a-a072-e58a5ea6d929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:01.184667 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f7424970-9952-403a-a072-e58a5ea6d929 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:14:01.185899 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f7424970-9952-403a-a072-e58a5ea6d929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:01.252036 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:01.280626 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:14:01.430294 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03131559-536b-4640-af2c-71bb755ee39e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:14:01.431909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-03131559-536b-4640-af2c-71bb755ee39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:01.448787 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:01.574230 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03131559-536b-4640-af2c-71bb755ee39e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:14:01.661193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:01.687503 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9be481-4043-48fc-a0b1-01eec5af07a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:14:01.688108 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9be481-4043-48fc-a0b1-01eec5af07a8 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:01.688387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9be481-4043-48fc-a0b1-01eec5af07a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:01.688654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9be481-4043-48fc-a0b1-01eec5af07a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:01.690284 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9f9be481-4043-48fc-a0b1-01eec5af07a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:01.776904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9be481-4043-48fc-a0b1-01eec5af07a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:14:01.778493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9be481-4043-48fc-a0b1-01eec5af07a8 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:14:01.796417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 716/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:14:02.843001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e73d4-9faf-43e7-9180-88f2e7037ad4 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:02.843546 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e73d4-9faf-43e7-9180-88f2e7037ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:02.843546 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e73d4-9faf-43e7-9180-88f2e7037ad4 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:02.844979 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:14:02.851171 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e31f0-9223-492b-b33c-e13f467be7e2 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:02.851587 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e31f0-9223-492b-b33c-e13f467be7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:02.851717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e31f0-9223-492b-b33c-e13f467be7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:02.926591 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-da1e31f0-9223-492b-b33c-e13f467be7e2 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:14:02.927813 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-da1e31f0-9223-492b-b33c-e13f467be7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:02.967476 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:03.026308 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:14:03.175442 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e73d4-9faf-43e7-9180-88f2e7037ad4 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:14:03.176945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-252e73d4-9faf-43e7-9180-88f2e7037ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:03.319565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e73d4-9faf-43e7-9180-88f2e7037ad4 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:14:03.372635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:03.433463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4ef21-86d9-400c-a050-4d2397b44dcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:14:03.434002 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4ef21-86d9-400c-a050-4d2397b44dcc service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:03.434282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4ef21-86d9-400c-a050-4d2397b44dcc service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:03.434552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4ef21-86d9-400c-a050-4d2397b44dcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:03.436163 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-83e4ef21-86d9-400c-a050-4d2397b44dcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:03.523178 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4ef21-86d9-400c-a050-4d2397b44dcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:14:03.524784 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4ef21-86d9-400c-a050-4d2397b44dcc service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:14:03.542920 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 720/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:14:04.599874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af69e12-6e4f-4b06-ace9-c8384a170a2e None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:04.600439 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af69e12-6e4f-4b06-ace9-c8384a170a2e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:04.600439 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af69e12-6e4f-4b06-ace9-c8384a170a2e None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:04.601739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:14:04.608079 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2b0a9-4aa3-482e-8bf1-99ac56f6633a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:04.608744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2b0a9-4aa3-482e-8bf1-99ac56f6633a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:04.608889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2b0a9-4aa3-482e-8bf1-99ac56f6633a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:04.683950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-34a2b0a9-4aa3-482e-8bf1-99ac56f6633a None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:14:04.685150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-34a2b0a9-4aa3-482e-8bf1-99ac56f6633a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:04.687135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:04.779396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:14:04.928800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af69e12-6e4f-4b06-ace9-c8384a170a2e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:14:04.930324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3af69e12-6e4f-4b06-ace9-c8384a170a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:05.073200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af69e12-6e4f-4b06-ace9-c8384a170a2e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:14:05.099854 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:05.183986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a790ca-a0d3-4b1b-9aa5-efd76e971f1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:14:05.184580 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a790ca-a0d3-4b1b-9aa5-efd76e971f1d service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:05.184857 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a790ca-a0d3-4b1b-9aa5-efd76e971f1d service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:05.185127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a790ca-a0d3-4b1b-9aa5-efd76e971f1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:05.186744 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-33a790ca-a0d3-4b1b-9aa5-efd76e971f1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:05.273896 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a790ca-a0d3-4b1b-9aa5-efd76e971f1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:14:05.275502 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a790ca-a0d3-4b1b-9aa5-efd76e971f1d service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:14:05.292743 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 719/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:14:07.379046 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b896d-cdd5-4bf6-a405-1f6624b87cd4 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:07.379562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b896d-cdd5-4bf6-a405-1f6624b87cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:07.379562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b896d-cdd5-4bf6-a405-1f6624b87cd4 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:07.380871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 04:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:14:07.386284 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885def9c-9731-40cc-b211-64950296f4d9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:07.386700 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885def9c-9731-40cc-b211-64950296f4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:07.386874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885def9c-9731-40cc-b211-64950296f4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:07.428137 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:07.453339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-885def9c-9731-40cc-b211-64950296f4d9 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:14:07.454543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-885def9c-9731-40cc-b211-64950296f4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:07.549763 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 04:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:14:07.837418 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b896d-cdd5-4bf6-a405-1f6624b87cd4 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:14:07.838995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a94b896d-cdd5-4bf6-a405-1f6624b87cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:07.941197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b896d-cdd5-4bf6-a405-1f6624b87cd4 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:14:07.973660 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:08.015196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf475471-7178-473e-95fa-670bf3f20bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:14:08.016355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf475471-7178-473e-95fa-670bf3f20bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:08.016573 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf475471-7178-473e-95fa-670bf3f20bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:08.016845 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf475471-7178-473e-95fa-670bf3f20bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:08.018436 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cf475471-7178-473e-95fa-670bf3f20bb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:08.124704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf475471-7178-473e-95fa-670bf3f20bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:14:08.126092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf475471-7178-473e-95fa-670bf3f20bb3 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:14:08.144645 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 723/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:14:10.447018 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e69eb-8a69-4c46-9951-44b752d3540d None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:10.447556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e69eb-8a69-4c46-9951-44b752d3540d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:10.447556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e69eb-8a69-4c46-9951-44b752d3540d None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:10.448930 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 04:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:14:10.454744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11554cbb-4efb-40c4-b0c5-40e1ff152a77 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:10.455189 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11554cbb-4efb-40c4-b0c5-40e1ff152a77 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:10.455358 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11554cbb-4efb-40c4-b0c5-40e1ff152a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:10.519675 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-11554cbb-4efb-40c4-b0c5-40e1ff152a77 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:14:10.520870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-11554cbb-4efb-40c4-b0c5-40e1ff152a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:10.533250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:10.614971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 04:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:14:10.901053 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e69eb-8a69-4c46-9951-44b752d3540d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:14:10.902677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-047e69eb-8a69-4c46-9951-44b752d3540d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:11.004979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e69eb-8a69-4c46-9951-44b752d3540d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:14:11.017526 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:11.078563 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2431b3-f17b-4d10-8202-e32ae91097d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:14:11.079181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2431b3-f17b-4d10-8202-e32ae91097d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:11.079457 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2431b3-f17b-4d10-8202-e32ae91097d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:11.079728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2431b3-f17b-4d10-8202-e32ae91097d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:11.081296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2f2431b3-f17b-4d10-8202-e32ae91097d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:11.188451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2431b3-f17b-4d10-8202-e32ae91097d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:14:11.189907 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2431b3-f17b-4d10-8202-e32ae91097d7 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:14:11.207910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 722/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:14:13.670114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478228a-f2cf-40d4-916a-33cd9cfc9f2a None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:13.670759 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478228a-f2cf-40d4-916a-33cd9cfc9f2a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:13.670759 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478228a-f2cf-40d4-916a-33cd9cfc9f2a None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:13.672658 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 04:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:14:13.677831 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61618c54-1dd7-4d69-84e9-58e355a8d0e9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:13.678268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61618c54-1dd7-4d69-84e9-58e355a8d0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:13.678370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61618c54-1dd7-4d69-84e9-58e355a8d0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:13.724921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:13.743539 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-61618c54-1dd7-4d69-84e9-58e355a8d0e9 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:14:13.744738 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-61618c54-1dd7-4d69-84e9-58e355a8d0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:13.839287 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 04:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:14:14.132586 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478228a-f2cf-40d4-916a-33cd9cfc9f2a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:14:14.134169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2478228a-f2cf-40d4-916a-33cd9cfc9f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:14.235276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478228a-f2cf-40d4-916a-33cd9cfc9f2a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:14:14.279383 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:14.313625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b19f2-7193-454e-b775-aad105466434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:14:14.314259 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b19f2-7193-454e-b775-aad105466434 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:14.314541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b19f2-7193-454e-b775-aad105466434 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:14.314846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b19f2-7193-454e-b775-aad105466434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:14.316484 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-697b19f2-7193-454e-b775-aad105466434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:14.424723 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b19f2-7193-454e-b775-aad105466434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:14:14.426197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b19f2-7193-454e-b775-aad105466434 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:14:14.444474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 726/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:14:16.702250 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7698958-f3b1-4712-8fe3-585bb929466c None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:16.703372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7698958-f3b1-4712-8fe3-585bb929466c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:16.703480 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7698958-f3b1-4712-8fe3-585bb929466c None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:16.704732 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 04:14:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:14:16.709923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67685e0-5166-4c77-85f5-18d41734f309 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:16.710378 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67685e0-5166-4c77-85f5-18d41734f309 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:16.710550 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67685e0-5166-4c77-85f5-18d41734f309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:16.775277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d67685e0-5166-4c77-85f5-18d41734f309 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:14:16.776476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d67685e0-5166-4c77-85f5-18d41734f309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:16.796830 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:16.872659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 04:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:14:17.155135 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7698958-f3b1-4712-8fe3-585bb929466c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:14:17.157161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d7698958-f3b1-4712-8fe3-585bb929466c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:17.256867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7698958-f3b1-4712-8fe3-585bb929466c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:14:17.276554 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:17.329308 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa8bc8-f25c-4722-95ab-83bef926d1f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:14:17.329911 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa8bc8-f25c-4722-95ab-83bef926d1f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:17.330187 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa8bc8-f25c-4722-95ab-83bef926d1f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:17.330457 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa8bc8-f25c-4722-95ab-83bef926d1f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:17.332098 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-82fa8bc8-f25c-4722-95ab-83bef926d1f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:17.439745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa8bc8-f25c-4722-95ab-83bef926d1f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:14:17.441188 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa8bc8-f25c-4722-95ab-83bef926d1f1 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:14:17.458629 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 725/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:14:19.654795 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8d7ed-2768-4443-85d8-97aafe51172f None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:19.655316 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8d7ed-2768-4443-85d8-97aafe51172f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:19.655316 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8d7ed-2768-4443-85d8-97aafe51172f None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:19.657164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 04:14:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:14:19.662610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2a8f1-a019-46ee-b197-8dab709ea684 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:19.663091 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2a8f1-a019-46ee-b197-8dab709ea684 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:19.663206 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2a8f1-a019-46ee-b197-8dab709ea684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:19.725725 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:19.729483 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-2fa2a8f1-a019-46ee-b197-8dab709ea684 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:14:19.730909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2fa2a8f1-a019-46ee-b197-8dab709ea684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:19.825850 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 04:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:14:20.109880 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8d7ed-2768-4443-85d8-97aafe51172f None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:14:20.111432 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-aed8d7ed-2768-4443-85d8-97aafe51172f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:20.211382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8d7ed-2768-4443-85d8-97aafe51172f None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:14:20.259493 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:20.283514 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230f3cf-cc3c-4f21-9226-abdc637bd6e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:14:20.284106 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230f3cf-cc3c-4f21-9226-abdc637bd6e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:20.284387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230f3cf-cc3c-4f21-9226-abdc637bd6e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:20.284663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230f3cf-cc3c-4f21-9226-abdc637bd6e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:20.286229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d230f3cf-cc3c-4f21-9226-abdc637bd6e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:20.391008 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230f3cf-cc3c-4f21-9226-abdc637bd6e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:14:20.392367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230f3cf-cc3c-4f21-9226-abdc637bd6e3 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:14:20.411107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 729/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:14:22.589520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b447c-8a04-45d3-b2c8-bb68065c6133 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:22.590049 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b447c-8a04-45d3-b2c8-bb68065c6133 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:22.590049 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b447c-8a04-45d3-b2c8-bb68065c6133 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:22.591434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 04:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:14:22.596712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927198f1-0675-43d3-9a25-deada4ada0e3 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:22.597136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927198f1-0675-43d3-9a25-deada4ada0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:22.597264 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927198f1-0675-43d3-9a25-deada4ada0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:22.662165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-927198f1-0675-43d3-9a25-deada4ada0e3 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:14:22.663317 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-927198f1-0675-43d3-9a25-deada4ada0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:22.691616 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:22.757096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 04:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:14:23.039928 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b447c-8a04-45d3-b2c8-bb68065c6133 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:14:23.041523 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5d3b447c-8a04-45d3-b2c8-bb68065c6133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:23.142653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b447c-8a04-45d3-b2c8-bb68065c6133 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:14:23.172002 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:23.215142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91047a-bf97-41f9-a802-8a077944c35d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:14:23.215742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91047a-bf97-41f9-a802-8a077944c35d service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:23.216027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91047a-bf97-41f9-a802-8a077944c35d service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:23.216298 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91047a-bf97-41f9-a802-8a077944c35d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:23.218413 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ac91047a-bf97-41f9-a802-8a077944c35d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:23.328186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91047a-bf97-41f9-a802-8a077944c35d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:14:23.329959 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91047a-bf97-41f9-a802-8a077944c35d service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:14:23.348338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 728/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:14:25.543088 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8cb92-9e89-44a6-af1e-06830632caf2 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:25.543620 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8cb92-9e89-44a6-af1e-06830632caf2 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:25.543620 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8cb92-9e89-44a6-af1e-06830632caf2 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:25.544983 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 04:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:14:25.550692 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ff7c6-3101-45bd-be52-346bd23179b5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:25.551125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ff7c6-3101-45bd-be52-346bd23179b5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:25.551272 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ff7c6-3101-45bd-be52-346bd23179b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:25.615574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-914ff7c6-3101-45bd-be52-346bd23179b5 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:14:25.616769 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-914ff7c6-3101-45bd-be52-346bd23179b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:25.625072 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:25.713530 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 04:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:14:25.994631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8cb92-9e89-44a6-af1e-06830632caf2 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:14:25.996179 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-bbd8cb92-9e89-44a6-af1e-06830632caf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:26.100414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8cb92-9e89-44a6-af1e-06830632caf2 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:14:26.155837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:26.173404 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4239b7-0dfd-44c3-b486-d9328ebe3929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:14:26.174017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4239b7-0dfd-44c3-b486-d9328ebe3929 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:26.174298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4239b7-0dfd-44c3-b486-d9328ebe3929 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:26.174575 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4239b7-0dfd-44c3-b486-d9328ebe3929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:26.176206 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ce4239b7-0dfd-44c3-b486-d9328ebe3929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:26.283960 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4239b7-0dfd-44c3-b486-d9328ebe3929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:14:26.285328 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4239b7-0dfd-44c3-b486-d9328ebe3929 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:14:26.303347 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 732/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:14:28.509402 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6282616-4e40-4741-a55a-2eef1426a083 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:28.509858 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6282616-4e40-4741-a55a-2eef1426a083 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:28.509965 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6282616-4e40-4741-a55a-2eef1426a083 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:28.511408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 04:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:14:28.517393 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586308c3-3ef9-4e02-a713-9827dd2a2c1b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:28.517800 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586308c3-3ef9-4e02-a713-9827dd2a2c1b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:28.517940 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586308c3-3ef9-4e02-a713-9827dd2a2c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:28.583463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-586308c3-3ef9-4e02-a713-9827dd2a2c1b None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:14:28.584010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-586308c3-3ef9-4e02-a713-9827dd2a2c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:28.624778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:28.682992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 04:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:14:28.977068 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6282616-4e40-4741-a55a-2eef1426a083 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:14:28.978648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f6282616-4e40-4741-a55a-2eef1426a083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:29.086988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6282616-4e40-4741-a55a-2eef1426a083 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:14:29.124745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:29.160188 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec4384-28ad-4da9-892e-4949b9d7e8c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:14:29.160785 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec4384-28ad-4da9-892e-4949b9d7e8c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:29.161067 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec4384-28ad-4da9-892e-4949b9d7e8c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:29.161342 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec4384-28ad-4da9-892e-4949b9d7e8c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:29.163160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3dec4384-28ad-4da9-892e-4949b9d7e8c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:29.269972 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec4384-28ad-4da9-892e-4949b9d7e8c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:14:29.271376 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec4384-28ad-4da9-892e-4949b9d7e8c6 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:14:29.289191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 731/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:14:31.460923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc8eaa-1c99-44aa-8bfc-370b4b867926 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:31.461458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc8eaa-1c99-44aa-8bfc-370b4b867926 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:31.461588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc8eaa-1c99-44aa-8bfc-370b4b867926 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:31.462878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 04:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:14:31.468406 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8c06e-99cb-4539-b153-5c122ab20400 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:31.468831 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8c06e-99cb-4539-b153-5c122ab20400 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:31.468993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8c06e-99cb-4539-b153-5c122ab20400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:31.534969 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-90d8c06e-99cb-4539-b153-5c122ab20400 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:14:31.536170 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-90d8c06e-99cb-4539-b153-5c122ab20400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:31.553749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:31.631614 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 04:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:14:31.909412 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc8eaa-1c99-44aa-8bfc-370b4b867926 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:14:31.910969 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-00cc8eaa-1c99-44aa-8bfc-370b4b867926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:32.011174 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc8eaa-1c99-44aa-8bfc-370b4b867926 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:14:32.076714 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:32.083656 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd933f-5a96-4f98-82b4-6de3f0f0e6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:14:32.084260 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd933f-5a96-4f98-82b4-6de3f0f0e6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:32.084543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd933f-5a96-4f98-82b4-6de3f0f0e6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:32.084817 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd933f-5a96-4f98-82b4-6de3f0f0e6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:32.086413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-27fd933f-5a96-4f98-82b4-6de3f0f0e6e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:32.198157 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd933f-5a96-4f98-82b4-6de3f0f0e6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:14:32.199642 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd933f-5a96-4f98-82b4-6de3f0f0e6e8 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:14:32.218260 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 735/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:14:34.368783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47684f-44bb-4de9-b3bb-b7a5c7dc2789 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:34.369359 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47684f-44bb-4de9-b3bb-b7a5c7dc2789 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:34.369359 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47684f-44bb-4de9-b3bb-b7a5c7dc2789 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:34.370649 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 04:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:14:34.376696 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4364fb-2dab-46c1-8577-ac8ab30171e7 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:34.377133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4364fb-2dab-46c1-8577-ac8ab30171e7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:34.377240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4364fb-2dab-46c1-8577-ac8ab30171e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:34.444152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-2b4364fb-2dab-46c1-8577-ac8ab30171e7 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:14:34.445363 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2b4364fb-2dab-46c1-8577-ac8ab30171e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:34.492102 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:34.539394 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 04:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:14:34.822365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47684f-44bb-4de9-b3bb-b7a5c7dc2789 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:14:34.823955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-be47684f-44bb-4de9-b3bb-b7a5c7dc2789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:34.928191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47684f-44bb-4de9-b3bb-b7a5c7dc2789 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:14:34.976418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:35.002930 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2880580-81c6-4539-b25a-50455d49fd85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:14:35.003544 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2880580-81c6-4539-b25a-50455d49fd85 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:35.003827 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2880580-81c6-4539-b25a-50455d49fd85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:35.004101 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2880580-81c6-4539-b25a-50455d49fd85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:35.005701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d2880580-81c6-4539-b25a-50455d49fd85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:35.116490 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2880580-81c6-4539-b25a-50455d49fd85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:14:35.117826 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2880580-81c6-4539-b25a-50455d49fd85 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:14:35.136038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 734/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:14:44.537808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=22 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:45.133676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=66 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:55.023042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a3874-42f9-449c-afc0-9d96841e0496 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:55.023611 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a3874-42f9-449c-afc0-9d96841e0496 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:55.023611 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a3874-42f9-449c-afc0-9d96841e0496 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:55.025021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 737/1471] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:14:55.030708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55fae5-71ee-4a92-a7ad-b4799d5c2b99 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:55.031159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55fae5-71ee-4a92-a7ad-b4799d5c2b99 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:55.031306 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55fae5-71ee-4a92-a7ad-b4799d5c2b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:55.103254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-7e55fae5-71ee-4a92-a7ad-b4799d5c2b99 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:14:55.104474 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7e55fae5-71ee-4a92-a7ad-b4799d5c2b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:55.200051 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 735/1472] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:14:55.498354 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07af99-73e5-4216-9e35-7c8dbd09b759 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:55.498639 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07af99-73e5-4216-9e35-7c8dbd09b759 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:55.498968 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07af99-73e5-4216-9e35-7c8dbd09b759 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:55.500329 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 738/1473] 10.222.0.48 () {54 vars in 962 bytes} [Tue Sep 27 04:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:14:55.505166 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84ea3c-c373-4fcd-ae47-25f2047656a1 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:55.505451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84ea3c-c373-4fcd-ae47-25f2047656a1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:55.505726 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84ea3c-c373-4fcd-ae47-25f2047656a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:55.579240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0c84ea3c-c373-4fcd-ae47-25f2047656a1 None None] MFA Rules not processed for user `405499a1b5dc4fb6ac7af73910c3d992`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:14:55.580356 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0c84ea3c-c373-4fcd-ae47-25f2047656a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:55.600064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:55.656876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 736/1474] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Sep 27 04:14:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:14:55.667322 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07af99-73e5-4216-9e35-7c8dbd09b759 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:14:55.671443 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3a07af99-73e5-4216-9e35-7c8dbd09b759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:55.780740 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07af99-73e5-4216-9e35-7c8dbd09b759 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:14:55.853379 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6f0fc-1fca-4e3a-a2a9-c06a21a74b4e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '405499a1b5dc4fb6ac7af73910c3d992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:14:55.853950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6f0fc-1fca-4e3a-a2a9-c06a21a74b4e service glance] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:55.854197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6f0fc-1fca-4e3a-a2a9-c06a21a74b4e service glance] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:55.854474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6f0fc-1fca-4e3a-a2a9-c06a21a74b4e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:55.856145 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-83e6f0fc-1fca-4e3a-a2a9-c06a21a74b4e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:55.909689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:55.964411 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6f0fc-1fca-4e3a-a2a9-c06a21a74b4e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:14:55.966373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6f0fc-1fca-4e3a-a2a9-c06a21a74b4e service glance] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:14:55.985012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 739/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:14:58.224342 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13c927-8085-41a4-be64-97423f368ba8 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:58.224887 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13c927-8085-41a4-be64-97423f368ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:58.224887 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13c927-8085-41a4-be64-97423f368ba8 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:58.226203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 737/1476] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:14:58.231618 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3691cf-476b-4b57-b40e-a72c4a6b8b6c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:58.232045 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3691cf-476b-4b57-b40e-a72c4a6b8b6c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:58.232143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3691cf-476b-4b57-b40e-a72c4a6b8b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:58.295925 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-df3691cf-476b-4b57-b40e-a72c4a6b8b6c None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:14:58.297108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-df3691cf-476b-4b57-b40e-a72c4a6b8b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:58.391755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 740/1477] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:14:58.673411 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13c927-8085-41a4-be64-97423f368ba8 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:14:58.674988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9d13c927-8085-41a4-be64-97423f368ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:14:58.802897 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13c927-8085-41a4-be64-97423f368ba8 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:14:58.855159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:14:58.899372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d239352-dae3-424e-b981-d0bb4747c2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:14:58.899977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d239352-dae3-424e-b981-d0bb4747c2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:14:58.900256 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d239352-dae3-424e-b981-d0bb4747c2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:14:58.900527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d239352-dae3-424e-b981-d0bb4747c2b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:14:58.901170 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d239352-dae3-424e-b981-d0bb4747c2b8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:14:58.902931 dv-cinder-859186-3-smb devstack@keystone.service[81374]: WARNING py.warnings [None req-4d239352-dae3-424e-b981-d0bb4747c2b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 04:14:58.902931 dv-cinder-859186-3-smb devstack@keystone.service[81374]: warnings.warn(msg) Sep 27 04:14:58.902931 dv-cinder-859186-3-smb devstack@keystone.service[81374]: Sep 27 04:14:58.904569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d239352-dae3-424e-b981-d0bb4747c2b8 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:14:58.923864 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 738/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 27 04:14:58 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:15:01.145932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8cb57-9cfe-46f7-abd3-bbe9782eb25a None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:15:01.146495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8cb57-9cfe-46f7-abd3-bbe9782eb25a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:15:01.146495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8cb57-9cfe-46f7-abd3-bbe9782eb25a None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:15:01.147923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 741/1479] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:15:01.153329 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b352d8f-d9c5-4284-ba01-9ec558396bd5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:15:01.153752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b352d8f-d9c5-4284-ba01-9ec558396bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:15:01.153916 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b352d8f-d9c5-4284-ba01-9ec558396bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:15:01.218989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5b352d8f-d9c5-4284-ba01-9ec558396bd5 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:15:01.220199 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5b352d8f-d9c5-4284-ba01-9ec558396bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:15:01.314684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 739/1480] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:15:01.621126 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8cb57-9cfe-46f7-abd3-bbe9782eb25a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:15:01.622710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-99a8cb57-9cfe-46f7-abd3-bbe9782eb25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:15:01.632657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:15:01.764531 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8cb57-9cfe-46f7-abd3-bbe9782eb25a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:15:01.842765 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:15:01.875445 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5734fe-f6e8-4ef5-8368-1ce1c9d8ed4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:15:01.876046 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5734fe-f6e8-4ef5-8368-1ce1c9d8ed4a service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:15:01.876320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5734fe-f6e8-4ef5-8368-1ce1c9d8ed4a service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:15:01.876588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5734fe-f6e8-4ef5-8368-1ce1c9d8ed4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:15:01.878160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4c5734fe-f6e8-4ef5-8368-1ce1c9d8ed4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:15:01.965960 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5734fe-f6e8-4ef5-8368-1ce1c9d8ed4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:15:01.967594 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5734fe-f6e8-4ef5-8368-1ce1c9d8ed4a service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:15:01.985226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 742/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:15:04.291717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd26f5c-469b-4aa8-bebb-55e8ce17eefe None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:15:04.292307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd26f5c-469b-4aa8-bebb-55e8ce17eefe None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:15:04.292307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd26f5c-469b-4aa8-bebb-55e8ce17eefe None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:15:04.294159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 740/1482] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:15:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:15:04.299524 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88d73e-5a81-47f2-a5c7-6d11c4115b60 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:15:04.299929 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88d73e-5a81-47f2-a5c7-6d11c4115b60 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:15:04.300075 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88d73e-5a81-47f2-a5c7-6d11c4115b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:15:04.364844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-cd88d73e-5a81-47f2-a5c7-6d11c4115b60 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:15:04.366049 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cd88d73e-5a81-47f2-a5c7-6d11c4115b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:15:04.412840 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:15:04.463187 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 743/1483] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:15:04.750624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd26f5c-469b-4aa8-bebb-55e8ce17eefe None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:15:04.752225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-dcd26f5c-469b-4aa8-bebb-55e8ce17eefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:15:04.775810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:15:04.853534 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd26f5c-469b-4aa8-bebb-55e8ce17eefe None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:15:04.925935 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4cd4d-b2b4-490c-a2b4-d0b10b689d39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:15:04.926542 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4cd4d-b2b4-490c-a2b4-d0b10b689d39 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:15:04.926857 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4cd4d-b2b4-490c-a2b4-d0b10b689d39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:15:04.927129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4cd4d-b2b4-490c-a2b4-d0b10b689d39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:15:04.928771 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d9a4cd4d-b2b4-490c-a2b4-d0b10b689d39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:15:05.003065 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:15:05.037229 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4cd4d-b2b4-490c-a2b4-d0b10b689d39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:15:05.038654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4cd4d-b2b4-490c-a2b4-d0b10b689d39 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:15:05.055954 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 741/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:15:07.227980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa6317-af86-4d7e-bde5-637f55540f11 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:15:07.228569 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa6317-af86-4d7e-bde5-637f55540f11 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:15:07.228569 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa6317-af86-4d7e-bde5-637f55540f11 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:15:07.229868 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 744/1485] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:15:07.236121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5337c-3a0f-4ecd-99b7-123d57cfd038 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:15:07.236551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5337c-3a0f-4ecd-99b7-123d57cfd038 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:15:07.236685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5337c-3a0f-4ecd-99b7-123d57cfd038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:15:07.301340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d7a5337c-3a0f-4ecd-99b7-123d57cfd038 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:15:07.302544 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d7a5337c-3a0f-4ecd-99b7-123d57cfd038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:15:07.397033 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 742/1486] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:15:07.686672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa6317-af86-4d7e-bde5-637f55540f11 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:15:07.688298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fdaa6317-af86-4d7e-bde5-637f55540f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:15:07.792017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa6317-af86-4d7e-bde5-637f55540f11 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:15:07.864786 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:15:07.866377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3cd2f-86d9-4736-b64a-bd7a9b9a87bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:15:07.867113 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3cd2f-86d9-4736-b64a-bd7a9b9a87bd service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:15:07.867592 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3cd2f-86d9-4736-b64a-bd7a9b9a87bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:15:07.868268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3cd2f-86d9-4736-b64a-bd7a9b9a87bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:15:07.869864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-33b3cd2f-86d9-4736-b64a-bd7a9b9a87bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:15:07.975703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3cd2f-86d9-4736-b64a-bd7a9b9a87bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:15:07.977052 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3cd2f-86d9-4736-b64a-bd7a9b9a87bd service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:15:07.994473 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 745/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:15:10.193362 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c034a1d-2d40-4154-89bf-5864b7aa94be None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:15:10.193926 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c034a1d-2d40-4154-89bf-5864b7aa94be None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:15:10.193926 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c034a1d-2d40-4154-89bf-5864b7aa94be None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:15:10.195331 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 743/1488] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:15:10.201203 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42351fb3-bd76-4a16-9f65-5867ab0fc727 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:15:10.201628 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42351fb3-bd76-4a16-9f65-5867ab0fc727 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:15:10.201778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42351fb3-bd76-4a16-9f65-5867ab0fc727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:15:10.266476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-42351fb3-bd76-4a16-9f65-5867ab0fc727 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:15:10.267700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-42351fb3-bd76-4a16-9f65-5867ab0fc727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:15:10.318199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:15:10.360917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 746/1489] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:15:10.651114 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c034a1d-2d40-4154-89bf-5864b7aa94be None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:15:10.652959 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2c034a1d-2d40-4154-89bf-5864b7aa94be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:15:10.688977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:15:10.758582 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c034a1d-2d40-4154-89bf-5864b7aa94be None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:15:10.830465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096b414-e397-4a54-91be-024bdb17d214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:15:10.831026 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096b414-e397-4a54-91be-024bdb17d214 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:15:10.831313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096b414-e397-4a54-91be-024bdb17d214 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:15:10.831615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096b414-e397-4a54-91be-024bdb17d214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:15:10.833202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d096b414-e397-4a54-91be-024bdb17d214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:15:10.912457 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:15:10.941359 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096b414-e397-4a54-91be-024bdb17d214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:15:10.942819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096b414-e397-4a54-91be-024bdb17d214 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:15:10.960716 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 744/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:15:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:15:13.419506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce818baa-f49a-4393-a213-f1dec8b79bce None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:15:13.420015 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce818baa-f49a-4393-a213-f1dec8b79bce None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:15:13.420124 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce818baa-f49a-4393-a213-f1dec8b79bce None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:15:13.421453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 747/1491] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 27 04:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:15:13.426807 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed57b41-57c9-466c-b566-ff54c75a8368 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:15:13.427304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed57b41-57c9-466c-b566-ff54c75a8368 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:15:13.427408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed57b41-57c9-466c-b566-ff54c75a8368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:15:13.492530 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-9ed57b41-57c9-466c-b566-ff54c75a8368 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:15:13.493764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9ed57b41-57c9-466c-b566-ff54c75a8368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:15:13.587376 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 745/1492] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 27 04:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:15:13.881366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce818baa-f49a-4393-a213-f1dec8b79bce None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:15:13.882977 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ce818baa-f49a-4393-a213-f1dec8b79bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:15:13.984622 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce818baa-f49a-4393-a213-f1dec8b79bce None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:15:14.055320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76501282-501f-41d1-b243-dc2f90bab40c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:15:14.055914 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76501282-501f-41d1-b243-dc2f90bab40c service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:15:14.056193 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76501282-501f-41d1-b243-dc2f90bab40c service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:15:14.056462 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76501282-501f-41d1-b243-dc2f90bab40c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:15:14.058040 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-76501282-501f-41d1-b243-dc2f90bab40c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:15:14.067261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:15:14.172235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76501282-501f-41d1-b243-dc2f90bab40c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:15:14.173685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76501282-501f-41d1-b243-dc2f90bab40c service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:15:14.191816 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 748/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:15:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:15:23.585879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=82 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:15:24.189577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=50 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:16:27.841130 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc04be1-edc0-4271-b4a5-e3ec7b8189f5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:16:27.841753 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc04be1-edc0-4271-b4a5-e3ec7b8189f5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:16:27.841753 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc04be1-edc0-4271-b4a5-e3ec7b8189f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:16:27.916557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-2fc04be1-edc0-4271-b4a5-e3ec7b8189f5 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:16:27.917770 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2fc04be1-edc0-4271-b4a5-e3ec7b8189f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:16:28.012212 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 746/1494] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:16:28.020094 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8fed0-7da9-4573-9615-dafed07fbbfb None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:16:28.020592 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8fed0-7da9-4573-9615-dafed07fbbfb None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:16:28.020795 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8fed0-7da9-4573-9615-dafed07fbbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:16:28.099913 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-39f8fed0-7da9-4573-9615-dafed07fbbfb None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:16:28.101056 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-39f8fed0-7da9-4573-9615-dafed07fbbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:16:28.196488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 749/1495] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:16:28.201122 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc04be1-edc0-4271-b4a5-e3ec7b8189f5 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:16:28.202332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2fc04be1-edc0-4271-b4a5-e3ec7b8189f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:16:28.213738 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc04be1-edc0-4271-b4a5-e3ec7b8189f5 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:16:28.275290 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:16:28.307882 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee10176-4ab7-4255-85cd-1c6497a23736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:16:28.308481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee10176-4ab7-4255-85cd-1c6497a23736 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:16:28.308764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee10176-4ab7-4255-85cd-1c6497a23736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:16:28.309039 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee10176-4ab7-4255-85cd-1c6497a23736 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:16:28.309685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee10176-4ab7-4255-85cd-1c6497a23736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:16:28.309992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee10176-4ab7-4255-85cd-1c6497a23736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:16:28.311029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: WARNING py.warnings [None req-fee10176-4ab7-4255-85cd-1c6497a23736 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 04:16:28.311029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: warnings.warn(msg) Sep 27 04:16:28.311029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: Sep 27 04:16:28.311914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee10176-4ab7-4255-85cd-1c6497a23736 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:16:28.324466 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 747/1496] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:16:28.332711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8fed0-7da9-4573-9615-dafed07fbbfb None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:16:28.341681 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8fed0-7da9-4573-9615-dafed07fbbfb None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:16:28.402646 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:16:28.436317 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec8d68-a213-49c2-ac00-154f9a112fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:16:28.436921 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec8d68-a213-49c2-ac00-154f9a112fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:16:28.437198 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec8d68-a213-49c2-ac00-154f9a112fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:16:28.437470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec8d68-a213-49c2-ac00-154f9a112fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:16:28.438092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec8d68-a213-49c2-ac00-154f9a112fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:16:28.439834 dv-cinder-859186-3-smb devstack@keystone.service[81375]: WARNING py.warnings [None req-dcec8d68-a213-49c2-ac00-154f9a112fe3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 04:16:28.439834 dv-cinder-859186-3-smb devstack@keystone.service[81375]: warnings.warn(msg) Sep 27 04:16:28.439834 dv-cinder-859186-3-smb devstack@keystone.service[81375]: Sep 27 04:16:28.441022 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec8d68-a213-49c2-ac00-154f9a112fe3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:16:28.495826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 750/1497] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:16:28 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:16:28.500155 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee10176-4ab7-4255-85cd-1c6497a23736 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:16:28.501712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fee10176-4ab7-4255-85cd-1c6497a23736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:16:28.533266 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee10176-4ab7-4255-85cd-1c6497a23736 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:16:28.628560 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a062f-8230-4d42-8f5b-391435dbbd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:16:28.629163 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a062f-8230-4d42-8f5b-391435dbbd10 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:16:28.629437 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a062f-8230-4d42-8f5b-391435dbbd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:16:28.629706 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a062f-8230-4d42-8f5b-391435dbbd10 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:16:28.630328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a062f-8230-4d42-8f5b-391435dbbd10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:16:28.631379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: WARNING py.warnings [None req-b66a062f-8230-4d42-8f5b-391435dbbd10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 04:16:28.631379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: warnings.warn(msg) Sep 27 04:16:28.631379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: Sep 27 04:16:28.632587 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a062f-8230-4d42-8f5b-391435dbbd10 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:16:28.673969 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 748/1498] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:16:28 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:16:28.678042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec8d68-a213-49c2-ac00-154f9a112fe3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:16:28.679582 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-dcec8d68-a213-49c2-ac00-154f9a112fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:16:28.739961 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec8d68-a213-49c2-ac00-154f9a112fe3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:16:28.828098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:16:28.840701 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297dc80-c944-4933-8670-b43d3717bce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:16:28.841317 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297dc80-c944-4933-8670-b43d3717bce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:16:28.841602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297dc80-c944-4933-8670-b43d3717bce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:16:28.841881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297dc80-c944-4933-8670-b43d3717bce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:16:28.842534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297dc80-c944-4933-8670-b43d3717bce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:16:28.843611 dv-cinder-859186-3-smb devstack@keystone.service[81375]: WARNING py.warnings [None req-0297dc80-c944-4933-8670-b43d3717bce5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 04:16:28.843611 dv-cinder-859186-3-smb devstack@keystone.service[81375]: warnings.warn(msg) Sep 27 04:16:28.843611 dv-cinder-859186-3-smb devstack@keystone.service[81375]: Sep 27 04:16:28.844515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297dc80-c944-4933-8670-b43d3717bce5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:16:28.858302 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 751/1499] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:16:28.862400 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a062f-8230-4d42-8f5b-391435dbbd10 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:16:28.864123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b66a062f-8230-4d42-8f5b-391435dbbd10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:16:28.875477 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a062f-8230-4d42-8f5b-391435dbbd10 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:16:28.900427 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:16:28.971172 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81665350-e4b4-4802-b9f8-6a7372ed1651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:16:28.971701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81665350-e4b4-4802-b9f8-6a7372ed1651 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:16:28.971985 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81665350-e4b4-4802-b9f8-6a7372ed1651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:16:28.972262 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81665350-e4b4-4802-b9f8-6a7372ed1651 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:16:28.972913 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81665350-e4b4-4802-b9f8-6a7372ed1651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:16:28.973921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: WARNING py.warnings [None req-81665350-e4b4-4802-b9f8-6a7372ed1651 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 04:16:28.973921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: warnings.warn(msg) Sep 27 04:16:28.973921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: Sep 27 04:16:28.974848 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81665350-e4b4-4802-b9f8-6a7372ed1651 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:16:28.987768 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 749/1500] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:16:28.991864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297dc80-c944-4933-8670-b43d3717bce5 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:16:28.993421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0297dc80-c944-4933-8670-b43d3717bce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:16:29.027375 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297dc80-c944-4933-8670-b43d3717bce5 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:16:29.121246 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48639a29-9281-40b9-854a-82c7ab751ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:16:29.121901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48639a29-9281-40b9-854a-82c7ab751ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:16:29.122183 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48639a29-9281-40b9-854a-82c7ab751ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:16:29.122455 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48639a29-9281-40b9-854a-82c7ab751ba7 admin admin] PATH_INFO: `/v3/projects/7481e6212baf4839b1e36b26e4d0e47b/users/2378b1ee97d84209b0ce17cf7c4d57ec/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:16:29.144252 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48639a29-9281-40b9-854a-82c7ab751ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7481e6212baf4839b1e36b26e4d0e47b, user_id=2378b1ee97d84209b0ce17cf7c4d57ec, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:16:29.145286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: WARNING py.warnings [None req-48639a29-9281-40b9-854a-82c7ab751ba7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 04:16:29.145286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: warnings.warn(msg) Sep 27 04:16:29.145286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: Sep 27 04:16:29.147246 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48639a29-9281-40b9-854a-82c7ab751ba7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:16:29.171975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 752/1501] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:16:28 2022] PUT /identity/v3/projects/7481e6212baf4839b1e36b26e4d0e47b/users/2378b1ee97d84209b0ce17cf7c4d57ec/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:16:29.184156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933248ac-cb8a-4b20-a105-b7aeb774fd97 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:16:29.184447 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933248ac-cb8a-4b20-a105-b7aeb774fd97 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:16:29.184722 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933248ac-cb8a-4b20-a105-b7aeb774fd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:16:29.241066 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-933248ac-cb8a-4b20-a105-b7aeb774fd97 None None] MFA Rules not processed for user `2378b1ee97d84209b0ce17cf7c4d57ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:16:29.242191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-933248ac-cb8a-4b20-a105-b7aeb774fd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:16:29.318251 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 750/1502] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:16:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:16:29.331794 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56bf3c-4aee-483f-8113-d501a0520695 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:16:29.332099 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56bf3c-4aee-483f-8113-d501a0520695 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:16:29.332371 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56bf3c-4aee-483f-8113-d501a0520695 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:16:29.333696 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 753/1503] 10.222.0.48 () {54 vars in 963 bytes} [Tue Sep 27 04:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:16:29.338963 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267aaea-4629-4504-adc3-581cbe5eecb0 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:16:29.339251 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267aaea-4629-4504-adc3-581cbe5eecb0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:16:29.339532 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267aaea-4629-4504-adc3-581cbe5eecb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:16:29.370140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:16:29.415602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f267aaea-4629-4504-adc3-581cbe5eecb0 None None] MFA Rules not processed for user `de5ccc88318a4b96969facf8df7bd504`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:16:29.416810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f267aaea-4629-4504-adc3-581cbe5eecb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:16:29.490182 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 751/1504] 10.222.0.48 () {58 vars in 1060 bytes} [Tue Sep 27 04:16:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:16:29.497880 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56bf3c-4aee-483f-8113-d501a0520695 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:16:29.499457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2a56bf3c-4aee-483f-8113-d501a0520695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:16:29.548537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:16:29.602075 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56bf3c-4aee-483f-8113-d501a0520695 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:16:29.673602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e07563-b177-4b7c-af49-d473dc10df90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:16:29.674204 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e07563-b177-4b7c-af49-d473dc10df90 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:16:29.674512 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e07563-b177-4b7c-af49-d473dc10df90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:16:29.674810 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e07563-b177-4b7c-af49-d473dc10df90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:16:29.676397 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-93e07563-b177-4b7c-af49-d473dc10df90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:16:29.774141 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e07563-b177-4b7c-af49-d473dc10df90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:16:29.775531 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e07563-b177-4b7c-af49-d473dc10df90 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:16:29.778950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:16:29.793466 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 754/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:16:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:16:29.838503 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4291d-2aa4-48c7-9e75-69ee50ee3494 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:16:29.838828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4291d-2aa4-48c7-9e75-69ee50ee3494 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:16:29.839109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4291d-2aa4-48c7-9e75-69ee50ee3494 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:16:29.840331 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 752/1506] 10.222.0.48 () {52 vars in 830 bytes} [Tue Sep 27 04:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:16:29.843929 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e07563-b177-4b7c-af49-d473dc10df90 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:16:29.845126 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-93e07563-b177-4b7c-af49-d473dc10df90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:16:29.944259 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e07563-b177-4b7c-af49-d473dc10df90 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:16:30.033980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3cdff-e23d-49ad-9844-711c9a530990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:16:30.034586 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3cdff-e23d-49ad-9844-711c9a530990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:16:30.034825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3cdff-e23d-49ad-9844-711c9a530990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:16:30.035101 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3cdff-e23d-49ad-9844-711c9a530990 admin admin] PATH_INFO: `/v3/users/2378b1ee97d84209b0ce17cf7c4d57ec` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:16:30.048031 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3cdff-e23d-49ad-9844-711c9a530990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2378b1ee97d84209b0ce17cf7c4d57ec)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:16:30.049053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: WARNING py.warnings [None req-16c3cdff-e23d-49ad-9844-711c9a530990 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 04:16:30.049053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: warnings.warn(msg) Sep 27 04:16:30.049053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: Sep 27 04:16:30.050271 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3cdff-e23d-49ad-9844-711c9a530990 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:16:30.060438 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:16:30.115454 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-16c3cdff-e23d-49ad-9844-711c9a530990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2378b1ee97d84209b0ce17cf7c4d57ec'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:16:30.132627 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-16c3cdff-e23d-49ad-9844-711c9a530990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2378b1ee97d84209b0ce17cf7c4d57ec'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:16:30.133155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-16c3cdff-e23d-49ad-9844-711c9a530990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2378b1ee97d84209b0ce17cf7c4d57ec'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:16:30.159297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-16c3cdff-e23d-49ad-9844-711c9a530990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2378b1ee97d84209b0ce17cf7c4d57ec'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:16:30.168322 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-16c3cdff-e23d-49ad-9844-711c9a530990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2378b1ee97d84209b0ce17cf7c4d57ec'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:16:30.174484 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 755/1507] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:16:29 2022] DELETE /identity/v3/users/2378b1ee97d84209b0ce17cf7c4d57ec => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:16:30.178895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd30eb-52ac-42c0-8529-712a6f174b66 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:16:30.179375 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd30eb-52ac-42c0-8529-712a6f174b66 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:16:30.179473 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd30eb-52ac-42c0-8529-712a6f174b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:16:30.236454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f6dd30eb-52ac-42c0-8529-712a6f174b66 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:16:30.237636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f6dd30eb-52ac-42c0-8529-712a6f174b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:16:30.311347 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:16:30.324399 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 753/1508] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:16:30.333734 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3cdff-e23d-49ad-9844-711c9a530990 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:16:30.335023 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-16c3cdff-e23d-49ad-9844-711c9a530990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:16:30.433599 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3cdff-e23d-49ad-9844-711c9a530990 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:16:30.493064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:16:30.514698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22f07b-5082-43fb-82cd-9abd6a5a9972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:16:30.515329 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22f07b-5082-43fb-82cd-9abd6a5a9972 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:16:30.515609 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22f07b-5082-43fb-82cd-9abd6a5a9972 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:16:30.515876 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22f07b-5082-43fb-82cd-9abd6a5a9972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:16:30.517461 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8c22f07b-5082-43fb-82cd-9abd6a5a9972 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:16:30.626412 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22f07b-5082-43fb-82cd-9abd6a5a9972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:16:30.627916 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22f07b-5082-43fb-82cd-9abd6a5a9972 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:16:30.645965 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 756/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:16:30.997596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd30eb-52ac-42c0-8529-712a6f174b66 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:16:30.998958 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f6dd30eb-52ac-42c0-8529-712a6f174b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:16:31.011109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd30eb-52ac-42c0-8529-712a6f174b66 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:16:31.109961 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1ac88-f789-4498-8705-52d7f67a0085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:16:31.110524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1ac88-f789-4498-8705-52d7f67a0085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:16:31.110833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1ac88-f789-4498-8705-52d7f67a0085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:16:31.111112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1ac88-f789-4498-8705-52d7f67a0085 admin admin] PATH_INFO: `/v3/projects/7481e6212baf4839b1e36b26e4d0e47b` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:16:31.120971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1ac88-f789-4498-8705-52d7f67a0085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7481e6212baf4839b1e36b26e4d0e47b)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:16:31.121997 dv-cinder-859186-3-smb devstack@keystone.service[81374]: WARNING py.warnings [None req-97d1ac88-f789-4498-8705-52d7f67a0085 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 04:16:31.121997 dv-cinder-859186-3-smb devstack@keystone.service[81374]: warnings.warn(msg) Sep 27 04:16:31.121997 dv-cinder-859186-3-smb devstack@keystone.service[81374]: Sep 27 04:16:31.123264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1ac88-f789-4498-8705-52d7f67a0085 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:16:31.197430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-97d1ac88-f789-4498-8705-52d7f67a0085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7481e6212baf4839b1e36b26e4d0e47b', 'request_id': 'req-97d1ac88-f789-4498-8705-52d7f67a0085'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:16:31.210412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-97d1ac88-f789-4498-8705-52d7f67a0085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7481e6212baf4839b1e36b26e4d0e47b', 'request_id': 'req-97d1ac88-f789-4498-8705-52d7f67a0085'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:16:31.219835 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-97d1ac88-f789-4498-8705-52d7f67a0085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7481e6212baf4839b1e36b26e4d0e47b', 'request_id': 'req-97d1ac88-f789-4498-8705-52d7f67a0085'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:16:31.242685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-97d1ac88-f789-4498-8705-52d7f67a0085 admin admin] The token cache is being invalidate because project 7481e6212baf4839b1e36b26e4d0e47b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:16:31.243003 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-97d1ac88-f789-4498-8705-52d7f67a0085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:16:31.243446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-97d1ac88-f789-4498-8705-52d7f67a0085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:16:31.244811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 754/1510] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:16:30 2022] DELETE /identity/v3/projects/7481e6212baf4839b1e36b26e4d0e47b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:16:40.643719 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=62 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:16:41.240715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:18:02.500892 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0c602-aaa2-417e-95cd-9915e7456429 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:02.501475 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0c602-aaa2-417e-95cd-9915e7456429 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:02.501475 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0c602-aaa2-417e-95cd-9915e7456429 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:02.502861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:18:02.507939 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f443b-f523-4d67-9ea9-558a8deb1293 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:02.508343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f443b-f523-4d67-9ea9-558a8deb1293 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:02.508500 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f443b-f523-4d67-9ea9-558a8deb1293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:02.593749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1b3f443b-f523-4d67-9ea9-558a8deb1293 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:18:02.594995 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1b3f443b-f523-4d67-9ea9-558a8deb1293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:18:02.696090 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:18:02.849623 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0c602-aaa2-417e-95cd-9915e7456429 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:18:02.851786 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4bd0c602-aaa2-417e-95cd-9915e7456429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:18:02.994479 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0c602-aaa2-417e-95cd-9915e7456429 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:18:02.999850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26baa7b-a33e-4bca-9587-3c57952eba81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:18:03.000448 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26baa7b-a33e-4bca-9587-3c57952eba81 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:03.000730 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26baa7b-a33e-4bca-9587-3c57952eba81 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:03.001006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26baa7b-a33e-4bca-9587-3c57952eba81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:03.009558 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26baa7b-a33e-4bca-9587-3c57952eba81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:18:03.011172 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26baa7b-a33e-4bca-9587-3c57952eba81 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:18:03.020248 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 758/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:18:04.101705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778986d3-5ef3-4e17-a159-85440a31944b None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:04.102276 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778986d3-5ef3-4e17-a159-85440a31944b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:04.102276 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778986d3-5ef3-4e17-a159-85440a31944b None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:04.103639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:18:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:18:04.109914 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824841d-7151-4dc2-be77-aca3e2136282 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:04.110370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824841d-7151-4dc2-be77-aca3e2136282 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:04.110472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824841d-7151-4dc2-be77-aca3e2136282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:04.129763 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a824841d-7151-4dc2-be77-aca3e2136282 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:18:04.130992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a824841d-7151-4dc2-be77-aca3e2136282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:18:04.138703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:18:04.293443 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778986d3-5ef3-4e17-a159-85440a31944b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:18:04.307745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778986d3-5ef3-4e17-a159-85440a31944b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:18:04.313160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a892feb-0804-4606-8a82-c3a7feb02dbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:18:04.313756 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a892feb-0804-4606-8a82-c3a7feb02dbf service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:04.314037 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a892feb-0804-4606-8a82-c3a7feb02dbf service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:04.314312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a892feb-0804-4606-8a82-c3a7feb02dbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:04.322393 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a892feb-0804-4606-8a82-c3a7feb02dbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:18:04.324014 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a892feb-0804-4606-8a82-c3a7feb02dbf service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:18:04.333159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 757/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:18:05.135613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cc9ba-b53f-46fa-8a40-a11ce2b2c503 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:05.136176 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cc9ba-b53f-46fa-8a40-a11ce2b2c503 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:05.136176 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cc9ba-b53f-46fa-8a40-a11ce2b2c503 None None] PATH_INFO: `/v3` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:05.137454 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 760/1517] 10.222.0.25 () {54 vars in 925 bytes} [Tue Sep 27 04:18:05 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:18:05.143596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3f4a1-8b17-41dc-bf79-cc4ef3de7a37 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:05.144026 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3f4a1-8b17-41dc-bf79-cc4ef3de7a37 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:05.144150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3f4a1-8b17-41dc-bf79-cc4ef3de7a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:05.202958 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-76b3f4a1-8b17-41dc-bf79-cc4ef3de7a37 None None] MFA Rules not processed for user `efd209a50a994b7c8485f2996697218b`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:18:05.204162 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-76b3f4a1-8b17-41dc-bf79-cc4ef3de7a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:18:05.220803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:18:05.277306 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 758/1518] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Sep 27 04:18:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:18:08.991967 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2779560-287d-463e-812c-bfc5c7498742 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:08.992423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2779560-287d-463e-812c-bfc5c7498742 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:08.992520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2779560-287d-463e-812c-bfc5c7498742 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:08.993892 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 761/1519] 10.222.0.48 () {54 vars in 961 bytes} [Tue Sep 27 04:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:18:08.998936 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49777e1d-25f3-4048-aa83-92694502a984 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:08.999381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49777e1d-25f3-4048-aa83-92694502a984 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:08.999489 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49777e1d-25f3-4048-aa83-92694502a984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:09.018284 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-49777e1d-25f3-4048-aa83-92694502a984 None None] MFA Rules not processed for user `efd209a50a994b7c8485f2996697218b`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:18:09.019540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-49777e1d-25f3-4048-aa83-92694502a984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:18:09.028450 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 759/1520] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Sep 27 04:18:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:18:09.035944 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2779560-287d-463e-812c-bfc5c7498742 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:18:09.049890 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2779560-287d-463e-812c-bfc5c7498742 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:18:09.054825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f7f61-6aa4-4e40-b51c-e8dcf5e7c299 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efd209a50a994b7c8485f2996697218b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:18:09.055449 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f7f61-6aa4-4e40-b51c-e8dcf5e7c299 service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:09.055734 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f7f61-6aa4-4e40-b51c-e8dcf5e7c299 service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:09.056013 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f7f61-6aa4-4e40-b51c-e8dcf5e7c299 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:09.064151 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f7f61-6aa4-4e40-b51c-e8dcf5e7c299 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:18:09.065820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f7f61-6aa4-4e40-b51c-e8dcf5e7c299 service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:18:09.075506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 762/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:18:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:18:15.815219 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7234e-53ed-4b48-9672-a62d7627822e None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:15.815800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7234e-53ed-4b48-9672-a62d7627822e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:15.815800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7234e-53ed-4b48-9672-a62d7627822e None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:15.817095 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:18:15.823704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac3453-030b-42be-a463-04bc48929223 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:15.824183 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac3453-030b-42be-a463-04bc48929223 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:15.824331 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac3453-030b-42be-a463-04bc48929223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:15.848760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d5ac3453-030b-42be-a463-04bc48929223 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:18:15.850041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d5ac3453-030b-42be-a463-04bc48929223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:18:15.858655 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:18:16.013189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7234e-53ed-4b48-9672-a62d7627822e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:18:16.027294 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7234e-53ed-4b48-9672-a62d7627822e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:18:16.032634 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cc9d9-c94f-4e8e-b84f-c0026741d50f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:18:16.033222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cc9d9-c94f-4e8e-b84f-c0026741d50f service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:16.033501 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cc9d9-c94f-4e8e-b84f-c0026741d50f service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:16.033775 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cc9d9-c94f-4e8e-b84f-c0026741d50f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:16.041678 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415cc9d9-c94f-4e8e-b84f-c0026741d50f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:18:16.043305 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415cc9d9-c94f-4e8e-b84f-c0026741d50f service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:18:16.052442 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 761/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:18:17.115353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf73104-c61b-4d61-9a15-4979e769c298 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:17.115901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf73104-c61b-4d61-9a15-4979e769c298 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:17.115901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf73104-c61b-4d61-9a15-4979e769c298 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:17.117186 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:18:17.123110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bb158-fe73-49c4-bed3-490827b1b4a4 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:17.123531 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bb158-fe73-49c4-bed3-490827b1b4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:17.123648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bb158-fe73-49c4-bed3-490827b1b4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:17.143013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-aa9bb158-fe73-49c4-bed3-490827b1b4a4 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:18:17.144199 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-aa9bb158-fe73-49c4-bed3-490827b1b4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:18:17.152406 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:18:17.304261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf73104-c61b-4d61-9a15-4979e769c298 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:18:17.318362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf73104-c61b-4d61-9a15-4979e769c298 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:18:17.324624 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ea5ec-6edd-4291-9ab3-21c611ab159b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:18:17.325205 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ea5ec-6edd-4291-9ab3-21c611ab159b service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:17.325485 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ea5ec-6edd-4291-9ab3-21c611ab159b service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:17.325755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ea5ec-6edd-4291-9ab3-21c611ab159b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:17.333554 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ea5ec-6edd-4291-9ab3-21c611ab159b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:18:17.335156 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ea5ec-6edd-4291-9ab3-21c611ab159b service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:18:17.344154 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 765/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:18:21.320262 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c02fb-81cf-4e6c-96d4-e5b99b63cf15 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:21.320860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c02fb-81cf-4e6c-96d4-e5b99b63cf15 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:21.320860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c02fb-81cf-4e6c-96d4-e5b99b63cf15 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:21.322123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 04:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:18:21.327442 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a87021-74a0-486c-9de0-bb0401c03ade None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:21.327844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a87021-74a0-486c-9de0-bb0401c03ade None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:21.328005 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a87021-74a0-486c-9de0-bb0401c03ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:21.347190 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f2a87021-74a0-486c-9de0-bb0401c03ade None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:18:21.348392 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f2a87021-74a0-486c-9de0-bb0401c03ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:18:21.356925 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 04:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:18:21.647970 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c02fb-81cf-4e6c-96d4-e5b99b63cf15 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:18:21.649705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7e6c02fb-81cf-4e6c-96d4-e5b99b63cf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:18:21.727999 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c02fb-81cf-4e6c-96d4-e5b99b63cf15 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:18:21.731877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8495080-7a6e-4481-b0d7-1e06397db17c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:18:21.732479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8495080-7a6e-4481-b0d7-1e06397db17c service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:21.732758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8495080-7a6e-4481-b0d7-1e06397db17c service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:21.733030 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8495080-7a6e-4481-b0d7-1e06397db17c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:21.741874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8495080-7a6e-4481-b0d7-1e06397db17c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:18:21.743341 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8495080-7a6e-4481-b0d7-1e06397db17c service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:18:21.752614 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 764/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:18:23.892850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe1dad-f025-4dae-914a-2f0e39a2642f None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:23.893406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe1dad-f025-4dae-914a-2f0e39a2642f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:23.893406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe1dad-f025-4dae-914a-2f0e39a2642f None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:23.894779 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 04:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:18:23.900050 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a226e72-1111-4ed3-8d12-2dffbc6b3feb None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:23.900430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a226e72-1111-4ed3-8d12-2dffbc6b3feb None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:23.900600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a226e72-1111-4ed3-8d12-2dffbc6b3feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:23.920285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1a226e72-1111-4ed3-8d12-2dffbc6b3feb None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:18:23.921482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1a226e72-1111-4ed3-8d12-2dffbc6b3feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:18:23.929899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 04:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:18:24.212558 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe1dad-f025-4dae-914a-2f0e39a2642f None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:18:24.223326 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe1dad-f025-4dae-914a-2f0e39a2642f None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:18:24.227450 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff0917-943c-4a95-87c9-ef0837eb0c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:18:24.228045 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff0917-943c-4a95-87c9-ef0837eb0c62 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:24.228327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff0917-943c-4a95-87c9-ef0837eb0c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:24.228606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff0917-943c-4a95-87c9-ef0837eb0c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:24.237531 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff0917-943c-4a95-87c9-ef0837eb0c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:18:24.238998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff0917-943c-4a95-87c9-ef0837eb0c62 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:18:24.248188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 768/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:18:27.846650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32256b51-c855-4095-b9c9-726275ea0998 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:27.847339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32256b51-c855-4095-b9c9-726275ea0998 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:27.847339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32256b51-c855-4095-b9c9-726275ea0998 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:27.848560 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 04:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:18:27.854447 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ff4a6-6089-4a06-b033-2cae350eafd3 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:27.854928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ff4a6-6089-4a06-b033-2cae350eafd3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:27.855030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ff4a6-6089-4a06-b033-2cae350eafd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:27.875138 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-857ff4a6-6089-4a06-b033-2cae350eafd3 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:18:27.876341 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-857ff4a6-6089-4a06-b033-2cae350eafd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:18:27.884292 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 04:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:18:28.188913 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32256b51-c855-4095-b9c9-726275ea0998 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:18:28.190577 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-32256b51-c855-4095-b9c9-726275ea0998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:18:28.254544 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:18:28.268383 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32256b51-c855-4095-b9c9-726275ea0998 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:18:28.271934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6fb4e-9a97-4ad2-8ba6-53a8ddb6de4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:18:28.273096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6fb4e-9a97-4ad2-8ba6-53a8ddb6de4f service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:28.273376 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6fb4e-9a97-4ad2-8ba6-53a8ddb6de4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:28.273647 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6fb4e-9a97-4ad2-8ba6-53a8ddb6de4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:28.282340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6fb4e-9a97-4ad2-8ba6-53a8ddb6de4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:18:28.283792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6fb4e-9a97-4ad2-8ba6-53a8ddb6de4f service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:18:28.292956 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 767/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:18:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:18:30.428359 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817c612-0e34-4a08-b5f2-7044699a78bf None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:30.428864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817c612-0e34-4a08-b5f2-7044699a78bf None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:30.428971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817c612-0e34-4a08-b5f2-7044699a78bf None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:30.430256 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 04:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:18:30.435455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8ddde-5827-4f40-8cc0-0e60bd93883f None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:30.435860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8ddde-5827-4f40-8cc0-0e60bd93883f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:30.436010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8ddde-5827-4f40-8cc0-0e60bd93883f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:30.455953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-abd8ddde-5827-4f40-8cc0-0e60bd93883f None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:18:30.457125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-abd8ddde-5827-4f40-8cc0-0e60bd93883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:18:30.465500 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 04:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:18:30.765895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817c612-0e34-4a08-b5f2-7044699a78bf None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:18:30.767594 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b817c612-0e34-4a08-b5f2-7044699a78bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:18:30.775663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=84 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:18:30.782070 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817c612-0e34-4a08-b5f2-7044699a78bf None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:18:30.785559 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b367e8-3ce9-4092-9a02-6d15d9d0511b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:18:30.786151 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b367e8-3ce9-4092-9a02-6d15d9d0511b service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:18:30.786434 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b367e8-3ce9-4092-9a02-6d15d9d0511b service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:18:30.786710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b367e8-3ce9-4092-9a02-6d15d9d0511b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:18:30.796233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b367e8-3ce9-4092-9a02-6d15d9d0511b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:18:30.797670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b367e8-3ce9-4092-9a02-6d15d9d0511b service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:18:30.806942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 771/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:18:40.450994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=11 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:18:40.802864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:00.520233 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28e29a-c0f2-4386-ac67-4dcf1646bf06 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:00.521968 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28e29a-c0f2-4386-ac67-4dcf1646bf06 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:00.521968 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28e29a-c0f2-4386-ac67-4dcf1646bf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:00.548525 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5b28e29a-c0f2-4386-ac67-4dcf1646bf06 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:00.549722 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5b28e29a-c0f2-4386-ac67-4dcf1646bf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:00.562998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 769/1540] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:00.571750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d24371-5b54-4580-8b76-b48c2969acf2 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:00.572377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d24371-5b54-4580-8b76-b48c2969acf2 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:00.572377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d24371-5b54-4580-8b76-b48c2969acf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:00.598140 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-50d24371-5b54-4580-8b76-b48c2969acf2 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:00.603611 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-50d24371-5b54-4580-8b76-b48c2969acf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:00.617679 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 772/1541] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:00.622802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28e29a-c0f2-4386-ac67-4dcf1646bf06 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:00.635872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28e29a-c0f2-4386-ac67-4dcf1646bf06 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:00.643803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c20a7-79ef-48bb-9161-2345c7daa48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:00.644488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c20a7-79ef-48bb-9161-2345c7daa48e admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:00.644776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c20a7-79ef-48bb-9161-2345c7daa48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:00.645053 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c20a7-79ef-48bb-9161-2345c7daa48e admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:00.645823 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c20a7-79ef-48bb-9161-2345c7daa48e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:00.646134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c20a7-79ef-48bb-9161-2345c7daa48e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:00.647836 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c20a7-79ef-48bb-9161-2345c7daa48e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:00.668857 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 770/1542] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:00.677907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d24371-5b54-4580-8b76-b48c2969acf2 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:00.690812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d24371-5b54-4580-8b76-b48c2969acf2 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:00.696626 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869807d-ce86-4b26-a3a2-697445bb849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:00.697262 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869807d-ce86-4b26-a3a2-697445bb849e admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:00.697551 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869807d-ce86-4b26-a3a2-697445bb849e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:00.697833 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869807d-ce86-4b26-a3a2-697445bb849e admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:00.703141 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869807d-ce86-4b26-a3a2-697445bb849e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:00.705365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869807d-ce86-4b26-a3a2-697445bb849e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:00.732175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3800e-2753-4372-bfb2-5ed0cd87f145 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:00.732539 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3800e-2753-4372-bfb2-5ed0cd87f145 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:00.732738 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3800e-2753-4372-bfb2-5ed0cd87f145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:00.771945 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-afe3800e-2753-4372-bfb2-5ed0cd87f145 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:00.773758 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 773/1543] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:00 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:00.773976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-afe3800e-2753-4372-bfb2-5ed0cd87f145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:00.778857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869807d-ce86-4b26-a3a2-697445bb849e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:00.897535 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 771/1544] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:00.901233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869807d-ce86-4b26-a3a2-697445bb849e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:00.906711 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d54528-d3b8-4547-8042-99d52288b618 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:00.907025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d54528-d3b8-4547-8042-99d52288b618 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:00.907309 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d54528-d3b8-4547-8042-99d52288b618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:00.916579 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe43ecb-ea2c-4c74-8153-f54d56fd0bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:00.917318 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe43ecb-ea2c-4c74-8153-f54d56fd0bed admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:00.917608 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe43ecb-ea2c-4c74-8153-f54d56fd0bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:00.917985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe43ecb-ea2c-4c74-8153-f54d56fd0bed admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:00.918755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe43ecb-ea2c-4c74-8153-f54d56fd0bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:00.919917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: WARNING py.warnings [None req-9fe43ecb-ea2c-4c74-8153-f54d56fd0bed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 04:20:00.919917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: warnings.warn(msg) Sep 27 04:20:00.919917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: Sep 27 04:20:00.921091 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe43ecb-ea2c-4c74-8153-f54d56fd0bed admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:00.955845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b3d54528-d3b8-4547-8042-99d52288b618 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:00.958122 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b3d54528-d3b8-4547-8042-99d52288b618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:00.973191 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 774/1545] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:00 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:00.975977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 772/1546] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:00.977545 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe43ecb-ea2c-4c74-8153-f54d56fd0bed admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:00.981059 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d54528-d3b8-4547-8042-99d52288b618 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:00.991608 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d54528-d3b8-4547-8042-99d52288b618 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:00.993662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe43ecb-ea2c-4c74-8153-f54d56fd0bed admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.004090 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564fe0a-1e04-4d14-a926-833dfeea8d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.004916 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564fe0a-1e04-4d14-a926-833dfeea8d69 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.005197 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564fe0a-1e04-4d14-a926-833dfeea8d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.005464 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564fe0a-1e04-4d14-a926-833dfeea8d69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.006299 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564fe0a-1e04-4d14-a926-833dfeea8d69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:01.006604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564fe0a-1e04-4d14-a926-833dfeea8d69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.007964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ba04f-5daf-428f-8b97-e826b5a691ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.008592 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ba04f-5daf-428f-8b97-e826b5a691ca admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.008726 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564fe0a-1e04-4d14-a926-833dfeea8d69 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.008886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ba04f-5daf-428f-8b97-e826b5a691ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.009150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ba04f-5daf-428f-8b97-e826b5a691ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.009815 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ba04f-5daf-428f-8b97-e826b5a691ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.011531 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ba04f-5daf-428f-8b97-e826b5a691ca admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.030159 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 775/1547] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:01.032331 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 773/1548] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:20:01.034548 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ba04f-5daf-428f-8b97-e826b5a691ca admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.041983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564fe0a-1e04-4d14-a926-833dfeea8d69 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.054114 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564fe0a-1e04-4d14-a926-833dfeea8d69 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.058154 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ba04f-5daf-428f-8b97-e826b5a691ca admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.065012 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a04765-dce1-4b59-ac28-63c8deffbb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.065635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a04765-dce1-4b59-ac28-63c8deffbb0b admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.066437 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a04765-dce1-4b59-ac28-63c8deffbb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.066727 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a04765-dce1-4b59-ac28-63c8deffbb0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.067580 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a04765-dce1-4b59-ac28-63c8deffbb0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.068604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: WARNING py.warnings [None req-60a04765-dce1-4b59-ac28-63c8deffbb0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 04:20:01.068604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: warnings.warn(msg) Sep 27 04:20:01.068604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: Sep 27 04:20:01.069153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff486ec-c089-4dc5-9074-b11b7b2e2a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.069777 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff486ec-c089-4dc5-9074-b11b7b2e2a76 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.069943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a04765-dce1-4b59-ac28-63c8deffbb0b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.070094 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff486ec-c089-4dc5-9074-b11b7b2e2a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.070321 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff486ec-c089-4dc5-9074-b11b7b2e2a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.071109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff486ec-c089-4dc5-9074-b11b7b2e2a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.072779 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff486ec-c089-4dc5-9074-b11b7b2e2a76 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.092372 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 776/1549] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:01.093661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eec42e-2b5a-4518-8490-a7fdc412a689 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.093953 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eec42e-2b5a-4518-8490-a7fdc412a689 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.094250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eec42e-2b5a-4518-8490-a7fdc412a689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.125976 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-54eec42e-2b5a-4518-8490-a7fdc412a689 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:01.127238 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-54eec42e-2b5a-4518-8490-a7fdc412a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:01.127356 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 774/1550] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/projects => generated 393 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:20:01.128143 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a04765-dce1-4b59-ac28-63c8deffbb0b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.214926 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a04765-dce1-4b59-ac28-63c8deffbb0b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.220924 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe4a03-e2e7-4d51-ab88-d930f96e264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.221717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe4a03-e2e7-4d51-ab88-d930f96e264a admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.222041 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe4a03-e2e7-4d51-ab88-d930f96e264a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.222371 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe4a03-e2e7-4d51-ab88-d930f96e264a admin admin] PATH_INFO: `/v3/projects/000077de90324331a9527e8c45def22e/users/8e03bcebeee44978afe2ce5040ddf122/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.223776 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 777/1551] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:01.224730 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eec42e-2b5a-4518-8490-a7fdc412a689 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.236132 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eec42e-2b5a-4518-8490-a7fdc412a689 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.241300 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be0908-90b6-4442-a0b1-478286da923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.241894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be0908-90b6-4442-a0b1-478286da923f admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.242178 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be0908-90b6-4442-a0b1-478286da923f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.242452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be0908-90b6-4442-a0b1-478286da923f admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.242585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe4a03-e2e7-4d51-ab88-d930f96e264a admin admin] RBAC: Authorizing `identity:create_grant(project_id=000077de90324331a9527e8c45def22e, user_id=8e03bcebeee44978afe2ce5040ddf122, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.243112 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be0908-90b6-4442-a0b1-478286da923f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.243752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: WARNING py.warnings [None req-fbfe4a03-e2e7-4d51-ab88-d930f96e264a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 04:20:01.243752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: warnings.warn(msg) Sep 27 04:20:01.243752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: Sep 27 04:20:01.245005 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be0908-90b6-4442-a0b1-478286da923f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.245782 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe4a03-e2e7-4d51-ab88-d930f96e264a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.259691 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 775/1552] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:01 2022] PUT /identity/v3/projects/000077de90324331a9527e8c45def22e/users/8e03bcebeee44978afe2ce5040ddf122/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:01.260986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7750819-de82-4bfc-8513-ccf6bf706c8d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.261272 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7750819-de82-4bfc-8513-ccf6bf706c8d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.261544 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7750819-de82-4bfc-8513-ccf6bf706c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.271501 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 778/1553] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:01.272734 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6ed75-5d4c-46c1-8e83-02f710bb712c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.273033 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6ed75-5d4c-46c1-8e83-02f710bb712c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.273295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6ed75-5d4c-46c1-8e83-02f710bb712c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.282384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d7750819-de82-4bfc-8513-ccf6bf706c8d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:01.283674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d7750819-de82-4bfc-8513-ccf6bf706c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:01.291876 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-2eb6ed75-5d4c-46c1-8e83-02f710bb712c None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:01.293037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2eb6ed75-5d4c-46c1-8e83-02f710bb712c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:01.300685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:01.301197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:01.345415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 776/1554] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:01.347068 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b50d41-b20d-4f92-b6d7-2f4676d0073d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.347575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b50d41-b20d-4f92-b6d7-2f4676d0073d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.348138 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b50d41-b20d-4f92-b6d7-2f4676d0073d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.356906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 779/1555] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:01.358176 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5099c-415b-4c59-95ef-bbecd05cc0de None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.358522 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5099c-415b-4c59-95ef-bbecd05cc0de None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.358837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5099c-415b-4c59-95ef-bbecd05cc0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.368631 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f9b50d41-b20d-4f92-b6d7-2f4676d0073d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:01.369814 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f9b50d41-b20d-4f92-b6d7-2f4676d0073d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:01.377622 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 777/1556] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:01.378057 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-29b5099c-415b-4c59-95ef-bbecd05cc0de None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:01.379358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98b625-c889-4862-bd81-4512e39085f6 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.379642 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98b625-c889-4862-bd81-4512e39085f6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.379822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-29b5099c-415b-4c59-95ef-bbecd05cc0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:01.379932 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98b625-c889-4862-bd81-4512e39085f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.395339 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 780/1557] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:01.395339 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef7aa3-5c02-4854-a3b6-27bc6d3acb52 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.395339 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef7aa3-5c02-4854-a3b6-27bc6d3acb52 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.395339 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef7aa3-5c02-4854-a3b6-27bc6d3acb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.400921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-bc98b625-c889-4862-bd81-4512e39085f6 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:01.402127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bc98b625-c889-4862-bd81-4512e39085f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:01.411118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 778/1558] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:01.412410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d1930-1814-4a2c-8c25-87ca81d9341c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.412699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d1930-1814-4a2c-8c25-87ca81d9341c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.412974 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d1930-1814-4a2c-8c25-87ca81d9341c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.423981 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-49ef7aa3-5c02-4854-a3b6-27bc6d3acb52 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:01.425843 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-49ef7aa3-5c02-4854-a3b6-27bc6d3acb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:01.431879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-725d1930-1814-4a2c-8c25-87ca81d9341c None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:01.433027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-725d1930-1814-4a2c-8c25-87ca81d9341c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:01.433771 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 781/1559] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:01.434584 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef7aa3-5c02-4854-a3b6-27bc6d3acb52 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.440822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 779/1560] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:01.442610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895884e8-3d1b-4250-8ce3-51f343cecdd0 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.442986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895884e8-3d1b-4250-8ce3-51f343cecdd0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.443262 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895884e8-3d1b-4250-8ce3-51f343cecdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.445255 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef7aa3-5c02-4854-a3b6-27bc6d3acb52 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.451192 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bddff3-01d7-4728-9cbd-e90bc8324364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.451878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bddff3-01d7-4728-9cbd-e90bc8324364 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.452168 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bddff3-01d7-4728-9cbd-e90bc8324364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.452446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bddff3-01d7-4728-9cbd-e90bc8324364 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.453104 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bddff3-01d7-4728-9cbd-e90bc8324364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.454739 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bddff3-01d7-4728-9cbd-e90bc8324364 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.464014 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-895884e8-3d1b-4250-8ce3-51f343cecdd0 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:01.465192 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 782/1561] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:01.465329 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-895884e8-3d1b-4250-8ce3-51f343cecdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:01.466307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75aed-8f21-4313-bcec-5edd64e6554a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.466602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75aed-8f21-4313-bcec-5edd64e6554a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.466901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75aed-8f21-4313-bcec-5edd64e6554a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.474477 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 780/1562] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:01.476051 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a88b1a-fc63-4034-ab5c-f1fb9bf7eae4 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.476331 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a88b1a-fc63-4034-ab5c-f1fb9bf7eae4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.476609 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a88b1a-fc63-4034-ab5c-f1fb9bf7eae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.485953 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d1b75aed-8f21-4313-bcec-5edd64e6554a None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:01.487183 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d1b75aed-8f21-4313-bcec-5edd64e6554a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:01.495766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 783/1563] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:01.496577 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-12a88b1a-fc63-4034-ab5c-f1fb9bf7eae4 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:01.496962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983bf4b-0cfa-49b0-8a2e-a849684217b3 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.497250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983bf4b-0cfa-49b0-8a2e-a849684217b3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.497647 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983bf4b-0cfa-49b0-8a2e-a849684217b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.497763 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-12a88b1a-fc63-4034-ab5c-f1fb9bf7eae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:01.506216 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 781/1564] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:01.507342 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe85c3d-23f3-4486-8bf3-ecfd1a59c6da None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.507624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe85c3d-23f3-4486-8bf3-ecfd1a59c6da None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.507899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe85c3d-23f3-4486-8bf3-ecfd1a59c6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.520552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e983bf4b-0cfa-49b0-8a2e-a849684217b3 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:01.521750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e983bf4b-0cfa-49b0-8a2e-a849684217b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:01.526162 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8fe85c3d-23f3-4486-8bf3-ecfd1a59c6da None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:01.527322 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8fe85c3d-23f3-4486-8bf3-ecfd1a59c6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:01.529532 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 784/1565] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:01.530303 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983bf4b-0cfa-49b0-8a2e-a849684217b3 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.535110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 782/1566] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:01.535933 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe85c3d-23f3-4486-8bf3-ecfd1a59c6da None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.539802 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983bf4b-0cfa-49b0-8a2e-a849684217b3 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.544280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bebc8a-bcb3-4182-8b53-ad99c3184a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.544866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bebc8a-bcb3-4182-8b53-ad99c3184a72 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.545151 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bebc8a-bcb3-4182-8b53-ad99c3184a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.545428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bebc8a-bcb3-4182-8b53-ad99c3184a72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.546101 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bebc8a-bcb3-4182-8b53-ad99c3184a72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:01.546409 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bebc8a-bcb3-4182-8b53-ad99c3184a72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.547457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: WARNING py.warnings [None req-82bebc8a-bcb3-4182-8b53-ad99c3184a72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 04:20:01.547457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: warnings.warn(msg) Sep 27 04:20:01.547457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: Sep 27 04:20:01.548348 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bebc8a-bcb3-4182-8b53-ad99c3184a72 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.560629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 785/1567] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:01.561419 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bebc8a-bcb3-4182-8b53-ad99c3184a72 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.571424 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bebc8a-bcb3-4182-8b53-ad99c3184a72 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.575941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ff0e2-3e41-4f70-b666-c8eaf247e24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.576551 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ff0e2-3e41-4f70-b666-c8eaf247e24e admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.576785 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ff0e2-3e41-4f70-b666-c8eaf247e24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.577060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ff0e2-3e41-4f70-b666-c8eaf247e24e admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.577687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ff0e2-3e41-4f70-b666-c8eaf247e24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.579302 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ff0e2-3e41-4f70-b666-c8eaf247e24e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.592882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 786/1568] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:01.592882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ff0e2-3e41-4f70-b666-c8eaf247e24e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.600432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe85c3d-23f3-4486-8bf3-ecfd1a59c6da None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.602295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ff0e2-3e41-4f70-b666-c8eaf247e24e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.604076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab28a8b-3821-4017-94bd-81ca61cc9ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.604677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab28a8b-3821-4017-94bd-81ca61cc9ffd service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.604955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab28a8b-3821-4017-94bd-81ca61cc9ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.605224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab28a8b-3821-4017-94bd-81ca61cc9ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.607172 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa49309-6f2a-4840-abff-74021c283717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.607746 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa49309-6f2a-4840-abff-74021c283717 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.608029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa49309-6f2a-4840-abff-74021c283717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.608306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa49309-6f2a-4840-abff-74021c283717 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.608943 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa49309-6f2a-4840-abff-74021c283717 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:01.609248 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa49309-6f2a-4840-abff-74021c283717 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.610852 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa49309-6f2a-4840-abff-74021c283717 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.615024 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab28a8b-3821-4017-94bd-81ca61cc9ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.616448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab28a8b-3821-4017-94bd-81ca61cc9ffd service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.623316 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 787/1569] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:01.624099 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa49309-6f2a-4840-abff-74021c283717 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.625825 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 783/1570] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:01.626550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab28a8b-3821-4017-94bd-81ca61cc9ffd service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.634164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa49309-6f2a-4840-abff-74021c283717 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.636462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab28a8b-3821-4017-94bd-81ca61cc9ffd service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.639168 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0071a-d269-4e0a-8d6d-7194de5df52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.639766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0071a-d269-4e0a-8d6d-7194de5df52a admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.640049 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0071a-d269-4e0a-8d6d-7194de5df52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.640326 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0071a-d269-4e0a-8d6d-7194de5df52a admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.641097 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35930d5e-5473-42bd-b54c-297eed5b5978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.641259 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0071a-d269-4e0a-8d6d-7194de5df52a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:01.641498 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0071a-d269-4e0a-8d6d-7194de5df52a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.641685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35930d5e-5473-42bd-b54c-297eed5b5978 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.641963 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35930d5e-5473-42bd-b54c-297eed5b5978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.642237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35930d5e-5473-42bd-b54c-297eed5b5978 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.642918 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35930d5e-5473-42bd-b54c-297eed5b5978 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:01.643027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0071a-d269-4e0a-8d6d-7194de5df52a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.643201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35930d5e-5473-42bd-b54c-297eed5b5978 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.644860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35930d5e-5473-42bd-b54c-297eed5b5978 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.656118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 788/1571] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:01.656794 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0071a-d269-4e0a-8d6d-7194de5df52a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.664479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 784/1572] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:01.664479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35930d5e-5473-42bd-b54c-297eed5b5978 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.670556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35930d5e-5473-42bd-b54c-297eed5b5978 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.673274 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0071a-d269-4e0a-8d6d-7194de5df52a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.676397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87740fc-be60-46d2-ba98-fc3b20159e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.677000 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87740fc-be60-46d2-ba98-fc3b20159e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.677282 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87740fc-be60-46d2-ba98-fc3b20159e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.677556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87740fc-be60-46d2-ba98-fc3b20159e88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.678199 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87740fc-be60-46d2-ba98-fc3b20159e88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:01.678505 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87740fc-be60-46d2-ba98-fc3b20159e88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.678987 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d046b1-0306-4dbe-b120-ede209d97e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.679589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d046b1-0306-4dbe-b120-ede209d97e83 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.679927 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d046b1-0306-4dbe-b120-ede209d97e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.680194 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87740fc-be60-46d2-ba98-fc3b20159e88 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.680298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d046b1-0306-4dbe-b120-ede209d97e83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.680842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d046b1-0306-4dbe-b120-ede209d97e83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:01.681198 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d046b1-0306-4dbe-b120-ede209d97e83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.682857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d046b1-0306-4dbe-b120-ede209d97e83 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.693184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 785/1573] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:01.694068 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87740fc-be60-46d2-ba98-fc3b20159e88 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.695489 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 789/1574] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:01.696478 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d046b1-0306-4dbe-b120-ede209d97e83 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.707453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d046b1-0306-4dbe-b120-ede209d97e83 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.712862 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b6cda-1423-4dff-b1e6-58789655358f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.713531 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b6cda-1423-4dff-b1e6-58789655358f admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.713819 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b6cda-1423-4dff-b1e6-58789655358f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.714094 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b6cda-1423-4dff-b1e6-58789655358f admin admin] PATH_INFO: `/v3/projects/5fd41bf6be394ef3889a7e2f7bfd57b9/users/84c92ec374504550aa3c2bbc8bf3eb8a/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.717581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87740fc-be60-46d2-ba98-fc3b20159e88 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.723502 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445d899-50bb-4776-9f48-cb62a3b79b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.724107 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445d899-50bb-4776-9f48-cb62a3b79b67 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.724387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445d899-50bb-4776-9f48-cb62a3b79b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.724658 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445d899-50bb-4776-9f48-cb62a3b79b67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.725292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445d899-50bb-4776-9f48-cb62a3b79b67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.727533 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445d899-50bb-4776-9f48-cb62a3b79b67 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.731180 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b6cda-1423-4dff-b1e6-58789655358f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fd41bf6be394ef3889a7e2f7bfd57b9, user_id=84c92ec374504550aa3c2bbc8bf3eb8a, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.734199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b6cda-1423-4dff-b1e6-58789655358f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.749456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 790/1575] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:01 2022] PUT /identity/v3/projects/5fd41bf6be394ef3889a7e2f7bfd57b9/users/84c92ec374504550aa3c2bbc8bf3eb8a/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:01.750284 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b6cda-1423-4dff-b1e6-58789655358f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.764892 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 786/1576] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:01.764892 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445d899-50bb-4776-9f48-cb62a3b79b67 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.813045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:01.814657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:01.836359 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b6cda-1423-4dff-b1e6-58789655358f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.841941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a4da7-72ec-42e2-9d94-f36be2f9c831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.842566 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a4da7-72ec-42e2-9d94-f36be2f9c831 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.842882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a4da7-72ec-42e2-9d94-f36be2f9c831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.843201 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a4da7-72ec-42e2-9d94-f36be2f9c831 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.844401 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a4da7-72ec-42e2-9d94-f36be2f9c831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.848125 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a4da7-72ec-42e2-9d94-f36be2f9c831 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.850430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445d899-50bb-4776-9f48-cb62a3b79b67 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.856038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66707242-fb81-4f62-ade0-3a27aca62797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.856907 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66707242-fb81-4f62-ade0-3a27aca62797 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.857254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66707242-fb81-4f62-ade0-3a27aca62797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.857536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66707242-fb81-4f62-ade0-3a27aca62797 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.858231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66707242-fb81-4f62-ade0-3a27aca62797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.860262 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66707242-fb81-4f62-ade0-3a27aca62797 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:01.879977 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 791/1577] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:01.881297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a4da7-72ec-42e2-9d94-f36be2f9c831 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.899048 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 787/1578] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:01.900072 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66707242-fb81-4f62-ade0-3a27aca62797 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:01.956110 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a4da7-72ec-42e2-9d94-f36be2f9c831 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.980202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66707242-fb81-4f62-ade0-3a27aca62797 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:01.986834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd65563-ea2a-4885-88ac-622725ab073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:01.986989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd65563-ea2a-4885-88ac-622725ab073d admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:01.987307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd65563-ea2a-4885-88ac-622725ab073d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:01.987655 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd65563-ea2a-4885-88ac-622725ab073d admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:01.988930 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd65563-ea2a-4885-88ac-622725ab073d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:01.990983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd65563-ea2a-4885-88ac-622725ab073d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.023640 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 788/1579] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/projects => generated 405 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:02.027623 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a261d-93b7-47cd-b210-61004e0c6fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.027860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd65563-ea2a-4885-88ac-622725ab073d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.028643 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a261d-93b7-47cd-b210-61004e0c6fcb admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.029225 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a261d-93b7-47cd-b210-61004e0c6fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.029661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a261d-93b7-47cd-b210-61004e0c6fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.030756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a261d-93b7-47cd-b210-61004e0c6fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.033344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a261d-93b7-47cd-b210-61004e0c6fcb admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.067176 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 792/1580] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:01 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:02.069047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8915c3-f66e-4eab-991e-348a5878817c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.069635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8915c3-f66e-4eab-991e-348a5878817c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.070112 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8915c3-f66e-4eab-991e-348a5878817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.093210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-7b8915c3-f66e-4eab-991e-348a5878817c None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:02.094096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7b8915c3-f66e-4eab-991e-348a5878817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:02.109626 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd65563-ea2a-4885-88ac-622725ab073d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.168805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:02.172791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 793/1581] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:02.173807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8915c3-f66e-4eab-991e-348a5878817c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.177221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a19ba-b133-4c34-9aeb-63efb9e55dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.177827 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a19ba-b133-4c34-9aeb-63efb9e55dcc admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.178111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a19ba-b133-4c34-9aeb-63efb9e55dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.178394 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a19ba-b133-4c34-9aeb-63efb9e55dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.179242 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a19ba-b133-4c34-9aeb-63efb9e55dcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.181411 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a19ba-b133-4c34-9aeb-63efb9e55dcc admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.187830 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8915c3-f66e-4eab-991e-348a5878817c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.192901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccfaaa-4087-4b30-94b2-d32b5c5fcec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.193509 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccfaaa-4087-4b30-94b2-d32b5c5fcec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.193795 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccfaaa-4087-4b30-94b2-d32b5c5fcec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.194398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccfaaa-4087-4b30-94b2-d32b5c5fcec3 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.194704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccfaaa-4087-4b30-94b2-d32b5c5fcec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.196741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccfaaa-4087-4b30-94b2-d32b5c5fcec3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.207858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:02.218017 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 789/1582] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:02 2022] POST /identity/v3/projects => generated 367 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:02.218017 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a19ba-b133-4c34-9aeb-63efb9e55dcc admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.226950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 794/1583] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:02 2022] POST /identity/v3/users => generated 294 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:02.226950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccfaaa-4087-4b30-94b2-d32b5c5fcec3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.238426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccfaaa-4087-4b30-94b2-d32b5c5fcec3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.291910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a19ba-b133-4c34-9aeb-63efb9e55dcc admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.296348 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe687df-89a9-4efe-851b-d2e6a6612a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.296942 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe687df-89a9-4efe-851b-d2e6a6612a5e admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.297288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe687df-89a9-4efe-851b-d2e6a6612a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.297646 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe687df-89a9-4efe-851b-d2e6a6612a5e admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.298290 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe687df-89a9-4efe-851b-d2e6a6612a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.300507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe687df-89a9-4efe-851b-d2e6a6612a5e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.301317 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db583c47-ee44-433b-a6ea-b73eb9023325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.302175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db583c47-ee44-433b-a6ea-b73eb9023325 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.302608 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db583c47-ee44-433b-a6ea-b73eb9023325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.303177 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db583c47-ee44-433b-a6ea-b73eb9023325 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.303982 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db583c47-ee44-433b-a6ea-b73eb9023325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.306059 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db583c47-ee44-433b-a6ea-b73eb9023325 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.327611 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 790/1584] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:02 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:02.328679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe687df-89a9-4efe-851b-d2e6a6612a5e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.346341 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 795/1585] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:02 2022] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:02.346622 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe687df-89a9-4efe-851b-d2e6a6612a5e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.346915 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db583c47-ee44-433b-a6ea-b73eb9023325 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.353411 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735384d-c75c-4ee6-8101-60c51c5d3863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.353872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735384d-c75c-4ee6-8101-60c51c5d3863 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.354154 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735384d-c75c-4ee6-8101-60c51c5d3863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.354427 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735384d-c75c-4ee6-8101-60c51c5d3863 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.355108 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735384d-c75c-4ee6-8101-60c51c5d3863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.357373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735384d-c75c-4ee6-8101-60c51c5d3863 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.359051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db583c47-ee44-433b-a6ea-b73eb9023325 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.365822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473c204-323c-4879-b05f-ebd94e020dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.366664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473c204-323c-4879-b05f-ebd94e020dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.366997 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473c204-323c-4879-b05f-ebd94e020dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.367808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473c204-323c-4879-b05f-ebd94e020dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.368832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473c204-323c-4879-b05f-ebd94e020dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.371598 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473c204-323c-4879-b05f-ebd94e020dc2 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.389417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 791/1586] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:02 2022] POST /identity/v3/users => generated 303 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:02.390329 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735384d-c75c-4ee6-8101-60c51c5d3863 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.402309 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 796/1587] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:02 2022] POST /identity/v3/users => generated 287 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:02.403692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473c204-323c-4879-b05f-ebd94e020dc2 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.417322 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473c204-323c-4879-b05f-ebd94e020dc2 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.422616 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a197fd2-b7dd-4fcf-a37c-0f88aa2b1ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.423282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a197fd2-b7dd-4fcf-a37c-0f88aa2b1ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.423568 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a197fd2-b7dd-4fcf-a37c-0f88aa2b1ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.423849 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a197fd2-b7dd-4fcf-a37c-0f88aa2b1ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.424825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a197fd2-b7dd-4fcf-a37c-0f88aa2b1ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.426874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a197fd2-b7dd-4fcf-a37c-0f88aa2b1ec1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.454148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 797/1588] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:02 2022] POST /identity/v3/users => generated 284 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:02.458912 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a197fd2-b7dd-4fcf-a37c-0f88aa2b1ec1 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.471802 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a197fd2-b7dd-4fcf-a37c-0f88aa2b1ec1 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.480399 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a06dc8-a5a9-4146-832b-e66ea7d638c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.481029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a06dc8-a5a9-4146-832b-e66ea7d638c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.481569 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a06dc8-a5a9-4146-832b-e66ea7d638c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.481852 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a06dc8-a5a9-4146-832b-e66ea7d638c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.482513 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a06dc8-a5a9-4146-832b-e66ea7d638c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.482873 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735384d-c75c-4ee6-8101-60c51c5d3863 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.484243 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a06dc8-a5a9-4146-832b-e66ea7d638c8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.488290 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364eacf-6d35-4160-80f5-ad9c5027a474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.489145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364eacf-6d35-4160-80f5-ad9c5027a474 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.489622 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364eacf-6d35-4160-80f5-ad9c5027a474 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.490079 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364eacf-6d35-4160-80f5-ad9c5027a474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.495936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 798/1589] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:02.499684 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a06dc8-a5a9-4146-832b-e66ea7d638c8 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.505348 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364eacf-6d35-4160-80f5-ad9c5027a474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.507212 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364eacf-6d35-4160-80f5-ad9c5027a474 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.511313 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a06dc8-a5a9-4146-832b-e66ea7d638c8 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.516412 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635859d-0a4f-468b-aab8-4bcff7c0b043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.517222 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635859d-0a4f-468b-aab8-4bcff7c0b043 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.517600 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635859d-0a4f-468b-aab8-4bcff7c0b043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.517972 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635859d-0a4f-468b-aab8-4bcff7c0b043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.518711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635859d-0a4f-468b-aab8-4bcff7c0b043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.521458 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 792/1590] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:02.521866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635859d-0a4f-468b-aab8-4bcff7c0b043 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.522692 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364eacf-6d35-4160-80f5-ad9c5027a474 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.533230 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364eacf-6d35-4160-80f5-ad9c5027a474 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.534506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 799/1591] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:02.536158 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635859d-0a4f-468b-aab8-4bcff7c0b043 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.540863 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8074a7-e150-4dff-98f0-401973714e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.541679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8074a7-e150-4dff-98f0-401973714e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.542167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8074a7-e150-4dff-98f0-401973714e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.542598 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8074a7-e150-4dff-98f0-401973714e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.543829 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8074a7-e150-4dff-98f0-401973714e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.546459 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8074a7-e150-4dff-98f0-401973714e60 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.547165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635859d-0a4f-468b-aab8-4bcff7c0b043 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.557797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651c2ff-5f73-4510-af4a-5cc600ce534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.558424 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651c2ff-5f73-4510-af4a-5cc600ce534e admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.558836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651c2ff-5f73-4510-af4a-5cc600ce534e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.559329 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651c2ff-5f73-4510-af4a-5cc600ce534e admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.560051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651c2ff-5f73-4510-af4a-5cc600ce534e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.561576 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 793/1592] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:02.562576 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8074a7-e150-4dff-98f0-401973714e60 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.565286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651c2ff-5f73-4510-af4a-5cc600ce534e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.574940 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8074a7-e150-4dff-98f0-401973714e60 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.580242 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d78ca-bddb-4a54-91cf-930ceea3608d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.581047 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d78ca-bddb-4a54-91cf-930ceea3608d admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.582149 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d78ca-bddb-4a54-91cf-930ceea3608d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.582267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 800/1593] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:02.583094 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d78ca-bddb-4a54-91cf-930ceea3608d admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.583469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651c2ff-5f73-4510-af4a-5cc600ce534e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.584077 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d78ca-bddb-4a54-91cf-930ceea3608d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.585918 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d78ca-bddb-4a54-91cf-930ceea3608d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.601482 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651c2ff-5f73-4510-af4a-5cc600ce534e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.602799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 794/1594] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:02.603964 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d78ca-bddb-4a54-91cf-930ceea3608d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.604525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b766a6-77b6-480f-a561-c04e1163c809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.605543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b766a6-77b6-480f-a561-c04e1163c809 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.606020 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b766a6-77b6-480f-a561-c04e1163c809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.606870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b766a6-77b6-480f-a561-c04e1163c809 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.608000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b766a6-77b6-480f-a561-c04e1163c809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.610673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b766a6-77b6-480f-a561-c04e1163c809 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.619669 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d78ca-bddb-4a54-91cf-930ceea3608d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.625332 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 801/1595] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:02.626492 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b766a6-77b6-480f-a561-c04e1163c809 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.628107 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fcca0-4ebc-4dc9-80d1-0e3575833031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.630963 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fcca0-4ebc-4dc9-80d1-0e3575833031 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.631291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fcca0-4ebc-4dc9-80d1-0e3575833031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.631625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fcca0-4ebc-4dc9-80d1-0e3575833031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.632994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fcca0-4ebc-4dc9-80d1-0e3575833031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.635350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fcca0-4ebc-4dc9-80d1-0e3575833031 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.641632 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b766a6-77b6-480f-a561-c04e1163c809 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.655123 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03415ec9-3185-4df2-9345-84fe9db1a265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.656069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03415ec9-3185-4df2-9345-84fe9db1a265 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.656362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03415ec9-3185-4df2-9345-84fe9db1a265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.656645 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03415ec9-3185-4df2-9345-84fe9db1a265 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.657756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03415ec9-3185-4df2-9345-84fe9db1a265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.659037 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 795/1596] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:02.660331 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fcca0-4ebc-4dc9-80d1-0e3575833031 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.660704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03415ec9-3185-4df2-9345-84fe9db1a265 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.672984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fcca0-4ebc-4dc9-80d1-0e3575833031 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.674224 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 802/1597] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:02.675195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03415ec9-3185-4df2-9345-84fe9db1a265 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.679941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc74719-c7dd-40ca-ba05-3090c65e505d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.681247 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc74719-c7dd-40ca-ba05-3090c65e505d admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.681719 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc74719-c7dd-40ca-ba05-3090c65e505d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.682169 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc74719-c7dd-40ca-ba05-3090c65e505d admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.683022 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc74719-c7dd-40ca-ba05-3090c65e505d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.685310 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc74719-c7dd-40ca-ba05-3090c65e505d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.694347 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03415ec9-3185-4df2-9345-84fe9db1a265 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.698820 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 796/1598] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:02.699886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc74719-c7dd-40ca-ba05-3090c65e505d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.705275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630ea49-46fe-40ff-a3b0-993f459e6505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.706327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630ea49-46fe-40ff-a3b0-993f459e6505 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.707380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630ea49-46fe-40ff-a3b0-993f459e6505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.707707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630ea49-46fe-40ff-a3b0-993f459e6505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.708462 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630ea49-46fe-40ff-a3b0-993f459e6505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.710394 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630ea49-46fe-40ff-a3b0-993f459e6505 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.712685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc74719-c7dd-40ca-ba05-3090c65e505d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.718403 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5531c-1cb0-4674-bc6b-5fa12a290f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.719543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5531c-1cb0-4674-bc6b-5fa12a290f26 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.719543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5531c-1cb0-4674-bc6b-5fa12a290f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.719834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5531c-1cb0-4674-bc6b-5fa12a290f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.720516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5531c-1cb0-4674-bc6b-5fa12a290f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.722248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5531c-1cb0-4674-bc6b-5fa12a290f26 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.730601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:02.730820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 803/1599] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:02.730820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630ea49-46fe-40ff-a3b0-993f459e6505 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.737051 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 797/1600] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:02.737972 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5531c-1cb0-4674-bc6b-5fa12a290f26 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.750567 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630ea49-46fe-40ff-a3b0-993f459e6505 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.753137 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5531c-1cb0-4674-bc6b-5fa12a290f26 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.761557 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4105f-ce34-44d2-84a9-d7ce1ab9f430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.761976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2be073-f19c-4324-a1a0-9e254059a016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.762241 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4105f-ce34-44d2-84a9-d7ce1ab9f430 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.762536 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4105f-ce34-44d2-84a9-d7ce1ab9f430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.763247 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2be073-f19c-4324-a1a0-9e254059a016 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.763746 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2be073-f19c-4324-a1a0-9e254059a016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.763858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4105f-ce34-44d2-84a9-d7ce1ab9f430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.764366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2be073-f19c-4324-a1a0-9e254059a016 admin admin] PATH_INFO: `/v3/projects/a2cfa8198a1d4fd2abe663ea6834ef27/users/36c0cb5c49fc4756930a9af1244e60a9/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.764593 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4105f-ce34-44d2-84a9-d7ce1ab9f430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.767579 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4105f-ce34-44d2-84a9-d7ce1ab9f430 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.783285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2be073-f19c-4324-a1a0-9e254059a016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2cfa8198a1d4fd2abe663ea6834ef27, user_id=36c0cb5c49fc4756930a9af1244e60a9, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.786391 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2be073-f19c-4324-a1a0-9e254059a016 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.800125 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 804/1601] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:02.800125 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4105f-ce34-44d2-84a9-d7ce1ab9f430 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.810415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 798/1602] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:02 2022] PUT /identity/v3/projects/a2cfa8198a1d4fd2abe663ea6834ef27/users/36c0cb5c49fc4756930a9af1244e60a9/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:02.811849 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2be073-f19c-4324-a1a0-9e254059a016 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.820049 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4105f-ce34-44d2-84a9-d7ce1ab9f430 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.857033 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:INSERT=12,keystone:SELECT=88 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:02.896394 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2be073-f19c-4324-a1a0-9e254059a016 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:02.902745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76299d91-23f7-469f-84f9-1f0cc4813bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.903847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76299d91-23f7-469f-84f9-1f0cc4813bae admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.904201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76299d91-23f7-469f-84f9-1f0cc4813bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.904520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76299d91-23f7-469f-84f9-1f0cc4813bae admin admin] PATH_INFO: `/v3/projects/e360ea6e5b804ee5b825d3e688c228ef/users/4bb70bc6dbfc4ffba5475e0c89e8fd03/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.915425 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79156245-cbf3-42b0-b501-b8d25e186d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:02.916573 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79156245-cbf3-42b0-b501-b8d25e186d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:02.916923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79156245-cbf3-42b0-b501-b8d25e186d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:02.917213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79156245-cbf3-42b0-b501-b8d25e186d83 admin admin] PATH_INFO: `/v3/projects/174bd0f5a3744575a5889156f31149e6/users/5335de6ca87344628a553923c5fca11a/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:02.937002 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76299d91-23f7-469f-84f9-1f0cc4813bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e360ea6e5b804ee5b825d3e688c228ef, user_id=4bb70bc6dbfc4ffba5475e0c89e8fd03, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.940248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76299d91-23f7-469f-84f9-1f0cc4813bae admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.949337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79156245-cbf3-42b0-b501-b8d25e186d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=174bd0f5a3744575a5889156f31149e6, user_id=5335de6ca87344628a553923c5fca11a, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:02.953282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79156245-cbf3-42b0-b501-b8d25e186d83 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:02.962756 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 799/1603] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:02 2022] PUT /identity/v3/projects/e360ea6e5b804ee5b825d3e688c228ef/users/4bb70bc6dbfc4ffba5475e0c89e8fd03/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:02.964266 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76299d91-23f7-469f-84f9-1f0cc4813bae admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:02.987525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 805/1604] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:02 2022] PUT /identity/v3/projects/174bd0f5a3744575a5889156f31149e6/users/5335de6ca87344628a553923c5fca11a/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:02.987525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79156245-cbf3-42b0-b501-b8d25e186d83 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:03.049531 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79156245-cbf3-42b0-b501-b8d25e186d83 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:03.055921 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40a689-c0bc-44da-81fb-6c8e1e46b4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:03.056651 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40a689-c0bc-44da-81fb-6c8e1e46b4bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:03.056940 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40a689-c0bc-44da-81fb-6c8e1e46b4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:03.057218 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40a689-c0bc-44da-81fb-6c8e1e46b4bb admin admin] PATH_INFO: `/v3/projects/50a4030549bb41cbabbd57418f647a9e/users/fc7554344773452f8d7a18513162688e/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:03.076510 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40a689-c0bc-44da-81fb-6c8e1e46b4bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a4030549bb41cbabbd57418f647a9e, user_id=fc7554344773452f8d7a18513162688e, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:03.079335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40a689-c0bc-44da-81fb-6c8e1e46b4bb admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:03.080922 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76299d91-23f7-469f-84f9-1f0cc4813bae admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:03.088750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566267c3-348f-4a3a-a9b3-cef79b37e21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:03.089727 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566267c3-348f-4a3a-a9b3-cef79b37e21c admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:03.090369 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566267c3-348f-4a3a-a9b3-cef79b37e21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:03.090811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566267c3-348f-4a3a-a9b3-cef79b37e21c admin admin] PATH_INFO: `/v3/projects/eee364531d7b4edd8d4f004db0810cda/users/b33ad4ee1b314adaa20c8d4bfcec13ab/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:03.102281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 806/1605] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:02 2022] PUT /identity/v3/projects/50a4030549bb41cbabbd57418f647a9e/users/fc7554344773452f8d7a18513162688e/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:03.114001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40a689-c0bc-44da-81fb-6c8e1e46b4bb admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:03.128821 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566267c3-348f-4a3a-a9b3-cef79b37e21c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee364531d7b4edd8d4f004db0810cda, user_id=b33ad4ee1b314adaa20c8d4bfcec13ab, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:03.132356 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566267c3-348f-4a3a-a9b3-cef79b37e21c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:03.161415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 800/1606] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:02 2022] PUT /identity/v3/projects/eee364531d7b4edd8d4f004db0810cda/users/b33ad4ee1b314adaa20c8d4bfcec13ab/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:03.162547 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cdd84-c143-4766-919d-1a7fc5299310 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:03.162863 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cdd84-c143-4766-919d-1a7fc5299310 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:03.163146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cdd84-c143-4766-919d-1a7fc5299310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:03.192339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-962cdd84-c143-4766-919d-1a7fc5299310 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:03.194604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-962cdd84-c143-4766-919d-1a7fc5299310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:03.199359 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40a689-c0bc-44da-81fb-6c8e1e46b4bb admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:03.271077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:03.286327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:03.319118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7ce08-6096-429e-8a13-c87feb22d772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:03.319978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7ce08-6096-429e-8a13-c87feb22d772 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:03.320266 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7ce08-6096-429e-8a13-c87feb22d772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:03.320558 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7ce08-6096-429e-8a13-c87feb22d772 admin admin] PATH_INFO: `/v3/projects/e74bbe1e34924cd9a0b2b54c36dea975/users/c064d1991b254b03b36b309fd4c2e421/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:03.328577 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 801/1607] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:03.330770 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d2927-dfa8-40ff-a729-83daeaa68c2c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:03.330770 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d2927-dfa8-40ff-a729-83daeaa68c2c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:03.331134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d2927-dfa8-40ff-a729-83daeaa68c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:03.345587 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7ce08-6096-429e-8a13-c87feb22d772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74bbe1e34924cd9a0b2b54c36dea975, user_id=c064d1991b254b03b36b309fd4c2e421, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:03.348913 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7ce08-6096-429e-8a13-c87feb22d772 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:03.362625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-be9d2927-dfa8-40ff-a729-83daeaa68c2c None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:03.371115 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 807/1608] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:03 2022] PUT /identity/v3/projects/e74bbe1e34924cd9a0b2b54c36dea975/users/c064d1991b254b03b36b309fd4c2e421/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:03.371320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-be9d2927-dfa8-40ff-a729-83daeaa68c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:03.371410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b15160-2200-435f-a47f-f31bb95d7b8f None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:03.371410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b15160-2200-435f-a47f-f31bb95d7b8f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:03.371410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b15160-2200-435f-a47f-f31bb95d7b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:03.403184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-91b15160-2200-435f-a47f-f31bb95d7b8f None None] MFA Rules not processed for user `4bb70bc6dbfc4ffba5475e0c89e8fd03`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:03.404886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-91b15160-2200-435f-a47f-f31bb95d7b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:03.458958 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 802/1609] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:03.460486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b22f33-5cc7-49f6-acf2-6bb4757a7c54 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:03.461542 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b22f33-5cc7-49f6-acf2-6bb4757a7c54 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:03.461754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b22f33-5cc7-49f6-acf2-6bb4757a7c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:03.489439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 808/1610] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:03.490812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5122d-ad36-49ce-bc9d-759d808d32e9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:03.491109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5122d-ad36-49ce-bc9d-759d808d32e9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:03.491549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5122d-ad36-49ce-bc9d-759d808d32e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:03.522330 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-eaa5122d-ad36-49ce-bc9d-759d808d32e9 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:03.523699 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-eaa5122d-ad36-49ce-bc9d-759d808d32e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:03.526756 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-81b22f33-5cc7-49f6-acf2-6bb4757a7c54 None None] MFA Rules not processed for user `fc7554344773452f8d7a18513162688e`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:03.527148 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-81b22f33-5cc7-49f6-acf2-6bb4757a7c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:03.584611 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 809/1611] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:03.584611 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5122d-ad36-49ce-bc9d-759d808d32e9 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:03.584611 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-eaa5122d-ad36-49ce-bc9d-759d808d32e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:03.655723 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5122d-ad36-49ce-bc9d-759d808d32e9 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:03.660118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7432c-9f9f-479b-b41c-72d940bebf70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:03.660850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7432c-9f9f-479b-b41c-72d940bebf70 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:03.661146 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7432c-9f9f-479b-b41c-72d940bebf70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:03.661423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7432c-9f9f-479b-b41c-72d940bebf70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:03.680371 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 803/1612] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:03.682543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621f5d7-0539-4285-ab20-6579a2a20f80 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:03.683123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621f5d7-0539-4285-ab20-6579a2a20f80 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:03.683721 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621f5d7-0539-4285-ab20-6579a2a20f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:03.685390 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7432c-9f9f-479b-b41c-72d940bebf70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:03.686901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7432c-9f9f-479b-b41c-72d940bebf70 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:03.704473 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 810/1613] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:03.708114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7432c-9f9f-479b-b41c-72d940bebf70 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:03.724852 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7432c-9f9f-479b-b41c-72d940bebf70 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:03.738296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0597cc7-dbd4-47c9-b27b-cc8b02a906eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:03.738954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0597cc7-dbd4-47c9-b27b-cc8b02a906eb service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:03.740083 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0597cc7-dbd4-47c9-b27b-cc8b02a906eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:03.740083 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0597cc7-dbd4-47c9-b27b-cc8b02a906eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:03.754469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c621f5d7-0539-4285-ab20-6579a2a20f80 None None] MFA Rules not processed for user `c064d1991b254b03b36b309fd4c2e421`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:03.755766 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c621f5d7-0539-4285-ab20-6579a2a20f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:03.759047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0597cc7-dbd4-47c9-b27b-cc8b02a906eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:03.760714 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0597cc7-dbd4-47c9-b27b-cc8b02a906eb service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:03.776195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 811/1614] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:03.777970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0597cc7-dbd4-47c9-b27b-cc8b02a906eb service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:03.790813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0597cc7-dbd4-47c9-b27b-cc8b02a906eb service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:03.804039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2043cb7-7095-4183-878a-fd59baf2b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:03.805578 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2043cb7-7095-4183-878a-fd59baf2b70f admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:03.806520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2043cb7-7095-4183-878a-fd59baf2b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:03.807270 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2043cb7-7095-4183-878a-fd59baf2b70f admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:03.809022 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2043cb7-7095-4183-878a-fd59baf2b70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:03.812103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2043cb7-7095-4183-878a-fd59baf2b70f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:03.858255 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 804/1615] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:03.859761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 812/1616] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:03 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:03.860101 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621f5d7-0539-4285-ab20-6579a2a20f80 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:03.868522 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:03.872222 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2043cb7-7095-4183-878a-fd59baf2b70f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:03.879508 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621f5d7-0539-4285-ab20-6579a2a20f80 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:03.887659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:03.951426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2043cb7-7095-4183-878a-fd59baf2b70f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:03.959824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb868648-5b27-4280-b334-db9b77a426d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:03.960689 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb868648-5b27-4280-b334-db9b77a426d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:03.961266 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb868648-5b27-4280-b334-db9b77a426d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:03.961727 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb868648-5b27-4280-b334-db9b77a426d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:03.962188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf35b71-3e3b-408f-801c-3092faf94520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:03.962942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf35b71-3e3b-408f-801c-3092faf94520 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:03.963338 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf35b71-3e3b-408f-801c-3092faf94520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:03.963710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf35b71-3e3b-408f-801c-3092faf94520 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:03.964612 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf35b71-3e3b-408f-801c-3092faf94520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:03.967014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf35b71-3e3b-408f-801c-3092faf94520 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:03.975534 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb868648-5b27-4280-b334-db9b77a426d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:03.978752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb868648-5b27-4280-b334-db9b77a426d9 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:04.000393 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 805/1617] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:04.001677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb868648-5b27-4280-b334-db9b77a426d9 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:04.015709 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 813/1618] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:03 2022] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:04.016930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf35b71-3e3b-408f-801c-3092faf94520 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:04.017240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb868648-5b27-4280-b334-db9b77a426d9 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:04.090525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf35b71-3e3b-408f-801c-3092faf94520 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:04.095108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3423c-7414-49f4-a6fa-b0bb4850b5db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:04.095813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3423c-7414-49f4-a6fa-b0bb4850b5db service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:04.096299 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3423c-7414-49f4-a6fa-b0bb4850b5db service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:04.096689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3423c-7414-49f4-a6fa-b0bb4850b5db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:04.118483 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2be61b-29a1-46dc-ac72-025babe068af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:04.121389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2be61b-29a1-46dc-ac72-025babe068af admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:04.121877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2be61b-29a1-46dc-ac72-025babe068af admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:04.122740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2be61b-29a1-46dc-ac72-025babe068af admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:04.123858 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2be61b-29a1-46dc-ac72-025babe068af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:04.127184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2be61b-29a1-46dc-ac72-025babe068af admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:04.173536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 806/1619] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:04 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:04.174583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2be61b-29a1-46dc-ac72-025babe068af admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:04.188718 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3423c-7414-49f4-a6fa-b0bb4850b5db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:04.190489 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3423c-7414-49f4-a6fa-b0bb4850b5db service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:04.216866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2be61b-29a1-46dc-ac72-025babe068af admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:04.237399 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3723884-79a9-40bb-be70-ecbea5bff45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:04.239907 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3723884-79a9-40bb-be70-ecbea5bff45a admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:04.249606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 814/1620] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:04.252094 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3423c-7414-49f4-a6fa-b0bb4850b5db service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:04.253125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3723884-79a9-40bb-be70-ecbea5bff45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:04.253736 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3723884-79a9-40bb-be70-ecbea5bff45a admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:04.255897 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3723884-79a9-40bb-be70-ecbea5bff45a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:04.258250 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3723884-79a9-40bb-be70-ecbea5bff45a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:04.291662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3423c-7414-49f4-a6fa-b0bb4850b5db service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:04.307872 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f9318-b729-49c3-b6cc-f99dc249a34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:04.308510 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f9318-b729-49c3-b6cc-f99dc249a34e admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:04.308797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f9318-b729-49c3-b6cc-f99dc249a34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:04.309077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f9318-b729-49c3-b6cc-f99dc249a34e admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:04.309749 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f9318-b729-49c3-b6cc-f99dc249a34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:04.310307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 807/1621] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:04 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:04.314050 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3723884-79a9-40bb-be70-ecbea5bff45a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:04.317891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f9318-b729-49c3-b6cc-f99dc249a34e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:04.339114 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3723884-79a9-40bb-be70-ecbea5bff45a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:04.347601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fb19e-8b6d-4242-8342-cfc30582750e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:04.348236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fb19e-8b6d-4242-8342-cfc30582750e admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:04.348524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fb19e-8b6d-4242-8342-cfc30582750e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:04.348804 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fb19e-8b6d-4242-8342-cfc30582750e admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:04.349932 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fb19e-8b6d-4242-8342-cfc30582750e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:04.365489 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 815/1622] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:04.366800 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f9318-b729-49c3-b6cc-f99dc249a34e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:04.370639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fb19e-8b6d-4242-8342-cfc30582750e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:04.394430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 808/1623] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:20:04.400154 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fb19e-8b6d-4242-8342-cfc30582750e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:04.416622 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f9318-b729-49c3-b6cc-f99dc249a34e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:04.419430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fb19e-8b6d-4242-8342-cfc30582750e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:04.428044 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634e4e5-d95e-4916-8509-87406bfb528f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:04.428864 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634e4e5-d95e-4916-8509-87406bfb528f admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:04.429241 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634e4e5-d95e-4916-8509-87406bfb528f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:04.429577 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634e4e5-d95e-4916-8509-87406bfb528f admin admin] PATH_INFO: `/v3/projects/17fd53a1082a42328c7819c60f86b487/users/6df505669c634507916007ade5af8dc6/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:04.435215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6594dd-f174-418b-9b70-6b9b6ad62a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:04.436335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6594dd-f174-418b-9b70-6b9b6ad62a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:04.436335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6594dd-f174-418b-9b70-6b9b6ad62a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:04.436535 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6594dd-f174-418b-9b70-6b9b6ad62a1a admin admin] PATH_INFO: `/v3/projects/5e47f9680cc14df2a6098341dd567732/users/65a387846fb54fe6aad20a3d0d70ec88/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:04.454789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634e4e5-d95e-4916-8509-87406bfb528f admin admin] RBAC: Authorizing `identity:create_grant(project_id=17fd53a1082a42328c7819c60f86b487, user_id=6df505669c634507916007ade5af8dc6, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:04.458614 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634e4e5-d95e-4916-8509-87406bfb528f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:04.497389 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6594dd-f174-418b-9b70-6b9b6ad62a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e47f9680cc14df2a6098341dd567732, user_id=65a387846fb54fe6aad20a3d0d70ec88, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:04.502804 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 809/1624] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:04 2022] PUT /identity/v3/projects/17fd53a1082a42328c7819c60f86b487/users/6df505669c634507916007ade5af8dc6/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:04.502966 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6594dd-f174-418b-9b70-6b9b6ad62a1a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:04.506012 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634e4e5-d95e-4916-8509-87406bfb528f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:04.581194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 816/1625] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:04 2022] PUT /identity/v3/projects/5e47f9680cc14df2a6098341dd567732/users/65a387846fb54fe6aad20a3d0d70ec88/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:04.582871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6594dd-f174-418b-9b70-6b9b6ad62a1a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:04.618819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:04.625905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:04.656390 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634e4e5-d95e-4916-8509-87406bfb528f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:04.729027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6594dd-f174-418b-9b70-6b9b6ad62a1a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:04.739340 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7007245-5707-4fa9-9314-cd13f7a50555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:04.740860 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7007245-5707-4fa9-9314-cd13f7a50555 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:04.741850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7007245-5707-4fa9-9314-cd13f7a50555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:04.742731 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7007245-5707-4fa9-9314-cd13f7a50555 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:04.742855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7007245-5707-4fa9-9314-cd13f7a50555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:04.745072 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7007245-5707-4fa9-9314-cd13f7a50555 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:04.775081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 817/1626] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:04.777439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7007245-5707-4fa9-9314-cd13f7a50555 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:04.800534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7007245-5707-4fa9-9314-cd13f7a50555 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:04.812610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb7139-b0c1-4b20-9649-3ddf733c917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:04.814240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb7139-b0c1-4b20-9649-3ddf733c917a admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:04.814603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb7139-b0c1-4b20-9649-3ddf733c917a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:04.816748 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb7139-b0c1-4b20-9649-3ddf733c917a admin admin] PATH_INFO: `/v3/projects/5e47f9680cc14df2a6098341dd567732/users/65a387846fb54fe6aad20a3d0d70ec88/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:04.822948 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb7139-b0c1-4b20-9649-3ddf733c917a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e47f9680cc14df2a6098341dd567732, user_id=65a387846fb54fe6aad20a3d0d70ec88, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:04.828871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb7139-b0c1-4b20-9649-3ddf733c917a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:04.849292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79ecf9-3d15-4f02-9726-47b96095f1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:04.850075 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79ecf9-3d15-4f02-9726-47b96095f1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:04.850461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79ecf9-3d15-4f02-9726-47b96095f1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:04.850871 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79ecf9-3d15-4f02-9726-47b96095f1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:04.851630 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79ecf9-3d15-4f02-9726-47b96095f1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:04.863384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79ecf9-3d15-4f02-9726-47b96095f1c9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:04.867426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 818/1627] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:04 2022] PUT /identity/v3/projects/5e47f9680cc14df2a6098341dd567732/users/65a387846fb54fe6aad20a3d0d70ec88/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:04.869461 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c3aad-8d3a-4a13-b61a-7f4f6cbf7816 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:04.869461 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c3aad-8d3a-4a13-b61a-7f4f6cbf7816 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:04.869715 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c3aad-8d3a-4a13-b61a-7f4f6cbf7816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:04.886182 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 810/1628] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:04.890477 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79ecf9-3d15-4f02-9726-47b96095f1c9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:04.907084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79ecf9-3d15-4f02-9726-47b96095f1c9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:04.939302 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8e0c3aad-8d3a-4a13-b61a-7f4f6cbf7816 None None] MFA Rules not processed for user `65a387846fb54fe6aad20a3d0d70ec88`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:04.942750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8e0c3aad-8d3a-4a13-b61a-7f4f6cbf7816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:05.034904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc45bb-5e95-4f07-81c5-4b9905866300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:05.036566 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc45bb-5e95-4f07-81c5-4b9905866300 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:05.036852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc45bb-5e95-4f07-81c5-4b9905866300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:05.037128 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc45bb-5e95-4f07-81c5-4b9905866300 admin admin] PATH_INFO: `/v3/projects/17fd53a1082a42328c7819c60f86b487/users/6df505669c634507916007ade5af8dc6/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:05.039380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc45bb-5e95-4f07-81c5-4b9905866300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17fd53a1082a42328c7819c60f86b487, user_id=6df505669c634507916007ade5af8dc6, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:05.042833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc45bb-5e95-4f07-81c5-4b9905866300 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:05.059222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 811/1629] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:04 2022] PUT /identity/v3/projects/17fd53a1082a42328c7819c60f86b487/users/6df505669c634507916007ade5af8dc6/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:05.069653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a53e7a-3e4c-43ae-b502-ee5bb281899a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:05.070072 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a53e7a-3e4c-43ae-b502-ee5bb281899a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:05.070590 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a53e7a-3e4c-43ae-b502-ee5bb281899a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:05.102812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 819/1630] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:05.116320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c3aad-8d3a-4a13-b61a-7f4f6cbf7816 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:05.120969 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e4a53e7a-3e4c-43ae-b502-ee5bb281899a None None] MFA Rules not processed for user `6df505669c634507916007ade5af8dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:05.122514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e4a53e7a-3e4c-43ae-b502-ee5bb281899a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:05.251393 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c3aad-8d3a-4a13-b61a-7f4f6cbf7816 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:05.271092 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 812/1631] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:05.303164 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a53e7a-3e4c-43ae-b502-ee5bb281899a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:05.309324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:05.394989 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:05.424770 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac73c77-6e87-4055-9d06-ddd52bf3440c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:05.425920 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac73c77-6e87-4055-9d06-ddd52bf3440c service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:05.426532 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac73c77-6e87-4055-9d06-ddd52bf3440c service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:05.427067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac73c77-6e87-4055-9d06-ddd52bf3440c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:05.479025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a53e7a-3e4c-43ae-b502-ee5bb281899a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:05.490712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a9b78-79f2-4dca-830e-0636121df050 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:05.491433 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a9b78-79f2-4dca-830e-0636121df050 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:05.491722 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a9b78-79f2-4dca-830e-0636121df050 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:05.492002 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a9b78-79f2-4dca-830e-0636121df050 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:05.517935 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a9b78-79f2-4dca-830e-0636121df050 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:05.523119 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a9b78-79f2-4dca-830e-0636121df050 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:05.563233 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 813/1632] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:20:05.607334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac73c77-6e87-4055-9d06-ddd52bf3440c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:05.609487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac73c77-6e87-4055-9d06-ddd52bf3440c service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:05.637069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 820/1633] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:20:05.868454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a9b78-79f2-4dca-830e-0636121df050 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:05.879475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a9b78-79f2-4dca-830e-0636121df050 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:05.890646 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d8749-b205-4ed2-9ec9-ce24ec580f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:05.891317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d8749-b205-4ed2-9ec9-ce24ec580f4b service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:05.891606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d8749-b205-4ed2-9ec9-ce24ec580f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:05.891945 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d8749-b205-4ed2-9ec9-ce24ec580f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:06.041278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d8749-b205-4ed2-9ec9-ce24ec580f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:06.042506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d8749-b205-4ed2-9ec9-ce24ec580f4b service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:06.077646 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 814/1634] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:06.498042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac73c77-6e87-4055-9d06-ddd52bf3440c service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:06.610687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac73c77-6e87-4055-9d06-ddd52bf3440c service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:06.618855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb2621-6aed-4891-83e0-17ca4029c677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:06.620301 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb2621-6aed-4891-83e0-17ca4029c677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:06.621514 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb2621-6aed-4891-83e0-17ca4029c677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:06.622034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb2621-6aed-4891-83e0-17ca4029c677 admin admin] PATH_INFO: `/v3/users/fc7554344773452f8d7a18513162688e` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:06.624028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb2621-6aed-4891-83e0-17ca4029c677 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc7554344773452f8d7a18513162688e)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:06.628807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb2621-6aed-4891-83e0-17ca4029c677 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:06.716044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c4cb2621-6aed-4891-83e0-17ca4029c677 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc7554344773452f8d7a18513162688e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:06.733595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c4cb2621-6aed-4891-83e0-17ca4029c677 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc7554344773452f8d7a18513162688e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:06.750430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c4cb2621-6aed-4891-83e0-17ca4029c677 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc7554344773452f8d7a18513162688e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:06.777774 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c4cb2621-6aed-4891-83e0-17ca4029c677 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc7554344773452f8d7a18513162688e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:06.795250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c4cb2621-6aed-4891-83e0-17ca4029c677 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc7554344773452f8d7a18513162688e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:06.805198 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 821/1635] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:06 2022] DELETE /identity/v3/users/fc7554344773452f8d7a18513162688e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:06.810078 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4253ab-3837-4526-8b89-ac7b76f94ca1 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:06.810374 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4253ab-3837-4526-8b89-ac7b76f94ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:06.810652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4253ab-3837-4526-8b89-ac7b76f94ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:06.854370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ca4253ab-3837-4526-8b89-ac7b76f94ca1 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:06.856001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ca4253ab-3837-4526-8b89-ac7b76f94ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:06.949375 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 815/1636] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:06.987666 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb2621-6aed-4891-83e0-17ca4029c677 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:06.989440 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c4cb2621-6aed-4891-83e0-17ca4029c677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:07.028782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:07.190840 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb2621-6aed-4891-83e0-17ca4029c677 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:07.210273 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f45eb-addc-4a47-8826-56033e7a4db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:07.210991 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f45eb-addc-4a47-8826-56033e7a4db6 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:07.211273 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f45eb-addc-4a47-8826-56033e7a4db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:07.211545 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f45eb-addc-4a47-8826-56033e7a4db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:07.235262 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f45eb-addc-4a47-8826-56033e7a4db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:07.236905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f45eb-addc-4a47-8826-56033e7a4db6 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:07.254769 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 822/1637] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:07.326994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce024510-bc57-41e8-8628-8688c33cd07e None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:07.327462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce024510-bc57-41e8-8628-8688c33cd07e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:07.327850 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce024510-bc57-41e8-8628-8688c33cd07e None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:07.329660 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 816/1638] 10.222.0.48 () {54 vars in 961 bytes} [Tue Sep 27 04:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:20:07.357396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df603056-77db-4d95-842c-cfc1816827f9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:07.357614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df603056-77db-4d95-842c-cfc1816827f9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:07.357887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df603056-77db-4d95-842c-cfc1816827f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:07.445973 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-df603056-77db-4d95-842c-cfc1816827f9 None None] MFA Rules not processed for user `3960d52dee8443cf9ec8930a389a7b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:07.447015 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-df603056-77db-4d95-842c-cfc1816827f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:07.646348 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b7369-94f7-439e-a34c-5752993acc68 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:07.646652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b7369-94f7-439e-a34c-5752993acc68 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:07.646887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 823/1639] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Sep 27 04:20:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:07.646969 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b7369-94f7-439e-a34c-5752993acc68 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:07.648363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 817/1640] 10.222.0.48 () {54 vars in 912 bytes} [Tue Sep 27 04:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:20:07.654856 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb01649-fed2-4917-ab76-e8775143bc8d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:07.655447 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb01649-fed2-4917-ab76-e8775143bc8d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:07.655944 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb01649-fed2-4917-ab76-e8775143bc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:07.712863 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-aeb01649-fed2-4917-ab76-e8775143bc8d None None] MFA Rules not processed for user `3960d52dee8443cf9ec8930a389a7b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:07.716933 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-aeb01649-fed2-4917-ab76-e8775143bc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:07.756019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b7369-94f7-439e-a34c-5752993acc68 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:07.758567 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-363b7369-94f7-439e-a34c-5752993acc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:07.767645 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 824/1641] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 27 04:20:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:07.868020 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64a8f9-aeba-419b-b002-c99d337c28e6 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:07.868445 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64a8f9-aeba-419b-b002-c99d337c28e6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:07.868873 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64a8f9-aeba-419b-b002-c99d337c28e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:07.888499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:07.908241 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b7369-94f7-439e-a34c-5752993acc68 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:07.919386 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ca148-07ba-40cb-9841-f20857a90103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:07.920345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ca148-07ba-40cb-9841-f20857a90103 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:07.922911 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ca148-07ba-40cb-9841-f20857a90103 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:07.923607 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ca148-07ba-40cb-9841-f20857a90103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:07.944619 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-ba64a8f9-aeba-419b-b002-c99d337c28e6 None None] MFA Rules not processed for user `b33ad4ee1b314adaa20c8d4bfcec13ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:07.946413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ba64a8f9-aeba-419b-b002-c99d337c28e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:07.959080 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ca148-07ba-40cb-9841-f20857a90103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:07.962195 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ca148-07ba-40cb-9841-f20857a90103 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:08.013630 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 818/1642] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:08.137266 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 825/1643] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:07 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:08.141905 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ca148-07ba-40cb-9841-f20857a90103 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:08.143724 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-863ca148-07ba-40cb-9841-f20857a90103 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:08.171614 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ca148-07ba-40cb-9841-f20857a90103 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:08.186968 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbd1a5-beba-4626-85f8-c5e793bbd908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:08.187844 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbd1a5-beba-4626-85f8-c5e793bbd908 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:08.190998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbd1a5-beba-4626-85f8-c5e793bbd908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:08.191549 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbd1a5-beba-4626-85f8-c5e793bbd908 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:08.194748 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbd1a5-beba-4626-85f8-c5e793bbd908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:08.196936 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbd1a5-beba-4626-85f8-c5e793bbd908 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:08.273887 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 819/1644] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:08 2022] POST /identity/v3/projects => generated 405 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:08.278067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64a8f9-aeba-419b-b002-c99d337c28e6 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:08.302815 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64a8f9-aeba-419b-b002-c99d337c28e6 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:08.342357 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:08.457339 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a387fbe-80c1-4519-a745-daae6025ac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:08.458274 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a387fbe-80c1-4519-a745-daae6025ac71 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:08.458738 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a387fbe-80c1-4519-a745-daae6025ac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:08.460359 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a387fbe-80c1-4519-a745-daae6025ac71 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:08.461370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a387fbe-80c1-4519-a745-daae6025ac71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:08.467000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a387fbe-80c1-4519-a745-daae6025ac71 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:08.520186 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 826/1645] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:08 2022] POST /identity/v3/users => generated 309 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:20:08.524947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbd1a5-beba-4626-85f8-c5e793bbd908 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:08.540800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbd1a5-beba-4626-85f8-c5e793bbd908 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:08.562056 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75bdb9-db6d-4f11-815f-37b47658bccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:08.562938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75bdb9-db6d-4f11-815f-37b47658bccc admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:08.564077 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75bdb9-db6d-4f11-815f-37b47658bccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:08.565031 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75bdb9-db6d-4f11-815f-37b47658bccc admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:08.575754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75bdb9-db6d-4f11-815f-37b47658bccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:08.581634 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75bdb9-db6d-4f11-815f-37b47658bccc admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:08.625210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a387fbe-80c1-4519-a745-daae6025ac71 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:08.625822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 820/1646] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:08.652251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a387fbe-80c1-4519-a745-daae6025ac71 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:08.674562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aeaecd-15e1-4dd7-b441-ab6b4be0315b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:08.676496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeaecd-15e1-4dd7-b441-ab6b4be0315b admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:08.677487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeaecd-15e1-4dd7-b441-ab6b4be0315b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:08.680251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeaecd-15e1-4dd7-b441-ab6b4be0315b admin admin] PATH_INFO: `/v3/projects/ab65aee3ba9c48e78d16d67f7a71bfa5/users/c2d73edbcc214518a4b2ac6edbea0450/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:08.814844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aeaecd-15e1-4dd7-b441-ab6b4be0315b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab65aee3ba9c48e78d16d67f7a71bfa5, user_id=c2d73edbcc214518a4b2ac6edbea0450, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:08.832911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aeaecd-15e1-4dd7-b441-ab6b4be0315b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:08.869671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 827/1647] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:08 2022] PUT /identity/v3/projects/ab65aee3ba9c48e78d16d67f7a71bfa5/users/c2d73edbcc214518a4b2ac6edbea0450/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:08.875379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75bdb9-db6d-4f11-815f-37b47658bccc admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:08.890527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75bdb9-db6d-4f11-815f-37b47658bccc admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:09.046357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0ee5f-c1a6-418c-b3e9-ddf9230aa82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:09.047093 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0ee5f-c1a6-418c-b3e9-ddf9230aa82e admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:09.047546 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0ee5f-c1a6-418c-b3e9-ddf9230aa82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:09.047976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0ee5f-c1a6-418c-b3e9-ddf9230aa82e admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:09.048854 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0ee5f-c1a6-418c-b3e9-ddf9230aa82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:09.051597 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0ee5f-c1a6-418c-b3e9-ddf9230aa82e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:09.073355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aeaecd-15e1-4dd7-b441-ab6b4be0315b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:09.081007 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 821/1648] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:09.087062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aeaecd-15e1-4dd7-b441-ab6b4be0315b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:09.093684 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db004fe-ce54-4298-9cdd-e84a3611d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:09.094639 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db004fe-ce54-4298-9cdd-e84a3611d338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:09.095026 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db004fe-ce54-4298-9cdd-e84a3611d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:09.095376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db004fe-ce54-4298-9cdd-e84a3611d338 admin admin] PATH_INFO: `/v3/projects/ab65aee3ba9c48e78d16d67f7a71bfa5/users/c2d73edbcc214518a4b2ac6edbea0450/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:09.098280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db004fe-ce54-4298-9cdd-e84a3611d338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab65aee3ba9c48e78d16d67f7a71bfa5, user_id=c2d73edbcc214518a4b2ac6edbea0450, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:09.101285 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db004fe-ce54-4298-9cdd-e84a3611d338 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:09.123189 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 828/1649] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:09 2022] PUT /identity/v3/projects/ab65aee3ba9c48e78d16d67f7a71bfa5/users/c2d73edbcc214518a4b2ac6edbea0450/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:09.724173 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0ee5f-c1a6-418c-b3e9-ddf9230aa82e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:09.725988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-87a0ee5f-c1a6-418c-b3e9-ddf9230aa82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:09.759745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0ee5f-c1a6-418c-b3e9-ddf9230aa82e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:09.979257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addaf7a-3141-4b01-89a2-f3e4f1a2d914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:09.984822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addaf7a-3141-4b01-89a2-f3e4f1a2d914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:09.985362 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addaf7a-3141-4b01-89a2-f3e4f1a2d914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:09.988855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addaf7a-3141-4b01-89a2-f3e4f1a2d914 admin admin] PATH_INFO: `/v3/projects/50a4030549bb41cbabbd57418f647a9e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:09.990895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addaf7a-3141-4b01-89a2-f3e4f1a2d914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a4030549bb41cbabbd57418f647a9e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:10.003872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addaf7a-3141-4b01-89a2-f3e4f1a2d914 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:10.153128 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8addaf7a-3141-4b01-89a2-f3e4f1a2d914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a4030549bb41cbabbd57418f647a9e', 'request_id': 'req-8addaf7a-3141-4b01-89a2-f3e4f1a2d914'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:10.175673 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8addaf7a-3141-4b01-89a2-f3e4f1a2d914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a4030549bb41cbabbd57418f647a9e', 'request_id': 'req-8addaf7a-3141-4b01-89a2-f3e4f1a2d914'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:10.182601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:10.203669 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8addaf7a-3141-4b01-89a2-f3e4f1a2d914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a4030549bb41cbabbd57418f647a9e', 'request_id': 'req-8addaf7a-3141-4b01-89a2-f3e4f1a2d914'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:10.210609 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db004fe-ce54-4298-9cdd-e84a3611d338 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:10.213606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7db004fe-ce54-4298-9cdd-e84a3611d338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:10.237066 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8addaf7a-3141-4b01-89a2-f3e4f1a2d914 admin admin] The token cache is being invalidate because project 50a4030549bb41cbabbd57418f647a9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:10.239315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8addaf7a-3141-4b01-89a2-f3e4f1a2d914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:10.242037 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8addaf7a-3141-4b01-89a2-f3e4f1a2d914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:10.245790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 822/1650] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:09 2022] DELETE /identity/v3/projects/50a4030549bb41cbabbd57418f647a9e => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:10.249808 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addaf7a-3141-4b01-89a2-f3e4f1a2d914 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:10.251930 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8addaf7a-3141-4b01-89a2-f3e4f1a2d914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:10.256003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db004fe-ce54-4298-9cdd-e84a3611d338 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:10.466834 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5c02d-d992-437f-a6b3-925eb4a1afc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:10.467511 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5c02d-d992-437f-a6b3-925eb4a1afc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:10.467800 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5c02d-d992-437f-a6b3-925eb4a1afc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:10.468082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5c02d-d992-437f-a6b3-925eb4a1afc7 admin admin] PATH_INFO: `/v3/users/4bb70bc6dbfc4ffba5475e0c89e8fd03` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:10.471309 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5c02d-d992-437f-a6b3-925eb4a1afc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb70bc6dbfc4ffba5475e0c89e8fd03)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:10.474748 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5c02d-d992-437f-a6b3-925eb4a1afc7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:10.489866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addaf7a-3141-4b01-89a2-f3e4f1a2d914 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:10.513612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b2e74-f288-4f0c-898d-74cae28df3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:10.514463 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b2e74-f288-4f0c-898d-74cae28df3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:10.514923 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b2e74-f288-4f0c-898d-74cae28df3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:10.515402 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b2e74-f288-4f0c-898d-74cae28df3aa admin admin] PATH_INFO: `/v3/users/6df505669c634507916007ade5af8dc6` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:10.517834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b2e74-f288-4f0c-898d-74cae28df3aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df505669c634507916007ade5af8dc6)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:10.519885 dv-cinder-859186-3-smb devstack@keystone.service[81374]: WARNING py.warnings [None req-158b2e74-f288-4f0c-898d-74cae28df3aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 04:20:10.519885 dv-cinder-859186-3-smb devstack@keystone.service[81374]: warnings.warn(msg) Sep 27 04:20:10.519885 dv-cinder-859186-3-smb devstack@keystone.service[81374]: Sep 27 04:20:10.522279 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b2e74-f288-4f0c-898d-74cae28df3aa admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:10.610690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c9a5c02d-d992-437f-a6b3-925eb4a1afc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb70bc6dbfc4ffba5475e0c89e8fd03'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:10.631811 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c9a5c02d-d992-437f-a6b3-925eb4a1afc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb70bc6dbfc4ffba5475e0c89e8fd03'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:10.636011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c9a5c02d-d992-437f-a6b3-925eb4a1afc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb70bc6dbfc4ffba5475e0c89e8fd03'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:10.653619 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:10.660997 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c9a5c02d-d992-437f-a6b3-925eb4a1afc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb70bc6dbfc4ffba5475e0c89e8fd03'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:10.699129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c9a5c02d-d992-437f-a6b3-925eb4a1afc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb70bc6dbfc4ffba5475e0c89e8fd03'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:10.719555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 829/1651] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:10 2022] DELETE /identity/v3/users/4bb70bc6dbfc4ffba5475e0c89e8fd03 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:10.727939 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b483d-477f-40f0-9251-eb2b10512333 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:10.729189 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b483d-477f-40f0-9251-eb2b10512333 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:10.729536 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b483d-477f-40f0-9251-eb2b10512333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:10.829112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-158b2e74-f288-4f0c-898d-74cae28df3aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df505669c634507916007ade5af8dc6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:10.831966 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a52b483d-477f-40f0-9251-eb2b10512333 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:10.835931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a52b483d-477f-40f0-9251-eb2b10512333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:10.876360 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-158b2e74-f288-4f0c-898d-74cae28df3aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df505669c634507916007ade5af8dc6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:10.971370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-158b2e74-f288-4f0c-898d-74cae28df3aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df505669c634507916007ade5af8dc6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:10.974952 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-158b2e74-f288-4f0c-898d-74cae28df3aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df505669c634507916007ade5af8dc6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:10.998147 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-158b2e74-f288-4f0c-898d-74cae28df3aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df505669c634507916007ade5af8dc6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:11.013932 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 823/1652] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:10 2022] DELETE /identity/v3/users/6df505669c634507916007ade5af8dc6 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:11.018491 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382ea29-8a24-4d1c-ba8c-eba091d10203 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:11.019392 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382ea29-8a24-4d1c-ba8c-eba091d10203 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:11.019798 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382ea29-8a24-4d1c-ba8c-eba091d10203 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:11.028856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 824/1653] 10.222.0.48 () {54 vars in 961 bytes} [Tue Sep 27 04:20:11 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:20:11.039665 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7865ad-6685-41ce-8c66-c9515973a966 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:11.039963 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7865ad-6685-41ce-8c66-c9515973a966 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:11.040239 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7865ad-6685-41ce-8c66-c9515973a966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:11.099321 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 830/1654] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:11.117648 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b483d-477f-40f0-9251-eb2b10512333 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:11.123871 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-fa7865ad-6685-41ce-8c66-c9515973a966 None None] MFA Rules not processed for user `3960d52dee8443cf9ec8930a389a7b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:11.125122 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fa7865ad-6685-41ce-8c66-c9515973a966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:11.137561 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a52b483d-477f-40f0-9251-eb2b10512333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:11.273176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:11.301602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 825/1655] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Sep 27 04:20:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:11.301937 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b483d-477f-40f0-9251-eb2b10512333 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:11.309062 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a108007-0605-4264-8bf1-56905ac13280 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:11.309371 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a108007-0605-4264-8bf1-56905ac13280 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:11.309657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a108007-0605-4264-8bf1-56905ac13280 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:11.311061 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 826/1656] 10.222.0.48 () {54 vars in 912 bytes} [Tue Sep 27 04:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:20:11.319936 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b1adc-fde3-4caf-85ef-eb97044cb098 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:11.320203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b1adc-fde3-4caf-85ef-eb97044cb098 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:11.320494 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b1adc-fde3-4caf-85ef-eb97044cb098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:11.375798 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f53b1adc-fde3-4caf-85ef-eb97044cb098 None None] MFA Rules not processed for user `3960d52dee8443cf9ec8930a389a7b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:11.376965 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f53b1adc-fde3-4caf-85ef-eb97044cb098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:11.420416 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735eb20-e4a5-4659-88ae-ed8af1018226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:11.421043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735eb20-e4a5-4659-88ae-ed8af1018226 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:11.421384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735eb20-e4a5-4659-88ae-ed8af1018226 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:11.421881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735eb20-e4a5-4659-88ae-ed8af1018226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:11.426259 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 827/1657] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 27 04:20:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:11.453687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b1adc-fde3-4caf-85ef-eb97044cb098 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:11.455943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f53b1adc-fde3-4caf-85ef-eb97044cb098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:11.557520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:11.564627 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735eb20-e4a5-4659-88ae-ed8af1018226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:11.575515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735eb20-e4a5-4659-88ae-ed8af1018226 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:11.613506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 831/1658] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:11.630538 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b1adc-fde3-4caf-85ef-eb97044cb098 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:11.637558 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa8e63-01d9-4dc5-9855-a682821ce45a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:11.638466 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa8e63-01d9-4dc5-9855-a682821ce45a service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:11.639043 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa8e63-01d9-4dc5-9855-a682821ce45a service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:11.639633 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa8e63-01d9-4dc5-9855-a682821ce45a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:11.654512 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa8e63-01d9-4dc5-9855-a682821ce45a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:11.656458 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa8e63-01d9-4dc5-9855-a682821ce45a service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:11.674376 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 828/1659] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:13.596558 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735eb20-e4a5-4659-88ae-ed8af1018226 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:13.599293 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b735eb20-e4a5-4659-88ae-ed8af1018226 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:13.620538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735eb20-e4a5-4659-88ae-ed8af1018226 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:13.636438 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dc779-75dc-4a3a-af42-89d5017ec502 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:13.636879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dc779-75dc-4a3a-af42-89d5017ec502 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:13.637013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dc779-75dc-4a3a-af42-89d5017ec502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:13.642247 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a13d2c-a611-4148-9d9d-7332744c1ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:13.642937 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a13d2c-a611-4148-9d9d-7332744c1ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:13.643277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a13d2c-a611-4148-9d9d-7332744c1ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:13.644163 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a13d2c-a611-4148-9d9d-7332744c1ccf admin admin] PATH_INFO: `/v3/projects/17fd53a1082a42328c7819c60f86b487` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:13.647728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a13d2c-a611-4148-9d9d-7332744c1ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=17fd53a1082a42328c7819c60f86b487)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:13.647895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: WARNING py.warnings [None req-90a13d2c-a611-4148-9d9d-7332744c1ccf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 04:20:13.647895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: warnings.warn(msg) Sep 27 04:20:13.647895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: Sep 27 04:20:13.649080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a13d2c-a611-4148-9d9d-7332744c1ccf admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:13.744615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-7e2dc779-75dc-4a3a-af42-89d5017ec502 None None] MFA Rules not processed for user `c2d73edbcc214518a4b2ac6edbea0450`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:13.745849 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7e2dc779-75dc-4a3a-af42-89d5017ec502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:13.873804 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-90a13d2c-a611-4148-9d9d-7332744c1ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17fd53a1082a42328c7819c60f86b487', 'request_id': 'req-90a13d2c-a611-4148-9d9d-7332744c1ccf'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:13.905589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-90a13d2c-a611-4148-9d9d-7332744c1ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17fd53a1082a42328c7819c60f86b487', 'request_id': 'req-90a13d2c-a611-4148-9d9d-7332744c1ccf'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:13.946799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-90a13d2c-a611-4148-9d9d-7332744c1ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17fd53a1082a42328c7819c60f86b487', 'request_id': 'req-90a13d2c-a611-4148-9d9d-7332744c1ccf'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:13.993148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-90a13d2c-a611-4148-9d9d-7332744c1ccf admin admin] The token cache is being invalidate because project 17fd53a1082a42328c7819c60f86b487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:13.993453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-90a13d2c-a611-4148-9d9d-7332744c1ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:13.995787 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-90a13d2c-a611-4148-9d9d-7332744c1ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:13.997419 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 832/1660] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:13 2022] DELETE /identity/v3/projects/17fd53a1082a42328c7819c60f86b487 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:14.000601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a13d2c-a611-4148-9d9d-7332744c1ccf admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:14.011189 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-90a13d2c-a611-4148-9d9d-7332744c1ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:14.015311 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 829/1661] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:13 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:14.021582 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236ebc0-988b-4986-aa74-07f42003af29 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:14.021582 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236ebc0-988b-4986-aa74-07f42003af29 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:14.021582 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236ebc0-988b-4986-aa74-07f42003af29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:14.089090 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-6236ebc0-988b-4986-aa74-07f42003af29 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:14.091407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6236ebc0-988b-4986-aa74-07f42003af29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:14.192974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a13d2c-a611-4148-9d9d-7332744c1ccf admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:14.206969 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b2974-a5c0-46e9-bbbd-72a19ac08a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:14.207590 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b2974-a5c0-46e9-bbbd-72a19ac08a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:14.207982 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b2974-a5c0-46e9-bbbd-72a19ac08a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:14.208370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b2974-a5c0-46e9-bbbd-72a19ac08a40 admin admin] PATH_INFO: `/v3/projects/e360ea6e5b804ee5b825d3e688c228ef` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:14.211433 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b2974-a5c0-46e9-bbbd-72a19ac08a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e360ea6e5b804ee5b825d3e688c228ef)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:14.213614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b2974-a5c0-46e9-bbbd-72a19ac08a40 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:14.260653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 830/1662] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:14.270623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443afd0-e3f4-4dee-87c4-73addb190e23 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:14.270952 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443afd0-e3f4-4dee-87c4-73addb190e23 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:14.271238 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443afd0-e3f4-4dee-87c4-73addb190e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:14.328205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f443afd0-e3f4-4dee-87c4-73addb190e23 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:14.329975 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f443afd0-e3f4-4dee-87c4-73addb190e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:14.352007 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-de4b2974-a5c0-46e9-bbbd-72a19ac08a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e360ea6e5b804ee5b825d3e688c228ef', 'request_id': 'req-de4b2974-a5c0-46e9-bbbd-72a19ac08a40'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:14.363658 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-de4b2974-a5c0-46e9-bbbd-72a19ac08a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e360ea6e5b804ee5b825d3e688c228ef', 'request_id': 'req-de4b2974-a5c0-46e9-bbbd-72a19ac08a40'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:14.377085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:14.378239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-de4b2974-a5c0-46e9-bbbd-72a19ac08a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e360ea6e5b804ee5b825d3e688c228ef', 'request_id': 'req-de4b2974-a5c0-46e9-bbbd-72a19ac08a40'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:14.406692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-de4b2974-a5c0-46e9-bbbd-72a19ac08a40 admin admin] The token cache is being invalidate because project e360ea6e5b804ee5b825d3e688c228ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:14.407152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-de4b2974-a5c0-46e9-bbbd-72a19ac08a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:14.408126 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-de4b2974-a5c0-46e9-bbbd-72a19ac08a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:14.412775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 833/1663] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:13 2022] DELETE /identity/v3/projects/e360ea6e5b804ee5b825d3e688c228ef => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:14.416484 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b2974-a5c0-46e9-bbbd-72a19ac08a40 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:14.421396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-de4b2974-a5c0-46e9-bbbd-72a19ac08a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:14.439144 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:14.557479 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b2974-a5c0-46e9-bbbd-72a19ac08a40 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:14.567364 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 831/1664] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:14.568460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443afd0-e3f4-4dee-87c4-73addb190e23 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:14.570327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525c93e-2d69-4409-806b-b5c510b66f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:14.571145 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525c93e-2d69-4409-806b-b5c510b66f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:14.572129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525c93e-2d69-4409-806b-b5c510b66f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:14.572129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525c93e-2d69-4409-806b-b5c510b66f28 admin admin] PATH_INFO: `/v3/users/65a387846fb54fe6aad20a3d0d70ec88` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:14.573754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525c93e-2d69-4409-806b-b5c510b66f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a387846fb54fe6aad20a3d0d70ec88)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:14.575606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525c93e-2d69-4409-806b-b5c510b66f28 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:14.586636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443afd0-e3f4-4dee-87c4-73addb190e23 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:14.601596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499baf19-dbf7-4e33-b16d-160fc5ca416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:14.602220 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499baf19-dbf7-4e33-b16d-160fc5ca416a admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:14.602550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499baf19-dbf7-4e33-b16d-160fc5ca416a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:14.602969 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499baf19-dbf7-4e33-b16d-160fc5ca416a admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:14.603668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499baf19-dbf7-4e33-b16d-160fc5ca416a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:14.603936 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499baf19-dbf7-4e33-b16d-160fc5ca416a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:14.605798 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499baf19-dbf7-4e33-b16d-160fc5ca416a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:14.619643 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 832/1665] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:14.633737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499baf19-dbf7-4e33-b16d-160fc5ca416a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:14.663306 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499baf19-dbf7-4e33-b16d-160fc5ca416a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:14.679071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f821859-65a8-4cfb-90f2-18d02034de92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:14.679981 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f821859-65a8-4cfb-90f2-18d02034de92 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:14.680402 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f821859-65a8-4cfb-90f2-18d02034de92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:14.680823 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f821859-65a8-4cfb-90f2-18d02034de92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:14.681868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f821859-65a8-4cfb-90f2-18d02034de92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:14.694186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f821859-65a8-4cfb-90f2-18d02034de92 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:14.708389 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9525c93e-2d69-4409-806b-b5c510b66f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a387846fb54fe6aad20a3d0d70ec88'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:14.723060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9525c93e-2d69-4409-806b-b5c510b66f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a387846fb54fe6aad20a3d0d70ec88'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:14.724009 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9525c93e-2d69-4409-806b-b5c510b66f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a387846fb54fe6aad20a3d0d70ec88'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:14.760501 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9525c93e-2d69-4409-806b-b5c510b66f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a387846fb54fe6aad20a3d0d70ec88'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:14.775717 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9525c93e-2d69-4409-806b-b5c510b66f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a387846fb54fe6aad20a3d0d70ec88'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:14.780225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 833/1666] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:14 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:14.782091 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f821859-65a8-4cfb-90f2-18d02034de92 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:14.782811 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 834/1667] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:14 2022] DELETE /identity/v3/users/65a387846fb54fe6aad20a3d0d70ec88 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:20:14.788630 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5f821859-65a8-4cfb-90f2-18d02034de92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:14.897112 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebefab3-b011-4618-87db-eec839ce321c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:14.897744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebefab3-b011-4618-87db-eec839ce321c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:14.898751 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebefab3-b011-4618-87db-eec839ce321c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:14.964373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f821859-65a8-4cfb-90f2-18d02034de92 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:14.968581 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8ebefab3-b011-4618-87db-eec839ce321c None None] MFA Rules not processed for user `8e03bcebeee44978afe2ce5040ddf122`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:14.970105 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8ebefab3-b011-4618-87db-eec839ce321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:15.116645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a5839-703d-4c2d-88cc-c7985dc917b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:15.119494 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a5839-703d-4c2d-88cc-c7985dc917b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:15.119963 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a5839-703d-4c2d-88cc-c7985dc917b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:15.121522 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a5839-703d-4c2d-88cc-c7985dc917b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:15.122338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a5839-703d-4c2d-88cc-c7985dc917b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:15.131359 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a5839-703d-4c2d-88cc-c7985dc917b1 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:15.188725 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 834/1668] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:14 2022] POST /identity/v3/users => generated 291 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:15.192289 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a5839-703d-4c2d-88cc-c7985dc917b1 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:15.198615 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 835/1669] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:15.204350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebefab3-b011-4618-87db-eec839ce321c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:15.207956 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8ebefab3-b011-4618-87db-eec839ce321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:15.233664 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a5839-703d-4c2d-88cc-c7985dc917b1 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:15.250564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8f92a-46ad-4170-9665-b92af2d5148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:15.251409 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8f92a-46ad-4170-9665-b92af2d5148f admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:15.251846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8f92a-46ad-4170-9665-b92af2d5148f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:15.252125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8f92a-46ad-4170-9665-b92af2d5148f admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:15.252793 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8f92a-46ad-4170-9665-b92af2d5148f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:15.256392 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8f92a-46ad-4170-9665-b92af2d5148f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:15.279620 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:15.299479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 835/1670] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:15.302992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8f92a-46ad-4170-9665-b92af2d5148f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:15.348340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8f92a-46ad-4170-9665-b92af2d5148f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:15.369443 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcb9a6-a692-425f-ba68-5174aa3a751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:15.373005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcb9a6-a692-425f-ba68-5174aa3a751e admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:15.374415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcb9a6-a692-425f-ba68-5174aa3a751e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:15.375052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcb9a6-a692-425f-ba68-5174aa3a751e admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:15.375773 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcb9a6-a692-425f-ba68-5174aa3a751e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:15.381816 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcb9a6-a692-425f-ba68-5174aa3a751e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:15.409123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:15.433565 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 836/1671] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:15.434478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcb9a6-a692-425f-ba68-5174aa3a751e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:15.452967 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcb9a6-a692-425f-ba68-5174aa3a751e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:15.467530 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd19a0-7cbd-427f-917f-93600a38d300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:15.473059 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd19a0-7cbd-427f-917f-93600a38d300 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:15.473912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd19a0-7cbd-427f-917f-93600a38d300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:15.474231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd19a0-7cbd-427f-917f-93600a38d300 admin admin] PATH_INFO: `/v3/projects/1cbca7df4ef04fdaaa5a3dd2dc125ba1/users/ef447a5708d64c01a883ff931d3c948c/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:15.488459 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebefab3-b011-4618-87db-eec839ce321c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:15.497775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8f69d-5829-4424-9cc8-6216be812495 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:15.498420 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f69d-5829-4424-9cc8-6216be812495 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:15.498856 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f69d-5829-4424-9cc8-6216be812495 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:15.499469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f69d-5829-4424-9cc8-6216be812495 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:15.527150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8f69d-5829-4424-9cc8-6216be812495 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:15.527150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8f69d-5829-4424-9cc8-6216be812495 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:15.529877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd19a0-7cbd-427f-917f-93600a38d300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cbca7df4ef04fdaaa5a3dd2dc125ba1, user_id=ef447a5708d64c01a883ff931d3c948c, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:15.535692 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd19a0-7cbd-427f-917f-93600a38d300 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:15.549503 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 836/1672] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:15.569937 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 837/1673] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:15 2022] PUT /identity/v3/projects/1cbca7df4ef04fdaaa5a3dd2dc125ba1/users/ef447a5708d64c01a883ff931d3c948c/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:15.580426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540715f3-a3de-474c-ba27-9a28339bf794 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:15.581130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540715f3-a3de-474c-ba27-9a28339bf794 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:15.582284 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540715f3-a3de-474c-ba27-9a28339bf794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:15.664179 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-540715f3-a3de-474c-ba27-9a28339bf794 None None] MFA Rules not processed for user `ef447a5708d64c01a883ff931d3c948c`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:15.665746 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-540715f3-a3de-474c-ba27-9a28339bf794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:15.840729 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 837/1674] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:15.845063 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd19a0-7cbd-427f-917f-93600a38d300 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:16.036026 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd19a0-7cbd-427f-917f-93600a38d300 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:16.041667 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6b985-7a88-4bd6-96b3-1b21d7f19049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:16.042856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6b985-7a88-4bd6-96b3-1b21d7f19049 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:16.043397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6b985-7a88-4bd6-96b3-1b21d7f19049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:16.043842 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6b985-7a88-4bd6-96b3-1b21d7f19049 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:16.044970 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6b985-7a88-4bd6-96b3-1b21d7f19049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:16.048167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6b985-7a88-4bd6-96b3-1b21d7f19049 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:16.102946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 838/1675] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:15 2022] POST /identity/v3/projects => generated 381 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:16.106604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540715f3-a3de-474c-ba27-9a28339bf794 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:16.122304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540715f3-a3de-474c-ba27-9a28339bf794 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:16.223613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec84e9-7d7a-4b4c-a65c-db8ee779a901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:16.224806 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec84e9-7d7a-4b4c-a65c-db8ee779a901 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:16.225494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec84e9-7d7a-4b4c-a65c-db8ee779a901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:16.226029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec84e9-7d7a-4b4c-a65c-db8ee779a901 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:16.226934 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec84e9-7d7a-4b4c-a65c-db8ee779a901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:16.230300 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec84e9-7d7a-4b4c-a65c-db8ee779a901 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:16.272667 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 838/1676] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:16 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:20:16.275455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6b985-7a88-4bd6-96b3-1b21d7f19049 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:16.326902 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6b985-7a88-4bd6-96b3-1b21d7f19049 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:16.339053 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39383d59-2425-4252-8868-e8fa54ac9a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:16.340445 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39383d59-2425-4252-8868-e8fa54ac9a3c admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:16.341044 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39383d59-2425-4252-8868-e8fa54ac9a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:16.341573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39383d59-2425-4252-8868-e8fa54ac9a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:16.342596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39383d59-2425-4252-8868-e8fa54ac9a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:16.344675 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39383d59-2425-4252-8868-e8fa54ac9a3c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:16.370839 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 839/1677] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:20:16.374480 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec84e9-7d7a-4b4c-a65c-db8ee779a901 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:16.401069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec84e9-7d7a-4b4c-a65c-db8ee779a901 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:16.414800 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4755e-b633-4d84-aa69-8aec5923cc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:16.415860 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4755e-b633-4d84-aa69-8aec5923cc10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:16.416350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4755e-b633-4d84-aa69-8aec5923cc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:16.416876 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4755e-b633-4d84-aa69-8aec5923cc10 admin admin] PATH_INFO: `/v3/projects/0bbc908715c2464f87775bffb4ea5ae1/users/360946ca107a40f0bd83df38a32fa7f3/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:16.456915 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4755e-b633-4d84-aa69-8aec5923cc10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bbc908715c2464f87775bffb4ea5ae1, user_id=360946ca107a40f0bd83df38a32fa7f3, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:16.466218 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4755e-b633-4d84-aa69-8aec5923cc10 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:16.475363 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:16.499020 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 839/1678] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:16 2022] PUT /identity/v3/projects/0bbc908715c2464f87775bffb4ea5ae1/users/360946ca107a40f0bd83df38a32fa7f3/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:20:16.504915 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39383d59-2425-4252-8868-e8fa54ac9a3c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:16.520319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39383d59-2425-4252-8868-e8fa54ac9a3c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:16.671803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190749a7-c6d2-48b6-94f6-3de92b0dce9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:16.673439 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190749a7-c6d2-48b6-94f6-3de92b0dce9c admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:16.675464 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190749a7-c6d2-48b6-94f6-3de92b0dce9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:16.677569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190749a7-c6d2-48b6-94f6-3de92b0dce9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:16.678477 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190749a7-c6d2-48b6-94f6-3de92b0dce9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:16.682848 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190749a7-c6d2-48b6-94f6-3de92b0dce9c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:16.716415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 840/1679] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:16.719375 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4755e-b633-4d84-aa69-8aec5923cc10 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:16.727145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190749a7-c6d2-48b6-94f6-3de92b0dce9c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:16.729334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-190749a7-c6d2-48b6-94f6-3de92b0dce9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:16.740132 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4755e-b633-4d84-aa69-8aec5923cc10 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:16.762865 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190749a7-c6d2-48b6-94f6-3de92b0dce9c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:16.763981 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef716f0a-a037-4498-89b6-9b7036b25a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:16.764676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef716f0a-a037-4498-89b6-9b7036b25a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:16.764957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef716f0a-a037-4498-89b6-9b7036b25a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:16.767353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef716f0a-a037-4498-89b6-9b7036b25a4a admin admin] PATH_INFO: `/v3/projects/0bbc908715c2464f87775bffb4ea5ae1/users/360946ca107a40f0bd83df38a32fa7f3/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:16.772868 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef716f0a-a037-4498-89b6-9b7036b25a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bbc908715c2464f87775bffb4ea5ae1, user_id=360946ca107a40f0bd83df38a32fa7f3, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:16.777271 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c8aba-62a8-43bc-a149-5234983dbd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:16.779492 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c8aba-62a8-43bc-a149-5234983dbd56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:16.779778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef716f0a-a037-4498-89b6-9b7036b25a4a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:16.780797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c8aba-62a8-43bc-a149-5234983dbd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:16.781787 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c8aba-62a8-43bc-a149-5234983dbd56 admin admin] PATH_INFO: `/v3/projects/5e47f9680cc14df2a6098341dd567732` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:16.784381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c8aba-62a8-43bc-a149-5234983dbd56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e47f9680cc14df2a6098341dd567732)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:16.790473 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c8aba-62a8-43bc-a149-5234983dbd56 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:16.840590 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 840/1680] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:16 2022] PUT /identity/v3/projects/0bbc908715c2464f87775bffb4ea5ae1/users/360946ca107a40f0bd83df38a32fa7f3/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:16.851598 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc7953-44e3-4459-8884-c3a0196709c1 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:16.852571 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc7953-44e3-4459-8884-c3a0196709c1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:16.852893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc7953-44e3-4459-8884-c3a0196709c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:16.897485 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:16.923345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a51c8aba-62a8-43bc-a149-5234983dbd56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e47f9680cc14df2a6098341dd567732', 'request_id': 'req-a51c8aba-62a8-43bc-a149-5234983dbd56'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:16.936058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1cbc7953-44e3-4459-8884-c3a0196709c1 None None] MFA Rules not processed for user `360946ca107a40f0bd83df38a32fa7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:16.939406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1cbc7953-44e3-4459-8884-c3a0196709c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:16.941257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a51c8aba-62a8-43bc-a149-5234983dbd56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e47f9680cc14df2a6098341dd567732', 'request_id': 'req-a51c8aba-62a8-43bc-a149-5234983dbd56'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:16.963535 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a51c8aba-62a8-43bc-a149-5234983dbd56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e47f9680cc14df2a6098341dd567732', 'request_id': 'req-a51c8aba-62a8-43bc-a149-5234983dbd56'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:16.982760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a51c8aba-62a8-43bc-a149-5234983dbd56 admin admin] The token cache is being invalidate because project 5e47f9680cc14df2a6098341dd567732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:16.984632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a51c8aba-62a8-43bc-a149-5234983dbd56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:16.985468 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a51c8aba-62a8-43bc-a149-5234983dbd56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:16.988757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 841/1681] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:16 2022] DELETE /identity/v3/projects/5e47f9680cc14df2a6098341dd567732 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:16.998205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe89d4b-0f8f-4fcb-b06c-f326a688b3e2 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:16.998704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe89d4b-0f8f-4fcb-b06c-f326a688b3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:17.000929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe89d4b-0f8f-4fcb-b06c-f326a688b3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:17.051579 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-4fe89d4b-0f8f-4fcb-b06c-f326a688b3e2 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:17.052992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4fe89d4b-0f8f-4fcb-b06c-f326a688b3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:17.194293 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 841/1682] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:17.206785 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc7953-44e3-4459-8884-c3a0196709c1 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:17.208442 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1cbc7953-44e3-4459-8884-c3a0196709c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:17.223257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 842/1683] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:17.225847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacafb5-ec32-4839-a455-46025886a8c7 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:17.226180 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacafb5-ec32-4839-a455-46025886a8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:17.228304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacafb5-ec32-4839-a455-46025886a8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:17.276109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-6aacafb5-ec32-4839-a455-46025886a8c7 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:17.278825 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6aacafb5-ec32-4839-a455-46025886a8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:17.301133 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 843/1684] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:17.317485 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacafb5-ec32-4839-a455-46025886a8c7 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:17.330410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacafb5-ec32-4839-a455-46025886a8c7 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:17.349288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bd6a8-7241-4d63-b297-cdeb4091c299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:17.349948 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bd6a8-7241-4d63-b297-cdeb4091c299 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:17.350236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bd6a8-7241-4d63-b297-cdeb4091c299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:17.350511 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bd6a8-7241-4d63-b297-cdeb4091c299 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:17.351224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bd6a8-7241-4d63-b297-cdeb4091c299 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:17.351532 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bd6a8-7241-4d63-b297-cdeb4091c299 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:17.353179 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bd6a8-7241-4d63-b297-cdeb4091c299 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:17.363985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc7953-44e3-4459-8884-c3a0196709c1 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:17.372159 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5436343-83c8-492f-8e8a-5155e0e5a016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:17.375901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5436343-83c8-492f-8e8a-5155e0e5a016 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:17.375901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5436343-83c8-492f-8e8a-5155e0e5a016 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:17.376570 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5436343-83c8-492f-8e8a-5155e0e5a016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:17.389456 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 844/1685] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:17.391454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bd6a8-7241-4d63-b297-cdeb4091c299 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:17.410815 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5436343-83c8-492f-8e8a-5155e0e5a016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:17.416497 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5436343-83c8-492f-8e8a-5155e0e5a016 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:17.423740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bd6a8-7241-4d63-b297-cdeb4091c299 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:17.435863 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7694ff-19ba-407b-b933-784acc89cefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:17.436432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7694ff-19ba-407b-b933-784acc89cefc admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:17.436771 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7694ff-19ba-407b-b933-784acc89cefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:17.437990 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7694ff-19ba-407b-b933-784acc89cefc admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:17.438338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7694ff-19ba-407b-b933-784acc89cefc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:17.441601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 842/1686] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:17.443829 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7694ff-19ba-407b-b933-784acc89cefc admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:17.517005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 845/1687] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:17 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:17.517714 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5436343-83c8-492f-8e8a-5155e0e5a016 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:17.533769 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5436343-83c8-492f-8e8a-5155e0e5a016 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:17.685184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d2e18-72a0-4686-a85f-8a12ab85aabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:17.685611 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d2e18-72a0-4686-a85f-8a12ab85aabb admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:17.685940 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d2e18-72a0-4686-a85f-8a12ab85aabb admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:17.686223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d2e18-72a0-4686-a85f-8a12ab85aabb admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:17.686924 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d2e18-72a0-4686-a85f-8a12ab85aabb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:17.688964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d2e18-72a0-4686-a85f-8a12ab85aabb admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:17.723103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:17.737492 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 843/1688] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:17 2022] POST /identity/v3/users => generated 285 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:20:17.741101 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7694ff-19ba-407b-b933-784acc89cefc admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:17.765279 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7694ff-19ba-407b-b933-784acc89cefc admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:17.774353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38f0d7-7f74-42b7-83b1-6e99739c2dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:17.775109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38f0d7-7f74-42b7-83b1-6e99739c2dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:17.775448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38f0d7-7f74-42b7-83b1-6e99739c2dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:17.775697 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38f0d7-7f74-42b7-83b1-6e99739c2dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:17.778684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38f0d7-7f74-42b7-83b1-6e99739c2dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:17.780488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38f0d7-7f74-42b7-83b1-6e99739c2dc2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:17.805120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d2e18-72a0-4686-a85f-8a12ab85aabb admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:17.816668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 846/1689] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:17.818650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d2e18-72a0-4686-a85f-8a12ab85aabb admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:17.824911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f33d7-5986-4efa-936c-6e6e6f5770b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:17.827340 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f33d7-5986-4efa-936c-6e6e6f5770b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:17.827865 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f33d7-5986-4efa-936c-6e6e6f5770b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:17.828227 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f33d7-5986-4efa-936c-6e6e6f5770b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:17.828915 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f33d7-5986-4efa-936c-6e6e6f5770b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:17.830685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f33d7-5986-4efa-936c-6e6e6f5770b1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:17.868893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 844/1690] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:20:17.872936 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38f0d7-7f74-42b7-83b1-6e99739c2dc2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:17.895971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38f0d7-7f74-42b7-83b1-6e99739c2dc2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:17.903927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525ab16-ac37-4fb7-9376-a9e522392b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:17.906780 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525ab16-ac37-4fb7-9376-a9e522392b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:17.908633 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525ab16-ac37-4fb7-9376-a9e522392b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:17.908842 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525ab16-ac37-4fb7-9376-a9e522392b91 admin admin] PATH_INFO: `/v3/projects/567ca46f965a47a69dbc5fc40e4627a1/users/074b86ef250c4249bf81079bba774f84/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:17.960568 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525ab16-ac37-4fb7-9376-a9e522392b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=567ca46f965a47a69dbc5fc40e4627a1, user_id=074b86ef250c4249bf81079bba774f84, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:17.964939 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525ab16-ac37-4fb7-9376-a9e522392b91 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:18.028195 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 847/1691] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:17 2022] PUT /identity/v3/projects/567ca46f965a47a69dbc5fc40e4627a1/users/074b86ef250c4249bf81079bba774f84/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:18.029544 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7333791-8aa9-4832-b937-af81d90fbe9d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:18.030112 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7333791-8aa9-4832-b937-af81d90fbe9d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:18.030822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7333791-8aa9-4832-b937-af81d90fbe9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:18.107390 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f7333791-8aa9-4832-b937-af81d90fbe9d None None] MFA Rules not processed for user `074b86ef250c4249bf81079bba774f84`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:18.108741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f7333791-8aa9-4832-b937-af81d90fbe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:18.282785 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 845/1692] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:18.284873 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859508de-a012-4433-bc1f-26934dc29d77 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:18.285532 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859508de-a012-4433-bc1f-26934dc29d77 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:18.285984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859508de-a012-4433-bc1f-26934dc29d77 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:18.288208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 848/1693] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 27 04:20:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:20:18.289405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7333791-8aa9-4832-b937-af81d90fbe9d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:18.303879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859508de-a012-4433-bc1f-26934dc29d77 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:18.456737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:18.535981 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859508de-a012-4433-bc1f-26934dc29d77 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:18.542637 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7333791-8aa9-4832-b937-af81d90fbe9d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:18.554152 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c9a7c-3fde-4120-959c-82680bd83fa3 tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360946ca107a40f0bd83df38a32fa7f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bbc908715c2464f87775bffb4ea5ae1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:18.555232 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c9a7c-3fde-4120-959c-82680bd83fa3 tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:18.555526 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c9a7c-3fde-4120-959c-82680bd83fa3 tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:18.555821 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c9a7c-3fde-4120-959c-82680bd83fa3 tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:18.559392 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c9a7c-3fde-4120-959c-82680bd83fa3 tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:18.559694 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c9a7c-3fde-4120-959c-82680bd83fa3 tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:18.562198 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67efec9-257e-4706-abf1-d36306c15b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:18.563275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67efec9-257e-4706-abf1-d36306c15b16 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:18.564487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67efec9-257e-4706-abf1-d36306c15b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:18.564593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c9a7c-3fde-4120-959c-82680bd83fa3 tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:18.566404 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67efec9-257e-4706-abf1-d36306c15b16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:18.567691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67efec9-257e-4706-abf1-d36306c15b16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:18.574376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67efec9-257e-4706-abf1-d36306c15b16 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:18.634919 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 849/1694] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:18.641454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7428be-528c-4851-abc2-e8a647da13e6 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:18.641750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7428be-528c-4851-abc2-e8a647da13e6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:18.642047 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7428be-528c-4851-abc2-e8a647da13e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:18.677608 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 846/1695] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:18 2022] POST /identity/v3/projects => generated 369 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:18.681372 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67efec9-257e-4706-abf1-d36306c15b16 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:18.713481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1c7428be-528c-4851-abc2-e8a647da13e6 None None] MFA Rules not processed for user `efd209a50a994b7c8485f2996697218b`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:18.714919 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1c7428be-528c-4851-abc2-e8a647da13e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:18.837921 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67efec9-257e-4706-abf1-d36306c15b16 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:18.855177 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d6169-1104-42a6-8261-4f7a225d40ec tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360946ca107a40f0bd83df38a32fa7f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bbc908715c2464f87775bffb4ea5ae1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:18.857905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d6169-1104-42a6-8261-4f7a225d40ec tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:18.858260 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d6169-1104-42a6-8261-4f7a225d40ec tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:18.858550 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d6169-1104-42a6-8261-4f7a225d40ec tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:18.861538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d6169-1104-42a6-8261-4f7a225d40ec tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:18.866121 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d6169-1104-42a6-8261-4f7a225d40ec tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:18.883658 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 850/1696] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 27 04:20:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:18.884557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7428be-528c-4851-abc2-e8a647da13e6 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:18.889854 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:18.935785 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 847/1697] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:18 2022] POST /identity/v3/projects => generated 355 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:18.935785 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d6169-1104-42a6-8261-4f7a225d40ec tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:18.938358 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fa0d6169-1104-42a6-8261-4f7a225d40ec tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:19.025265 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7428be-528c-4851-abc2-e8a647da13e6 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:19.107864 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee0e3d-57cb-4bed-a939-a2d36c82ea86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:19.108669 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee0e3d-57cb-4bed-a939-a2d36c82ea86 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:19.109054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee0e3d-57cb-4bed-a939-a2d36c82ea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:19.109440 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee0e3d-57cb-4bed-a939-a2d36c82ea86 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:19.110210 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee0e3d-57cb-4bed-a939-a2d36c82ea86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:19.113045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee0e3d-57cb-4bed-a939-a2d36c82ea86 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:19.121715 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d6169-1104-42a6-8261-4f7a225d40ec tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:19.138629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48376f6c-aa2e-44aa-abb8-180ff18068a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efd209a50a994b7c8485f2996697218b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:19.140856 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48376f6c-aa2e-44aa-abb8-180ff18068a5 service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:19.141919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48376f6c-aa2e-44aa-abb8-180ff18068a5 service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:19.144042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48376f6c-aa2e-44aa-abb8-180ff18068a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:19.146566 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 851/1698] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:18 2022] POST /identity/v3/users => generated 291 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:19.147646 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee0e3d-57cb-4bed-a939-a2d36c82ea86 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:19.171171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48376f6c-aa2e-44aa-abb8-180ff18068a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:19.176160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48376f6c-aa2e-44aa-abb8-180ff18068a5 service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:19.185316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:19.199372 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 848/1699] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:19.217916 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebefea3-3de1-45be-a6dc-e8b1c24adbcc None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:19.219877 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebefea3-3de1-45be-a6dc-e8b1c24adbcc None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:19.222960 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebefea3-3de1-45be-a6dc-e8b1c24adbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:19.303873 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-3ebefea3-3de1-45be-a6dc-e8b1c24adbcc None None] MFA Rules not processed for user `84c92ec374504550aa3c2bbc8bf3eb8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:19.306998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3ebefea3-3de1-45be-a6dc-e8b1c24adbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:19.312546 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee0e3d-57cb-4bed-a939-a2d36c82ea86 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:19.329018 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cfac1-363b-411c-8cc9-f21d0c93601c tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360946ca107a40f0bd83df38a32fa7f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bbc908715c2464f87775bffb4ea5ae1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:19.329929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cfac1-363b-411c-8cc9-f21d0c93601c tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:19.330431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cfac1-363b-411c-8cc9-f21d0c93601c tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:19.331540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cfac1-363b-411c-8cc9-f21d0c93601c tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:19.333511 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2cfac1-363b-411c-8cc9-f21d0c93601c tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:19.334920 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2cfac1-363b-411c-8cc9-f21d0c93601c tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:19.338810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2cfac1-363b-411c-8cc9-f21d0c93601c tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:19.375490 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 852/1700] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:19.377347 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cfac1-363b-411c-8cc9-f21d0c93601c tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:19.391354 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cfac1-363b-411c-8cc9-f21d0c93601c tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:19.409881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9290745-f2f8-4305-8dad-e551baccbf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:19.410913 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9290745-f2f8-4305-8dad-e551baccbf5c admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:19.411688 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9290745-f2f8-4305-8dad-e551baccbf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:19.412264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9290745-f2f8-4305-8dad-e551baccbf5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:19.413712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9290745-f2f8-4305-8dad-e551baccbf5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:19.417407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9290745-f2f8-4305-8dad-e551baccbf5c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:19.432055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 853/1701] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:19.436288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9290745-f2f8-4305-8dad-e551baccbf5c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:19.461592 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9290745-f2f8-4305-8dad-e551baccbf5c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:19.469235 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf373207-72f9-4edb-b25a-21e2af8e730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:19.469919 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf373207-72f9-4edb-b25a-21e2af8e730e admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:19.470310 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf373207-72f9-4edb-b25a-21e2af8e730e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:19.470597 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf373207-72f9-4edb-b25a-21e2af8e730e admin admin] PATH_INFO: `/v3/projects/b372c8724d6f458c8a5ffd8d12eaaff3/users/9adbd11a9c6e498d9737f64eda239741/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:19.485273 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 849/1702] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:19.486331 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebefea3-3de1-45be-a6dc-e8b1c24adbcc None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:19.518046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf373207-72f9-4edb-b25a-21e2af8e730e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b372c8724d6f458c8a5ffd8d12eaaff3, user_id=9adbd11a9c6e498d9737f64eda239741, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:19.520388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebefea3-3de1-45be-a6dc-e8b1c24adbcc None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:19.520945 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf373207-72f9-4edb-b25a-21e2af8e730e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:19.533519 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65285547-b99f-41f3-80bc-50b64b6f388d tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360946ca107a40f0bd83df38a32fa7f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bbc908715c2464f87775bffb4ea5ae1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:19.540054 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65285547-b99f-41f3-80bc-50b64b6f388d tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:19.540598 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65285547-b99f-41f3-80bc-50b64b6f388d tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:19.541581 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65285547-b99f-41f3-80bc-50b64b6f388d tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] PATH_INFO: `/v3/projects/1142998544b74402b3f626f245e65d5d` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:19.543857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65285547-b99f-41f3-80bc-50b64b6f388d tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1142998544b74402b3f626f245e65d5d)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:19.553219 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 854/1703] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:19 2022] PUT /identity/v3/projects/b372c8724d6f458c8a5ffd8d12eaaff3/users/9adbd11a9c6e498d9737f64eda239741/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:19.555095 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65285547-b99f-41f3-80bc-50b64b6f388d tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:19.559698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f02bd7-6c46-45a2-825b-9f41c1a1e9df None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:19.560045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f02bd7-6c46-45a2-825b-9f41c1a1e9df None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:19.560330 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f02bd7-6c46-45a2-825b-9f41c1a1e9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:19.607225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-66f02bd7-6c46-45a2-825b-9f41c1a1e9df None None] MFA Rules not processed for user `84c92ec374504550aa3c2bbc8bf3eb8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:19.611675 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-66f02bd7-6c46-45a2-825b-9f41c1a1e9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:19.657827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-65285547-b99f-41f3-80bc-50b64b6f388d tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1142998544b74402b3f626f245e65d5d', 'request_id': 'req-65285547-b99f-41f3-80bc-50b64b6f388d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:19.665207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-65285547-b99f-41f3-80bc-50b64b6f388d tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1142998544b74402b3f626f245e65d5d', 'request_id': 'req-65285547-b99f-41f3-80bc-50b64b6f388d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:19.673385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-65285547-b99f-41f3-80bc-50b64b6f388d tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1142998544b74402b3f626f245e65d5d', 'request_id': 'req-65285547-b99f-41f3-80bc-50b64b6f388d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:19.679372 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:19.714219 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-65285547-b99f-41f3-80bc-50b64b6f388d tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] The token cache is being invalidate because project 1142998544b74402b3f626f245e65d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:19.715510 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-65285547-b99f-41f3-80bc-50b64b6f388d tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:19.721106 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-65285547-b99f-41f3-80bc-50b64b6f388d tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:19.730351 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 850/1704] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:19 2022] DELETE /identity/v3/projects/1142998544b74402b3f626f245e65d5d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:19.731839 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65285547-b99f-41f3-80bc-50b64b6f388d tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:19.735408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-65285547-b99f-41f3-80bc-50b64b6f388d tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:19.803721 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 855/1705] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:19.818336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a6601-1226-4a0c-86e1-7331c6a481ee None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:19.819050 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a6601-1226-4a0c-86e1-7331c6a481ee None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:19.819339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a6601-1226-4a0c-86e1-7331c6a481ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:19.867352 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65285547-b99f-41f3-80bc-50b64b6f388d tempest-VolumeQuotaClassesTest-2090909688 tempest-VolumeQuotaClassesTest-2090909688-project-admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:19.889468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee402247-f70f-45fe-882c-5d91a42cb10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:19.894091 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee402247-f70f-45fe-882c-5d91a42cb10a admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:19.894737 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee402247-f70f-45fe-882c-5d91a42cb10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:19.895077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee402247-f70f-45fe-882c-5d91a42cb10a admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:19.896202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee402247-f70f-45fe-882c-5d91a42cb10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:19.899434 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee402247-f70f-45fe-882c-5d91a42cb10a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:19.921831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 851/1706] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:19.925820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee402247-f70f-45fe-882c-5d91a42cb10a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:19.928346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ee402247-f70f-45fe-882c-5d91a42cb10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:19.948560 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e73a6601-1226-4a0c-86e1-7331c6a481ee None None] MFA Rules not processed for user `5335de6ca87344628a553923c5fca11a`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:19.949283 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee402247-f70f-45fe-882c-5d91a42cb10a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:19.949860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e73a6601-1226-4a0c-86e1-7331c6a481ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:19.961291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d39370-73ff-47a5-a57b-e0018bd76abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:19.962542 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d39370-73ff-47a5-a57b-e0018bd76abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:19.962912 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d39370-73ff-47a5-a57b-e0018bd76abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:19.963196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d39370-73ff-47a5-a57b-e0018bd76abc admin admin] PATH_INFO: `/v3/users/c064d1991b254b03b36b309fd4c2e421` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:19.964364 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d39370-73ff-47a5-a57b-e0018bd76abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c064d1991b254b03b36b309fd4c2e421)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:19.966894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d39370-73ff-47a5-a57b-e0018bd76abc admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:20.079184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-59d39370-73ff-47a5-a57b-e0018bd76abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c064d1991b254b03b36b309fd4c2e421'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:20.104973 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-59d39370-73ff-47a5-a57b-e0018bd76abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c064d1991b254b03b36b309fd4c2e421'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:20.110232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-59d39370-73ff-47a5-a57b-e0018bd76abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c064d1991b254b03b36b309fd4c2e421'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:20.151733 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 856/1707] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:20.152958 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a6601-1226-4a0c-86e1-7331c6a481ee None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:20.162779 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e73a6601-1226-4a0c-86e1-7331c6a481ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:20.162987 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-59d39370-73ff-47a5-a57b-e0018bd76abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c064d1991b254b03b36b309fd4c2e421'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:20.178711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-59d39370-73ff-47a5-a57b-e0018bd76abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c064d1991b254b03b36b309fd4c2e421'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:20.186742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:20.194679 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 852/1708] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:19 2022] DELETE /identity/v3/users/c064d1991b254b03b36b309fd4c2e421 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:20.195579 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d39370-73ff-47a5-a57b-e0018bd76abc admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:20.196931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-59d39370-73ff-47a5-a57b-e0018bd76abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:20.323077 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a6601-1226-4a0c-86e1-7331c6a481ee None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:20.357781 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d39370-73ff-47a5-a57b-e0018bd76abc admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:20.373751 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b444e8-4903-49d6-91b4-a95eced0d6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:20.375284 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b444e8-4903-49d6-91b4-a95eced0d6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:20.375573 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b444e8-4903-49d6-91b4-a95eced0d6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:20.375848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b444e8-4903-49d6-91b4-a95eced0d6dc admin admin] PATH_INFO: `/v3/projects/b372c8724d6f458c8a5ffd8d12eaaff3/users/9adbd11a9c6e498d9737f64eda239741/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:20.381447 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b444e8-4903-49d6-91b4-a95eced0d6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b372c8724d6f458c8a5ffd8d12eaaff3, user_id=9adbd11a9c6e498d9737f64eda239741, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:20.384759 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b444e8-4903-49d6-91b4-a95eced0d6dc admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:20.410210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:20.428352 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 853/1709] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:20 2022] PUT /identity/v3/projects/b372c8724d6f458c8a5ffd8d12eaaff3/users/9adbd11a9c6e498d9737f64eda239741/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:20.432319 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7f00a-e98f-45d1-b8be-436b6760f251 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:20.432682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7f00a-e98f-45d1-b8be-436b6760f251 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:20.433076 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7f00a-e98f-45d1-b8be-436b6760f251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:20.473159 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-90b7f00a-e98f-45d1-b8be-436b6760f251 None None] MFA Rules not processed for user `5335de6ca87344628a553923c5fca11a`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:20.474322 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-90b7f00a-e98f-45d1-b8be-436b6760f251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:20.478277 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00433fae-a81d-41ab-ab19-2530b5b589f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:20.478938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00433fae-a81d-41ab-ab19-2530b5b589f9 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:20.479222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00433fae-a81d-41ab-ab19-2530b5b589f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:20.479497 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00433fae-a81d-41ab-ab19-2530b5b589f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:20.484563 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-00433fae-a81d-41ab-ab19-2530b5b589f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:20.641256 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00433fae-a81d-41ab-ab19-2530b5b589f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:20.642479 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 854/1710] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:20.643042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00433fae-a81d-41ab-ab19-2530b5b589f9 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:20.649704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bbdb4-cd0c-464e-99b0-9abcda113bb7 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:20.650069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bbdb4-cd0c-464e-99b0-9abcda113bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:20.650427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bbdb4-cd0c-464e-99b0-9abcda113bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:20.676211 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 857/1711] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:20.676689 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00433fae-a81d-41ab-ab19-2530b5b589f9 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:20.682483 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-00433fae-a81d-41ab-ab19-2530b5b589f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:20.729297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-bf2bbdb4-cd0c-464e-99b0-9abcda113bb7 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:20.731112 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-bf2bbdb4-cd0c-464e-99b0-9abcda113bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:20.734577 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00433fae-a81d-41ab-ab19-2530b5b589f9 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:20.840346 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:20.855132 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 855/1712] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:20.857162 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d357f-3690-4b19-b27f-49b63bcf4316 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:20.857458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d357f-3690-4b19-b27f-49b63bcf4316 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:20.857736 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d357f-3690-4b19-b27f-49b63bcf4316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:20.881479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea78680-726f-49c5-9915-365b512420c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:20.882142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea78680-726f-49c5-9915-365b512420c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:20.882423 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea78680-726f-49c5-9915-365b512420c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:20.882697 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea78680-726f-49c5-9915-365b512420c2 admin admin] PATH_INFO: `/v3/users/ef447a5708d64c01a883ff931d3c948c` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:20.884190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea78680-726f-49c5-9915-365b512420c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef447a5708d64c01a883ff931d3c948c)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:20.885934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea78680-726f-49c5-9915-365b512420c2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:20.943627 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-754d357f-3690-4b19-b27f-49b63bcf4316 None None] MFA Rules not processed for user `9adbd11a9c6e498d9737f64eda239741`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:20.944878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-754d357f-3690-4b19-b27f-49b63bcf4316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:20.997927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0ea78680-726f-49c5-9915-365b512420c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef447a5708d64c01a883ff931d3c948c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:21.015403 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0ea78680-726f-49c5-9915-365b512420c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef447a5708d64c01a883ff931d3c948c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:21.047434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0ea78680-726f-49c5-9915-365b512420c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef447a5708d64c01a883ff931d3c948c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:21.048829 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0ea78680-726f-49c5-9915-365b512420c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef447a5708d64c01a883ff931d3c948c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:21.067986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0ea78680-726f-49c5-9915-365b512420c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef447a5708d64c01a883ff931d3c948c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:21.078056 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 858/1713] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:20 2022] DELETE /identity/v3/users/ef447a5708d64c01a883ff931d3c948c => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:21.078552 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea78680-726f-49c5-9915-365b512420c2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:21.081961 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0ea78680-726f-49c5-9915-365b512420c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:21.125990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 856/1714] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:21.125990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d357f-3690-4b19-b27f-49b63bcf4316 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:21.125990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-754d357f-3690-4b19-b27f-49b63bcf4316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:21.172221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:21.216966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea78680-726f-49c5-9915-365b512420c2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:21.224157 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b8c3e-c2a5-4f3d-a1b0-ab26bff24ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:21.224966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b8c3e-c2a5-4f3d-a1b0-ab26bff24ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:21.225325 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b8c3e-c2a5-4f3d-a1b0-ab26bff24ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:21.225732 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b8c3e-c2a5-4f3d-a1b0-ab26bff24ee2 admin admin] PATH_INFO: `/v3/users/b33ad4ee1b314adaa20c8d4bfcec13ab` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:21.227150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b8c3e-c2a5-4f3d-a1b0-ab26bff24ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b33ad4ee1b314adaa20c8d4bfcec13ab)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:21.229674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b8c3e-c2a5-4f3d-a1b0-ab26bff24ee2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:21.258052 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d357f-3690-4b19-b27f-49b63bcf4316 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:21.310980 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b80b8c3e-c2a5-4f3d-a1b0-ab26bff24ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b33ad4ee1b314adaa20c8d4bfcec13ab'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:21.321401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b80b8c3e-c2a5-4f3d-a1b0-ab26bff24ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b33ad4ee1b314adaa20c8d4bfcec13ab'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:21.332275 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:21.349698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b80b8c3e-c2a5-4f3d-a1b0-ab26bff24ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b33ad4ee1b314adaa20c8d4bfcec13ab'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:21.351109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b80b8c3e-c2a5-4f3d-a1b0-ab26bff24ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b33ad4ee1b314adaa20c8d4bfcec13ab'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:21.366828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b80b8c3e-c2a5-4f3d-a1b0-ab26bff24ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b33ad4ee1b314adaa20c8d4bfcec13ab'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:21.375004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 859/1715] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:21 2022] DELETE /identity/v3/users/b33ad4ee1b314adaa20c8d4bfcec13ab => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:21.379125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b8c3e-c2a5-4f3d-a1b0-ab26bff24ee2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:21.381106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b80b8c3e-c2a5-4f3d-a1b0-ab26bff24ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:21.388144 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e224c2e-9fdb-44d8-9ff0-f4040edf26ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:21.389042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e224c2e-9fdb-44d8-9ff0-f4040edf26ae service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:21.391524 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e224c2e-9fdb-44d8-9ff0-f4040edf26ae service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:21.391839 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e224c2e-9fdb-44d8-9ff0-f4040edf26ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:21.398278 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8e224c2e-9fdb-44d8-9ff0-f4040edf26ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:21.516290 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e224c2e-9fdb-44d8-9ff0-f4040edf26ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:21.518390 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e224c2e-9fdb-44d8-9ff0-f4040edf26ae service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:21.521802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b8c3e-c2a5-4f3d-a1b0-ab26bff24ee2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:21.542862 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d56ac-7afc-40c5-8da1-9531ce4f219f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:21.543900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d56ac-7afc-40c5-8da1-9531ce4f219f service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:21.544292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d56ac-7afc-40c5-8da1-9531ce4f219f service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:21.544672 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d56ac-7afc-40c5-8da1-9531ce4f219f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:21.547054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-633d56ac-7afc-40c5-8da1-9531ce4f219f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:21.547758 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 857/1716] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:21.549113 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2b8d3-bd23-4abe-a5de-aa7a32200f4d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:21.553574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2b8d3-bd23-4abe-a5de-aa7a32200f4d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:21.553913 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2b8d3-bd23-4abe-a5de-aa7a32200f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:21.577970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f1e2b8d3-bd23-4abe-a5de-aa7a32200f4d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:21.579287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f1e2b8d3-bd23-4abe-a5de-aa7a32200f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:21.694626 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:21.701348 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d56ac-7afc-40c5-8da1-9531ce4f219f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:21.703801 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d56ac-7afc-40c5-8da1-9531ce4f219f service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:21.729283 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 858/1717] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:21.731016 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1948d7-bd72-47a9-b632-87d2ce0fd05d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:21.731016 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1948d7-bd72-47a9-b632-87d2ce0fd05d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:21.731217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1948d7-bd72-47a9-b632-87d2ce0fd05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:21.749762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 860/1718] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:21.750697 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d56ac-7afc-40c5-8da1-9531ce4f219f service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:21.753115 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-633d56ac-7afc-40c5-8da1-9531ce4f219f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:21.798242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8c1948d7-bd72-47a9-b632-87d2ce0fd05d None None] MFA Rules not processed for user `36c0cb5c49fc4756930a9af1244e60a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:21.799521 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8c1948d7-bd72-47a9-b632-87d2ce0fd05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:21.899578 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d56ac-7afc-40c5-8da1-9531ce4f219f service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:21.911868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cb1af-61f6-42ee-9e15-16574668fed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:21.912498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cb1af-61f6-42ee-9e15-16574668fed3 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:21.912777 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cb1af-61f6-42ee-9e15-16574668fed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:21.913051 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cb1af-61f6-42ee-9e15-16574668fed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:21.917371 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-950cb1af-61f6-42ee-9e15-16574668fed3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:21.939830 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 859/1719] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:21.940598 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba497501-c07c-4f92-9d3e-6d8d2311d09f None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:21.940883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba497501-c07c-4f92-9d3e-6d8d2311d09f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:21.941155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba497501-c07c-4f92-9d3e-6d8d2311d09f None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:21.942487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 860/1720] 10.222.0.48 () {54 vars in 912 bytes} [Tue Sep 27 04:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:20:21.943219 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba497501-c07c-4f92-9d3e-6d8d2311d09f None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:21.977214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba497501-c07c-4f92-9d3e-6d8d2311d09f None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:21.984208 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005888b-d21a-4957-87ea-b0ff59b03507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:21.984931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005888b-d21a-4957-87ea-b0ff59b03507 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:21.985277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005888b-d21a-4957-87ea-b0ff59b03507 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:21.985625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005888b-d21a-4957-87ea-b0ff59b03507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:22.008455 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005888b-d21a-4957-87ea-b0ff59b03507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:22.011027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005888b-d21a-4957-87ea-b0ff59b03507 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:22.023783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:22.030051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 861/1721] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:22.032447 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3c8be-4822-46b9-9555-1ed4f32c2ef5 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:22.034866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3c8be-4822-46b9-9555-1ed4f32c2ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:22.035268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3c8be-4822-46b9-9555-1ed4f32c2ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:22.064300 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cb1af-61f6-42ee-9e15-16574668fed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:22.066402 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cb1af-61f6-42ee-9e15-16574668fed3 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:22.089094 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 861/1722] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:22.114837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f0b3c8be-4822-46b9-9555-1ed4f32c2ef5 None None] MFA Rules not processed for user `e94f9a63cb4847c6916a84735d00b48f`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:22.116460 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f0b3c8be-4822-46b9-9555-1ed4f32c2ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:22.132812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 862/1723] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 27 04:20:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:22.219023 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cb1af-61f6-42ee-9e15-16574668fed3 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:22.221982 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-950cb1af-61f6-42ee-9e15-16574668fed3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:22.286799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cb1af-61f6-42ee-9e15-16574668fed3 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:22.290929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cd996-9771-4e08-91db-6cdd551785d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:22.291561 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cd996-9771-4e08-91db-6cdd551785d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:22.291843 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cd996-9771-4e08-91db-6cdd551785d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:22.292121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cd996-9771-4e08-91db-6cdd551785d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:22.303990 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6cd996-9771-4e08-91db-6cdd551785d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:22.306020 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6cd996-9771-4e08-91db-6cdd551785d8 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:22.334588 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 862/1724] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:22.521307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3c8be-4822-46b9-9555-1ed4f32c2ef5 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:22.531063 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f0b3c8be-4822-46b9-9555-1ed4f32c2ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:22.557508 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3c8be-4822-46b9-9555-1ed4f32c2ef5 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:22.574624 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7b616-5c0e-4540-b13a-a9a5bcd149b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:22.575067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7b616-5c0e-4540-b13a-a9a5bcd149b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:22.575446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7b616-5c0e-4540-b13a-a9a5bcd149b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:22.575818 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7b616-5c0e-4540-b13a-a9a5bcd149b5 admin admin] PATH_INFO: `/v3/projects/eee364531d7b4edd8d4f004db0810cda` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:22.578205 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7b616-5c0e-4540-b13a-a9a5bcd149b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee364531d7b4edd8d4f004db0810cda)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:22.583990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7b616-5c0e-4540-b13a-a9a5bcd149b5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:22.733246 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-19c7b616-5c0e-4540-b13a-a9a5bcd149b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee364531d7b4edd8d4f004db0810cda', 'request_id': 'req-19c7b616-5c0e-4540-b13a-a9a5bcd149b5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:22.752452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-19c7b616-5c0e-4540-b13a-a9a5bcd149b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee364531d7b4edd8d4f004db0810cda', 'request_id': 'req-19c7b616-5c0e-4540-b13a-a9a5bcd149b5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:22.762872 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-19c7b616-5c0e-4540-b13a-a9a5bcd149b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee364531d7b4edd8d4f004db0810cda', 'request_id': 'req-19c7b616-5c0e-4540-b13a-a9a5bcd149b5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:22.794308 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-19c7b616-5c0e-4540-b13a-a9a5bcd149b5 admin admin] The token cache is being invalidate because project eee364531d7b4edd8d4f004db0810cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:22.794752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-19c7b616-5c0e-4540-b13a-a9a5bcd149b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:22.798001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-19c7b616-5c0e-4540-b13a-a9a5bcd149b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:22.800896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 863/1725] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:22 2022] DELETE /identity/v3/projects/eee364531d7b4edd8d4f004db0810cda => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:22.804999 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cd996-9771-4e08-91db-6cdd551785d8 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:22.818538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4729b-aa13-466b-bcaf-61a103943133 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:22.819563 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4729b-aa13-466b-bcaf-61a103943133 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:22.819563 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4729b-aa13-466b-bcaf-61a103943133 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:22.823852 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 864/1726] 10.222.0.48 () {54 vars in 912 bytes} [Tue Sep 27 04:20:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:20:22.828520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601cfe4-5ce9-4af8-b7e9-6036f39fae92 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:22.828914 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601cfe4-5ce9-4af8-b7e9-6036f39fae92 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:22.830195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601cfe4-5ce9-4af8-b7e9-6036f39fae92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:22.831444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cd996-9771-4e08-91db-6cdd551785d8 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:22.876943 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-0601cfe4-5ce9-4af8-b7e9-6036f39fae92 None None] MFA Rules not processed for user `e94f9a63cb4847c6916a84735d00b48f`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:22.880655 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0601cfe4-5ce9-4af8-b7e9-6036f39fae92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:22.979306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:23.027297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 865/1727] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 27 04:20:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:23.028809 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414ca5b-e535-4d92-aec4-e18cc44c0897 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:23.029202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414ca5b-e535-4d92-aec4-e18cc44c0897 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:23.029666 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414ca5b-e535-4d92-aec4-e18cc44c0897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:23.050607 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15722488-b679-4c6f-b7a7-7885de43a5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:23.051310 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15722488-b679-4c6f-b7a7-7885de43a5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:23.052524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15722488-b679-4c6f-b7a7-7885de43a5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:23.052761 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15722488-b679-4c6f-b7a7-7885de43a5ac admin admin] PATH_INFO: `/v3/users/c2d73edbcc214518a4b2ac6edbea0450` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:23.054130 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15722488-b679-4c6f-b7a7-7885de43a5ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d73edbcc214518a4b2ac6edbea0450)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:23.056150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15722488-b679-4c6f-b7a7-7885de43a5ac admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:23.065922 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9414ca5b-e535-4d92-aec4-e18cc44c0897 None None] MFA Rules not processed for user `8e03bcebeee44978afe2ce5040ddf122`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:23.067581 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9414ca5b-e535-4d92-aec4-e18cc44c0897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:23.190688 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-15722488-b679-4c6f-b7a7-7885de43a5ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d73edbcc214518a4b2ac6edbea0450'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:23.210506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-15722488-b679-4c6f-b7a7-7885de43a5ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d73edbcc214518a4b2ac6edbea0450'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:23.231789 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 866/1728] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:23.233771 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414ca5b-e535-4d92-aec4-e18cc44c0897 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:23.238607 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9414ca5b-e535-4d92-aec4-e18cc44c0897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:23.248428 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-15722488-b679-4c6f-b7a7-7885de43a5ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d73edbcc214518a4b2ac6edbea0450'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:23.249975 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-15722488-b679-4c6f-b7a7-7885de43a5ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d73edbcc214518a4b2ac6edbea0450'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:23.265878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414ca5b-e535-4d92-aec4-e18cc44c0897 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:23.278430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-15722488-b679-4c6f-b7a7-7885de43a5ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d73edbcc214518a4b2ac6edbea0450'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:23.286279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d43a56-f5fc-4c3c-83aa-89673966492c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:23.290494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d43a56-f5fc-4c3c-83aa-89673966492c service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:23.291089 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d43a56-f5fc-4c3c-83aa-89673966492c service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:23.291980 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 863/1729] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:22 2022] DELETE /identity/v3/users/c2d73edbcc214518a4b2ac6edbea0450 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:23.293181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d43a56-f5fc-4c3c-83aa-89673966492c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:23.294059 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15722488-b679-4c6f-b7a7-7885de43a5ac admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:23.296303 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-83d43a56-f5fc-4c3c-83aa-89673966492c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:23.297351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-15722488-b679-4c6f-b7a7-7885de43a5ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:23.322968 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d43a56-f5fc-4c3c-83aa-89673966492c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:23.324453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d43a56-f5fc-4c3c-83aa-89673966492c service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:23.347332 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 867/1730] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:23.421997 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d43a56-f5fc-4c3c-83aa-89673966492c service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:23.423747 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-83d43a56-f5fc-4c3c-83aa-89673966492c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:23.451862 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:23.490048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d43a56-f5fc-4c3c-83aa-89673966492c service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:23.491627 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15722488-b679-4c6f-b7a7-7885de43a5ac admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:23.499477 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02222fb3-def4-4a64-b9db-7eb9ce2bdd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:23.500358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02222fb3-def4-4a64-b9db-7eb9ce2bdd3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:23.500859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02222fb3-def4-4a64-b9db-7eb9ce2bdd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:23.501284 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02222fb3-def4-4a64-b9db-7eb9ce2bdd3f admin admin] PATH_INFO: `/v3/projects/1cbca7df4ef04fdaaa5a3dd2dc125ba1` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:23.502614 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02222fb3-def4-4a64-b9db-7eb9ce2bdd3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cbca7df4ef04fdaaa5a3dd2dc125ba1)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:23.505023 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02222fb3-def4-4a64-b9db-7eb9ce2bdd3f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:23.505793 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fa18b-48cf-4255-b8d3-966c8c614bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:23.506625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fa18b-48cf-4255-b8d3-966c8c614bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:23.508099 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fa18b-48cf-4255-b8d3-966c8c614bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:23.508420 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fa18b-48cf-4255-b8d3-966c8c614bea admin admin] PATH_INFO: `/v3/projects/e74bbe1e34924cd9a0b2b54c36dea975` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:23.510969 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fa18b-48cf-4255-b8d3-966c8c614bea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e74bbe1e34924cd9a0b2b54c36dea975)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:23.512938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fa18b-48cf-4255-b8d3-966c8c614bea admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:23.592639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-02222fb3-def4-4a64-b9db-7eb9ce2bdd3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cbca7df4ef04fdaaa5a3dd2dc125ba1', 'request_id': 'req-02222fb3-def4-4a64-b9db-7eb9ce2bdd3f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:23.616413 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-02222fb3-def4-4a64-b9db-7eb9ce2bdd3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cbca7df4ef04fdaaa5a3dd2dc125ba1', 'request_id': 'req-02222fb3-def4-4a64-b9db-7eb9ce2bdd3f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:23.631569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-02222fb3-def4-4a64-b9db-7eb9ce2bdd3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cbca7df4ef04fdaaa5a3dd2dc125ba1', 'request_id': 'req-02222fb3-def4-4a64-b9db-7eb9ce2bdd3f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:23.635838 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2c7fa18b-48cf-4255-b8d3-966c8c614bea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e74bbe1e34924cd9a0b2b54c36dea975', 'request_id': 'req-2c7fa18b-48cf-4255-b8d3-966c8c614bea'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:23.653487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2c7fa18b-48cf-4255-b8d3-966c8c614bea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e74bbe1e34924cd9a0b2b54c36dea975', 'request_id': 'req-2c7fa18b-48cf-4255-b8d3-966c8c614bea'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:23.670804 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2c7fa18b-48cf-4255-b8d3-966c8c614bea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e74bbe1e34924cd9a0b2b54c36dea975', 'request_id': 'req-2c7fa18b-48cf-4255-b8d3-966c8c614bea'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:23.673072 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-02222fb3-def4-4a64-b9db-7eb9ce2bdd3f admin admin] The token cache is being invalidate because project 1cbca7df4ef04fdaaa5a3dd2dc125ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:23.673204 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-02222fb3-def4-4a64-b9db-7eb9ce2bdd3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:23.673943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-02222fb3-def4-4a64-b9db-7eb9ce2bdd3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:23.675982 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 864/1731] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:23 2022] DELETE /identity/v3/projects/1cbca7df4ef04fdaaa5a3dd2dc125ba1 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:23.676802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02222fb3-def4-4a64-b9db-7eb9ce2bdd3f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:23.681872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-02222fb3-def4-4a64-b9db-7eb9ce2bdd3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:23.706407 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2c7fa18b-48cf-4255-b8d3-966c8c614bea admin admin] The token cache is being invalidate because project e74bbe1e34924cd9a0b2b54c36dea975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:23.707786 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2c7fa18b-48cf-4255-b8d3-966c8c614bea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:23.712519 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2c7fa18b-48cf-4255-b8d3-966c8c614bea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:23.717773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 868/1732] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:23 2022] DELETE /identity/v3/projects/e74bbe1e34924cd9a0b2b54c36dea975 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:23.717773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fa18b-48cf-4255-b8d3-966c8c614bea admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:23.720335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2c7fa18b-48cf-4255-b8d3-966c8c614bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:23.868711 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02222fb3-def4-4a64-b9db-7eb9ce2bdd3f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:23.923708 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fa18b-48cf-4255-b8d3-966c8c614bea admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:23.939889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4478a-dca5-4bb3-9072-8fa1004d1154 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efd209a50a994b7c8485f2996697218b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:23.941429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4478a-dca5-4bb3-9072-8fa1004d1154 service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:23.941859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4478a-dca5-4bb3-9072-8fa1004d1154 service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:23.942302 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4478a-dca5-4bb3-9072-8fa1004d1154 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:23.947326 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c6d4478a-dca5-4bb3-9072-8fa1004d1154 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:23.970752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:23.995741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4478a-dca5-4bb3-9072-8fa1004d1154 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:23.997457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4478a-dca5-4bb3-9072-8fa1004d1154 service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:24.036061 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 869/1733] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:24.037137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4478a-dca5-4bb3-9072-8fa1004d1154 service placement] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:24.039712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c6d4478a-dca5-4bb3-9072-8fa1004d1154 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:24.044877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33bdb7-84da-439e-afd3-f78990f299d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:24.046286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33bdb7-84da-439e-afd3-f78990f299d7 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:24.047421 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33bdb7-84da-439e-afd3-f78990f299d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:24.047914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33bdb7-84da-439e-afd3-f78990f299d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:24.050976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-dd33bdb7-84da-439e-afd3-f78990f299d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:24.073080 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:24.216994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33bdb7-84da-439e-afd3-f78990f299d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:24.222709 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33bdb7-84da-439e-afd3-f78990f299d7 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:24.246021 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 865/1734] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:24.251110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84854ed1-fa77-4583-a62f-4c590bd92b19 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:24.251747 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84854ed1-fa77-4583-a62f-4c590bd92b19 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:24.251747 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84854ed1-fa77-4583-a62f-4c590bd92b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:24.292994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-84854ed1-fa77-4583-a62f-4c590bd92b19 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:24.294507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-84854ed1-fa77-4583-a62f-4c590bd92b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:24.313789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 866/1735] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:24.314643 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84854ed1-fa77-4583-a62f-4c590bd92b19 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:24.316973 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-84854ed1-fa77-4583-a62f-4c590bd92b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:24.325898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4478a-dca5-4bb3-9072-8fa1004d1154 service placement] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:24.343295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09780ec-291f-4476-a4ea-02c65ac85a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:24.345491 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84854ed1-fa77-4583-a62f-4c590bd92b19 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:24.345945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09780ec-291f-4476-a4ea-02c65ac85a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:24.346355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09780ec-291f-4476-a4ea-02c65ac85a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:24.348272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09780ec-291f-4476-a4ea-02c65ac85a90 admin admin] PATH_INFO: `/v3/users/360946ca107a40f0bd83df38a32fa7f3` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:24.352130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09780ec-291f-4476-a4ea-02c65ac85a90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=360946ca107a40f0bd83df38a32fa7f3)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:24.358505 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09780ec-291f-4476-a4ea-02c65ac85a90 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:24.360968 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49df4a7-9e56-4aed-82ad-1f272f03e628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:24.361655 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49df4a7-9e56-4aed-82ad-1f272f03e628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:24.361939 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49df4a7-9e56-4aed-82ad-1f272f03e628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:24.362846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49df4a7-9e56-4aed-82ad-1f272f03e628 admin admin] PATH_INFO: `/v3/projects/ab65aee3ba9c48e78d16d67f7a71bfa5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:24.365032 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49df4a7-9e56-4aed-82ad-1f272f03e628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab65aee3ba9c48e78d16d67f7a71bfa5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:24.368172 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49df4a7-9e56-4aed-82ad-1f272f03e628 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:24.525815 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b09780ec-291f-4476-a4ea-02c65ac85a90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '360946ca107a40f0bd83df38a32fa7f3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:24.542368 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b09780ec-291f-4476-a4ea-02c65ac85a90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '360946ca107a40f0bd83df38a32fa7f3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:24.543475 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b09780ec-291f-4476-a4ea-02c65ac85a90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '360946ca107a40f0bd83df38a32fa7f3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:24.563098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b09780ec-291f-4476-a4ea-02c65ac85a90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '360946ca107a40f0bd83df38a32fa7f3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:24.575368 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b09780ec-291f-4476-a4ea-02c65ac85a90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '360946ca107a40f0bd83df38a32fa7f3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:24.582690 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d49df4a7-9e56-4aed-82ad-1f272f03e628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab65aee3ba9c48e78d16d67f7a71bfa5', 'request_id': 'req-d49df4a7-9e56-4aed-82ad-1f272f03e628'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:24.587337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 870/1736] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:24 2022] DELETE /identity/v3/users/360946ca107a40f0bd83df38a32fa7f3 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:24.587337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d76c6-dca7-4a73-a86e-63d92effc998 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:24.587337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d76c6-dca7-4a73-a86e-63d92effc998 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:24.587337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d76c6-dca7-4a73-a86e-63d92effc998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:24.598344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d49df4a7-9e56-4aed-82ad-1f272f03e628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab65aee3ba9c48e78d16d67f7a71bfa5', 'request_id': 'req-d49df4a7-9e56-4aed-82ad-1f272f03e628'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:24.616984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d49df4a7-9e56-4aed-82ad-1f272f03e628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab65aee3ba9c48e78d16d67f7a71bfa5', 'request_id': 'req-d49df4a7-9e56-4aed-82ad-1f272f03e628'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:24.642356 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d49df4a7-9e56-4aed-82ad-1f272f03e628 admin admin] The token cache is being invalidate because project ab65aee3ba9c48e78d16d67f7a71bfa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:24.642356 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d49df4a7-9e56-4aed-82ad-1f272f03e628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:24.643466 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d49df4a7-9e56-4aed-82ad-1f272f03e628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:24.647855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 867/1737] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:24 2022] DELETE /identity/v3/projects/ab65aee3ba9c48e78d16d67f7a71bfa5 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:24.652763 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44f8cd-9b29-4fcd-bc44-7ab89c9f6334 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:24.653229 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44f8cd-9b29-4fcd-bc44-7ab89c9f6334 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:24.654367 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44f8cd-9b29-4fcd-bc44-7ab89c9f6334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:24.711210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5b2d76c6-dca7-4a73-a86e-63d92effc998 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:24.718856 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5b2d76c6-dca7-4a73-a86e-63d92effc998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:24.752134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-cb44f8cd-9b29-4fcd-bc44-7ab89c9f6334 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:24.754259 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-cb44f8cd-9b29-4fcd-bc44-7ab89c9f6334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:24.957805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 868/1738] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:24.962231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 871/1739] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:24.979815 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cecdb0-87c7-4574-ae94-991b2666d7d0 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:24.979991 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d76c6-dca7-4a73-a86e-63d92effc998 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:24.983400 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cecdb0-87c7-4574-ae94-991b2666d7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:24.987096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cecdb0-87c7-4574-ae94-991b2666d7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:24.990659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d76c6-dca7-4a73-a86e-63d92effc998 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:25.008046 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43195c-54cc-410d-8b1b-17c14ea9deb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:25.009628 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43195c-54cc-410d-8b1b-17c14ea9deb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:25.009945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43195c-54cc-410d-8b1b-17c14ea9deb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:25.010230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43195c-54cc-410d-8b1b-17c14ea9deb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:25.011270 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43195c-54cc-410d-8b1b-17c14ea9deb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:25.012149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43195c-54cc-410d-8b1b-17c14ea9deb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:25.020008 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43195c-54cc-410d-8b1b-17c14ea9deb5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:25.043138 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:25.049249 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 872/1740] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:25.062783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43195c-54cc-410d-8b1b-17c14ea9deb5 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:25.098022 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43195c-54cc-410d-8b1b-17c14ea9deb5 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:25.103630 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-60cecdb0-87c7-4574-ae94-991b2666d7d0 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:25.110693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838dcd0-79a8-4c83-b6fd-5814619360b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:25.111395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-60cecdb0-87c7-4574-ae94-991b2666d7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:25.112233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838dcd0-79a8-4c83-b6fd-5814619360b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:25.113510 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838dcd0-79a8-4c83-b6fd-5814619360b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:25.115101 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838dcd0-79a8-4c83-b6fd-5814619360b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:25.115945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838dcd0-79a8-4c83-b6fd-5814619360b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:25.122915 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838dcd0-79a8-4c83-b6fd-5814619360b5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:25.145940 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 869/1741] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:25.149679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67ee4e-def9-45b3-8ea1-b111a8cf2217 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:25.149974 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67ee4e-def9-45b3-8ea1-b111a8cf2217 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:25.150254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67ee4e-def9-45b3-8ea1-b111a8cf2217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:25.223252 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 873/1742] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:25 2022] POST /identity/v3/projects => generated 405 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:25.226216 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-2c67ee4e-def9-45b3-8ea1-b111a8cf2217 None None] MFA Rules not processed for user `84c92ec374504550aa3c2bbc8bf3eb8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:25.227262 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838dcd0-79a8-4c83-b6fd-5814619360b5 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:25.230233 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2c67ee4e-def9-45b3-8ea1-b111a8cf2217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:25.303316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:25.436476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838dcd0-79a8-4c83-b6fd-5814619360b5 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:25.449852 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060087f-65ae-46c4-97b3-0f95695ea1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:25.450742 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060087f-65ae-46c4-97b3-0f95695ea1ed admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:25.451342 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060087f-65ae-46c4-97b3-0f95695ea1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:25.451774 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060087f-65ae-46c4-97b3-0f95695ea1ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:25.454361 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060087f-65ae-46c4-97b3-0f95695ea1ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:25.454876 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060087f-65ae-46c4-97b3-0f95695ea1ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:25.459710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 870/1743] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:25.460540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67ee4e-def9-45b3-8ea1-b111a8cf2217 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:25.468884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060087f-65ae-46c4-97b3-0f95695ea1ed admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:25.491716 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67ee4e-def9-45b3-8ea1-b111a8cf2217 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:25.533592 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf731417-d9eb-4ba5-bb97-0e9a2bd98a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:25.535650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf731417-d9eb-4ba5-bb97-0e9a2bd98a2b admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:25.535946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf731417-d9eb-4ba5-bb97-0e9a2bd98a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:25.536285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf731417-d9eb-4ba5-bb97-0e9a2bd98a2b admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:25.536863 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf731417-d9eb-4ba5-bb97-0e9a2bd98a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:25.550232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 874/1744] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:25.555650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060087f-65ae-46c4-97b3-0f95695ea1ed admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:25.564005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf731417-d9eb-4ba5-bb97-0e9a2bd98a2b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:25.631884 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 871/1745] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:25 2022] POST /identity/v3/users => generated 303 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:25.633410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060087f-65ae-46c4-97b3-0f95695ea1ed admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:25.636709 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf731417-d9eb-4ba5-bb97-0e9a2bd98a2b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:25.676979 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a810a-1ad0-42fc-8457-20c51b76987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:25.681949 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a810a-1ad0-42fc-8457-20c51b76987b admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:25.681949 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a810a-1ad0-42fc-8457-20c51b76987b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:25.682251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a810a-1ad0-42fc-8457-20c51b76987b admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:25.682968 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a810a-1ad0-42fc-8457-20c51b76987b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:25.686663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a810a-1ad0-42fc-8457-20c51b76987b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:25.711380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf731417-d9eb-4ba5-bb97-0e9a2bd98a2b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:25.738893 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46117d64-9a97-4b8d-885a-3fc6174e54f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:25.740752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46117d64-9a97-4b8d-885a-3fc6174e54f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:25.741044 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46117d64-9a97-4b8d-885a-3fc6174e54f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:25.741324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46117d64-9a97-4b8d-885a-3fc6174e54f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:25.748848 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46117d64-9a97-4b8d-885a-3fc6174e54f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:25.759403 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46117d64-9a97-4b8d-885a-3fc6174e54f6 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:25.796316 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 875/1746] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:25 2022] POST /identity/v3/projects => generated 381 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:25.819022 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a810a-1ad0-42fc-8457-20c51b76987b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:25.821339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 872/1747] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:25.824470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-513a810a-1ad0-42fc-8457-20c51b76987b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:25.833917 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46117d64-9a97-4b8d-885a-3fc6174e54f6 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:25.889612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46117d64-9a97-4b8d-885a-3fc6174e54f6 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:26.050380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a810a-1ad0-42fc-8457-20c51b76987b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:26.083466 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14565c1-188f-4929-aa47-aa2816633103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:26.084296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14565c1-188f-4929-aa47-aa2816633103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:26.086216 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14565c1-188f-4929-aa47-aa2816633103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:26.086615 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14565c1-188f-4929-aa47-aa2816633103 admin admin] PATH_INFO: `/v3/users/074b86ef250c4249bf81079bba774f84` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:26.090108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14565c1-188f-4929-aa47-aa2816633103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=074b86ef250c4249bf81079bba774f84)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:26.101897 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14565c1-188f-4929-aa47-aa2816633103 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:26.130113 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b132f8-7e10-4768-816f-8c606ddffc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:26.131469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b132f8-7e10-4768-816f-8c606ddffc0d admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:26.148514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b132f8-7e10-4768-816f-8c606ddffc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:26.149500 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b132f8-7e10-4768-816f-8c606ddffc0d admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:26.152153 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b132f8-7e10-4768-816f-8c606ddffc0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:26.157576 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b132f8-7e10-4768-816f-8c606ddffc0d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:26.249499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 873/1748] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:25 2022] POST /identity/v3/users => generated 291 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:26.255363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b132f8-7e10-4768-816f-8c606ddffc0d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:26.270606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e14565c1-188f-4929-aa47-aa2816633103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074b86ef250c4249bf81079bba774f84'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:26.279685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b132f8-7e10-4768-816f-8c606ddffc0d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:26.282915 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:26.295398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e14565c1-188f-4929-aa47-aa2816633103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074b86ef250c4249bf81079bba774f84'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:26.298657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923dbd7-c64b-4494-a8f1-fdd5772346e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:26.299454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923dbd7-c64b-4494-a8f1-fdd5772346e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:26.299966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923dbd7-c64b-4494-a8f1-fdd5772346e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:26.300437 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923dbd7-c64b-4494-a8f1-fdd5772346e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:26.301655 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e14565c1-188f-4929-aa47-aa2816633103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074b86ef250c4249bf81079bba774f84'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:26.303154 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923dbd7-c64b-4494-a8f1-fdd5772346e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:26.308318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923dbd7-c64b-4494-a8f1-fdd5772346e9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:26.342810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 874/1749] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:26.343775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e14565c1-188f-4929-aa47-aa2816633103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074b86ef250c4249bf81079bba774f84'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:26.343910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923dbd7-c64b-4494-a8f1-fdd5772346e9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:26.351620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c923dbd7-c64b-4494-a8f1-fdd5772346e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:26.364826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e14565c1-188f-4929-aa47-aa2816633103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074b86ef250c4249bf81079bba774f84'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:26.380755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 876/1750] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:25 2022] DELETE /identity/v3/users/074b86ef250c4249bf81079bba774f84 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:26.382043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14565c1-188f-4929-aa47-aa2816633103 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:26.383814 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e14565c1-188f-4929-aa47-aa2816633103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:26.401767 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923dbd7-c64b-4494-a8f1-fdd5772346e9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:26.593882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14565c1-188f-4929-aa47-aa2816633103 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:26.605139 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dec06-2e8b-4b29-aeec-350c1124378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:26.607021 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dec06-2e8b-4b29-aeec-350c1124378e admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:26.611222 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2102f2-9efc-46ca-b3ca-15b1736b44d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:26.612097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2102f2-9efc-46ca-b3ca-15b1736b44d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:26.612338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dec06-2e8b-4b29-aeec-350c1124378e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:26.612705 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2102f2-9efc-46ca-b3ca-15b1736b44d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:26.613112 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2102f2-9efc-46ca-b3ca-15b1736b44d5 admin admin] PATH_INFO: `/v3/projects/abd2630ad9224d26a16cf6d7e637ef41/users/44405bda057e4720b1c4ea87dd71b761/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:26.613370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dec06-2e8b-4b29-aeec-350c1124378e admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:26.615825 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dec06-2e8b-4b29-aeec-350c1124378e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:26.627311 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dec06-2e8b-4b29-aeec-350c1124378e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:26.660354 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2102f2-9efc-46ca-b3ca-15b1736b44d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd2630ad9224d26a16cf6d7e637ef41, user_id=44405bda057e4720b1c4ea87dd71b761, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:26.664188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2102f2-9efc-46ca-b3ca-15b1736b44d5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:26.672669 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 875/1751] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:26.675451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b70bda-632b-42c1-b73b-aeee5f07f1f1 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:26.676083 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b70bda-632b-42c1-b73b-aeee5f07f1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:26.678924 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b70bda-632b-42c1-b73b-aeee5f07f1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:26.694882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 877/1752] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:26 2022] PUT /identity/v3/projects/abd2630ad9224d26a16cf6d7e637ef41/users/44405bda057e4720b1c4ea87dd71b761/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:26.694882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2102f2-9efc-46ca-b3ca-15b1736b44d5 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:26.696735 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ec2102f2-9efc-46ca-b3ca-15b1736b44d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:26.732840 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-14b70bda-632b-42c1-b73b-aeee5f07f1f1 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:26.734410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-14b70bda-632b-42c1-b73b-aeee5f07f1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:26.747847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:26.836108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2102f2-9efc-46ca-b3ca-15b1736b44d5 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:26.843179 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3c903-baad-4403-a0fc-0735781d1f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:26.846068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3c903-baad-4403-a0fc-0735781d1f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:26.846534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3c903-baad-4403-a0fc-0735781d1f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:26.848788 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3c903-baad-4403-a0fc-0735781d1f4f admin admin] PATH_INFO: `/v3/projects/0bbc908715c2464f87775bffb4ea5ae1` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:26.850438 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3c903-baad-4403-a0fc-0735781d1f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bbc908715c2464f87775bffb4ea5ae1)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:26.854171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3c903-baad-4403-a0fc-0735781d1f4f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:26.982652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 876/1753] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:26.983694 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b70bda-632b-42c1-b73b-aeee5f07f1f1 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:27.023681 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b70bda-632b-42c1-b73b-aeee5f07f1f1 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:27.087774 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-bdd3c903-baad-4403-a0fc-0735781d1f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bbc908715c2464f87775bffb4ea5ae1', 'request_id': 'req-bdd3c903-baad-4403-a0fc-0735781d1f4f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:27.125581 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:27.134630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-bdd3c903-baad-4403-a0fc-0735781d1f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bbc908715c2464f87775bffb4ea5ae1', 'request_id': 'req-bdd3c903-baad-4403-a0fc-0735781d1f4f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:27.158492 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-bdd3c903-baad-4403-a0fc-0735781d1f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bbc908715c2464f87775bffb4ea5ae1', 'request_id': 'req-bdd3c903-baad-4403-a0fc-0735781d1f4f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:27.189610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d816e3d-fa2f-4ec1-aff1-22fc37bfa85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:27.194966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d816e3d-fa2f-4ec1-aff1-22fc37bfa85b admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:27.195649 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d816e3d-fa2f-4ec1-aff1-22fc37bfa85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:27.195942 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d816e3d-fa2f-4ec1-aff1-22fc37bfa85b admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:27.196696 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d816e3d-fa2f-4ec1-aff1-22fc37bfa85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:27.197742 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-bdd3c903-baad-4403-a0fc-0735781d1f4f admin admin] The token cache is being invalidate because project 0bbc908715c2464f87775bffb4ea5ae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:27.199518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-bdd3c903-baad-4403-a0fc-0735781d1f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:27.200780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-bdd3c903-baad-4403-a0fc-0735781d1f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:27.201487 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d816e3d-fa2f-4ec1-aff1-22fc37bfa85b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:27.203435 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 878/1754] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:26 2022] DELETE /identity/v3/projects/0bbc908715c2464f87775bffb4ea5ae1 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:27.212974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f8eb4-51d0-442b-bc4d-04581aca5b1c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:27.223077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f8eb4-51d0-442b-bc4d-04581aca5b1c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:27.223993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f8eb4-51d0-442b-bc4d-04581aca5b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:27.231859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 877/1755] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:27.233207 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d816e3d-fa2f-4ec1-aff1-22fc37bfa85b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:27.241100 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2d816e3d-fa2f-4ec1-aff1-22fc37bfa85b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:27.332618 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1d2f8eb4-51d0-442b-bc4d-04581aca5b1c None None] MFA Rules not processed for user `44405bda057e4720b1c4ea87dd71b761`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:27.334034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1d2f8eb4-51d0-442b-bc4d-04581aca5b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:27.420827 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d816e3d-fa2f-4ec1-aff1-22fc37bfa85b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:27.443229 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6275f18-eea3-4b02-9aa6-6656d5ad45e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:27.443937 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6275f18-eea3-4b02-9aa6-6656d5ad45e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:27.444221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6275f18-eea3-4b02-9aa6-6656d5ad45e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:27.444503 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6275f18-eea3-4b02-9aa6-6656d5ad45e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:27.464683 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c6275f18-eea3-4b02-9aa6-6656d5ad45e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:27.520069 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6275f18-eea3-4b02-9aa6-6656d5ad45e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:27.539621 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6275f18-eea3-4b02-9aa6-6656d5ad45e4 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:27.557781 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 879/1756] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:27.558914 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82555f1f-c31f-40bd-b3f1-47d676b01c22 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:27.563829 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82555f1f-c31f-40bd-b3f1-47d676b01c22 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:27.564253 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82555f1f-c31f-40bd-b3f1-47d676b01c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:27.594528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 878/1757] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:27.597603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6275f18-eea3-4b02-9aa6-6656d5ad45e4 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:27.605498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c6275f18-eea3-4b02-9aa6-6656d5ad45e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:27.629433 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-82555f1f-c31f-40bd-b3f1-47d676b01c22 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:27.630828 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-82555f1f-c31f-40bd-b3f1-47d676b01c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:27.661546 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 880/1758] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:27.661546 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82555f1f-c31f-40bd-b3f1-47d676b01c22 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:27.664057 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-82555f1f-c31f-40bd-b3f1-47d676b01c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:27.667023 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6275f18-eea3-4b02-9aa6-6656d5ad45e4 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:27.686431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82555f1f-c31f-40bd-b3f1-47d676b01c22 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:27.696035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09df79-e9b7-42da-8190-88ad6ea1060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:27.697496 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09df79-e9b7-42da-8190-88ad6ea1060e admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:27.700071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09df79-e9b7-42da-8190-88ad6ea1060e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:27.701608 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e4181-5fe8-4729-9b8a-df9c1acd5717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:27.702565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e4181-5fe8-4729-9b8a-df9c1acd5717 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:27.702787 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e4181-5fe8-4729-9b8a-df9c1acd5717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:27.703004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09df79-e9b7-42da-8190-88ad6ea1060e admin admin] PATH_INFO: `/v3/projects/7a0adb8afabb4c52a336ba6d055c2e15/users/5d9157836b6e446e9ccbfbcab9af61f7/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:27.703115 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e4181-5fe8-4729-9b8a-df9c1acd5717 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:27.703706 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e4181-5fe8-4729-9b8a-df9c1acd5717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:27.710681 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e4181-5fe8-4729-9b8a-df9c1acd5717 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:27.755681 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09df79-e9b7-42da-8190-88ad6ea1060e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0adb8afabb4c52a336ba6d055c2e15, user_id=5d9157836b6e446e9ccbfbcab9af61f7, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:27.758866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09df79-e9b7-42da-8190-88ad6ea1060e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:27.782857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 881/1759] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:27 2022] POST /identity/v3/projects => generated 405 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:27.784185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376a5cc-a79d-40ac-8e0f-4ec20be3c2d9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:27.784478 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376a5cc-a79d-40ac-8e0f-4ec20be3c2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:27.784845 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376a5cc-a79d-40ac-8e0f-4ec20be3c2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:27.792257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 879/1760] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:27 2022] PUT /identity/v3/projects/7a0adb8afabb4c52a336ba6d055c2e15/users/5d9157836b6e446e9ccbfbcab9af61f7/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:27.793724 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09df79-e9b7-42da-8190-88ad6ea1060e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:27.823230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e376a5cc-a79d-40ac-8e0f-4ec20be3c2d9 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:27.824568 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e376a5cc-a79d-40ac-8e0f-4ec20be3c2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:27.925150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:28.033382 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09df79-e9b7-42da-8190-88ad6ea1060e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:28.067383 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f1b6f-7ce3-496a-a58b-f10341b665d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:28.068291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f1b6f-7ce3-496a-a58b-f10341b665d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:28.068694 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f1b6f-7ce3-496a-a58b-f10341b665d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:28.069841 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f1b6f-7ce3-496a-a58b-f10341b665d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:28.071153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 882/1761] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:28.081857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb05b59-ede5-412f-80a3-7e1638aec2aa None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:28.082424 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f1b6f-7ce3-496a-a58b-f10341b665d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:28.084429 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb05b59-ede5-412f-80a3-7e1638aec2aa None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:28.085406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb05b59-ede5-412f-80a3-7e1638aec2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:28.088135 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f1b6f-7ce3-496a-a58b-f10341b665d0 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:28.156899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 880/1762] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:27 2022] POST /identity/v3/users => generated 309 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:28.160881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f1b6f-7ce3-496a-a58b-f10341b665d0 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:28.176058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-bbb05b59-ede5-412f-80a3-7e1638aec2aa None None] MFA Rules not processed for user `5d9157836b6e446e9ccbfbcab9af61f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:28.180968 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-bbb05b59-ede5-412f-80a3-7e1638aec2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:28.185433 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f1b6f-7ce3-496a-a58b-f10341b665d0 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:28.218321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb5017-b369-44be-9b3d-cbea293e3abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:28.219158 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb5017-b369-44be-9b3d-cbea293e3abb admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:28.219913 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb5017-b369-44be-9b3d-cbea293e3abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:28.219913 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb5017-b369-44be-9b3d-cbea293e3abb admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:28.225191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb5017-b369-44be-9b3d-cbea293e3abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:28.228617 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb5017-b369-44be-9b3d-cbea293e3abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:28.230435 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb5017-b369-44be-9b3d-cbea293e3abb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:28.271222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 881/1763] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:28.272571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb5017-b369-44be-9b3d-cbea293e3abb admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:28.308703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb5017-b369-44be-9b3d-cbea293e3abb admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:28.326480 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:28.327993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f4d99-7ad6-42bd-9b48-91b09fbf5546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:28.328934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f4d99-7ad6-42bd-9b48-91b09fbf5546 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:28.329431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f4d99-7ad6-42bd-9b48-91b09fbf5546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:28.329935 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f4d99-7ad6-42bd-9b48-91b09fbf5546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:28.331221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f4d99-7ad6-42bd-9b48-91b09fbf5546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:28.333672 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f4d99-7ad6-42bd-9b48-91b09fbf5546 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:28.364371 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 882/1764] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:28.368804 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f4d99-7ad6-42bd-9b48-91b09fbf5546 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:28.394316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f4d99-7ad6-42bd-9b48-91b09fbf5546 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:28.404245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f6c32-86e3-42ff-a369-da3b83d824a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:28.407822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f6c32-86e3-42ff-a369-da3b83d824a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:28.409878 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f6c32-86e3-42ff-a369-da3b83d824a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:28.410284 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f6c32-86e3-42ff-a369-da3b83d824a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:28.411502 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f6c32-86e3-42ff-a369-da3b83d824a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:28.418377 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f6c32-86e3-42ff-a369-da3b83d824a6 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:28.420326 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 883/1765] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:28.421930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb05b59-ede5-412f-80a3-7e1638aec2aa None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:28.439752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb05b59-ede5-412f-80a3-7e1638aec2aa None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:28.479013 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679f683-fbdc-487e-9f6f-23c3772b228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:28.480207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679f683-fbdc-487e-9f6f-23c3772b228c admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:28.480506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679f683-fbdc-487e-9f6f-23c3772b228c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:28.482732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679f683-fbdc-487e-9f6f-23c3772b228c admin admin] PATH_INFO: `/v3/projects/e8cb1bb5088c4b13b592874ccd490fe0/users/12bb3529163c47c0a51d97681ec7a38d/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:28.482878 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 883/1766] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:28 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:28.483792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f6c32-86e3-42ff-a369-da3b83d824a6 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:28.525037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679f683-fbdc-487e-9f6f-23c3772b228c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8cb1bb5088c4b13b592874ccd490fe0, user_id=12bb3529163c47c0a51d97681ec7a38d, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:28.530317 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679f683-fbdc-487e-9f6f-23c3772b228c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:28.567716 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 884/1767] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:28 2022] PUT /identity/v3/projects/e8cb1bb5088c4b13b592874ccd490fe0/users/12bb3529163c47c0a51d97681ec7a38d/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:28.568743 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679f683-fbdc-487e-9f6f-23c3772b228c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:28.678468 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f6c32-86e3-42ff-a369-da3b83d824a6 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:28.769010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679f683-fbdc-487e-9f6f-23c3772b228c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:28.782803 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfb98c-d975-461f-9c5a-64a14eb8e698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:28.784722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfb98c-d975-461f-9c5a-64a14eb8e698 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:28.785009 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfb98c-d975-461f-9c5a-64a14eb8e698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:28.785335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfb98c-d975-461f-9c5a-64a14eb8e698 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:28.786275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfb98c-d975-461f-9c5a-64a14eb8e698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:28.791851 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfb98c-d975-461f-9c5a-64a14eb8e698 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:28.794368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaaa1f6-68e1-4418-8f44-a674d3616f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:28.795046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaaa1f6-68e1-4418-8f44-a674d3616f29 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:28.795403 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaaa1f6-68e1-4418-8f44-a674d3616f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:28.796035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaaa1f6-68e1-4418-8f44-a674d3616f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:28.796322 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaaa1f6-68e1-4418-8f44-a674d3616f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:28.798240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaaa1f6-68e1-4418-8f44-a674d3616f29 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:28.823009 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 885/1768] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:28 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:28.824542 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfb98c-d975-461f-9c5a-64a14eb8e698 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:28.874838 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfb98c-d975-461f-9c5a-64a14eb8e698 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:28.888392 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e3267-1dd0-429f-b41e-0c84829ad849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:28.889192 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e3267-1dd0-429f-b41e-0c84829ad849 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:28.890889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e3267-1dd0-429f-b41e-0c84829ad849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:28.891174 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e3267-1dd0-429f-b41e-0c84829ad849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:28.894185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e3267-1dd0-429f-b41e-0c84829ad849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:28.897603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e3267-1dd0-429f-b41e-0c84829ad849 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:28.898481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 884/1769] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:28 2022] POST /identity/v3/projects => generated 381 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:28.900068 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaaa1f6-68e1-4418-8f44-a674d3616f29 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:28.930862 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:28.934086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 886/1770] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:28.940836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e3267-1dd0-429f-b41e-0c84829ad849 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:28.967631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e3267-1dd0-429f-b41e-0c84829ad849 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:29.062354 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaaa1f6-68e1-4418-8f44-a674d3616f29 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:29.073087 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0797b-e176-426c-ab08-4aa796f92ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:29.075754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0797b-e176-426c-ab08-4aa796f92ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:29.076318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0797b-e176-426c-ab08-4aa796f92ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:29.076807 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0797b-e176-426c-ab08-4aa796f92ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:29.079475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0797b-e176-426c-ab08-4aa796f92ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:29.083617 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0797b-e176-426c-ab08-4aa796f92ec9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:29.104877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 885/1771] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:29.106100 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0797b-e176-426c-ab08-4aa796f92ec9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:29.133953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0797b-e176-426c-ab08-4aa796f92ec9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:29.139388 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be066a5e-8da4-4781-8b9b-fecc6f63b78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:29.140323 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be066a5e-8da4-4781-8b9b-fecc6f63b78e admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:29.140792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be066a5e-8da4-4781-8b9b-fecc6f63b78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:29.141273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be066a5e-8da4-4781-8b9b-fecc6f63b78e admin admin] PATH_INFO: `/v3/projects/e8cb1bb5088c4b13b592874ccd490fe0/users/12bb3529163c47c0a51d97681ec7a38d/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:29.144600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be066a5e-8da4-4781-8b9b-fecc6f63b78e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8cb1bb5088c4b13b592874ccd490fe0, user_id=12bb3529163c47c0a51d97681ec7a38d, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:29.144743 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27293f1-09c7-488c-bb4e-b47c9b84f63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:29.148126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be066a5e-8da4-4781-8b9b-fecc6f63b78e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:29.148778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27293f1-09c7-488c-bb4e-b47c9b84f63e admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:29.149154 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27293f1-09c7-488c-bb4e-b47c9b84f63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:29.149505 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27293f1-09c7-488c-bb4e-b47c9b84f63e admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:29.150239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27293f1-09c7-488c-bb4e-b47c9b84f63e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:29.157924 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27293f1-09c7-488c-bb4e-b47c9b84f63e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:29.163198 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 886/1772] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:29 2022] PUT /identity/v3/projects/e8cb1bb5088c4b13b592874ccd490fe0/users/12bb3529163c47c0a51d97681ec7a38d/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:29.164234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be066a5e-8da4-4781-8b9b-fecc6f63b78e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:29.215081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 887/1773] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:28 2022] POST /identity/v3/users => generated 297 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:29.215081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a54b86-aef5-4844-8239-947d0ecbcfdd None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:29.215081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a54b86-aef5-4844-8239-947d0ecbcfdd None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:29.215081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a54b86-aef5-4844-8239-947d0ecbcfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:29.281486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:29.315371 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be066a5e-8da4-4781-8b9b-fecc6f63b78e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:29.328019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aae899-10bf-4998-a5d3-e262310ca8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:29.328815 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aae899-10bf-4998-a5d3-e262310ca8bd admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:29.329258 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aae899-10bf-4998-a5d3-e262310ca8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:29.329697 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aae899-10bf-4998-a5d3-e262310ca8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:29.331301 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aae899-10bf-4998-a5d3-e262310ca8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:29.334586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aae899-10bf-4998-a5d3-e262310ca8bd admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:29.337694 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d0a54b86-aef5-4844-8239-947d0ecbcfdd None None] MFA Rules not processed for user `71c7a54c598642a4b9219ae21c34f0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:29.339144 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d0a54b86-aef5-4844-8239-947d0ecbcfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:29.356416 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 887/1774] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:29.358539 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f68630-9f67-4e4a-9e70-8ead56bf7a5a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:29.361104 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f68630-9f67-4e4a-9e70-8ead56bf7a5a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:29.362993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f68630-9f67-4e4a-9e70-8ead56bf7a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:29.449921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-93f68630-9f67-4e4a-9e70-8ead56bf7a5a None None] MFA Rules not processed for user `12bb3529163c47c0a51d97681ec7a38d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:29.453881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-93f68630-9f67-4e4a-9e70-8ead56bf7a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:29.532392 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 888/1775] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 27 04:20:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:29.533423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a54b86-aef5-4844-8239-947d0ecbcfdd None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:29.577111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a54b86-aef5-4844-8239-947d0ecbcfdd None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:29.597313 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7da58-0dac-40d3-b843-e616d2e48c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:29.598305 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7da58-0dac-40d3-b843-e616d2e48c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:29.600216 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7da58-0dac-40d3-b843-e616d2e48c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:29.601291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7da58-0dac-40d3-b843-e616d2e48c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:29.603796 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7da58-0dac-40d3-b843-e616d2e48c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:29.614540 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7da58-0dac-40d3-b843-e616d2e48c7f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:29.648878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 889/1776] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:29.650687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7da58-0dac-40d3-b843-e616d2e48c7f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:29.674984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7da58-0dac-40d3-b843-e616d2e48c7f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:29.684476 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 888/1777] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:29 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:29.686615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f68630-9f67-4e4a-9e70-8ead56bf7a5a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:29.691244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bbf95-69d3-4fc4-9fd0-1d60e2bda1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:29.693249 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bbf95-69d3-4fc4-9fd0-1d60e2bda1d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:29.694981 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bbf95-69d3-4fc4-9fd0-1d60e2bda1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:29.695393 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bbf95-69d3-4fc4-9fd0-1d60e2bda1d0 admin admin] PATH_INFO: `/v3/projects/058e2a896b8144edb94b7a8a4e1a0e6e/users/9be7e33fdac7412998c278187575188d/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:29.737516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f68630-9f67-4e4a-9e70-8ead56bf7a5a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:29.757727 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d45858-c80d-449f-abb2-27bafd25a184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:29.758572 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d45858-c80d-449f-abb2-27bafd25a184 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:29.758887 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d45858-c80d-449f-abb2-27bafd25a184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:29.759157 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d45858-c80d-449f-abb2-27bafd25a184 admin admin] PATH_INFO: `/v3/projects/25d72d58ee794d39be199a1ccd429490/users/76b0cf8ddea4409baa8ddbd1de44d5e0/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:29.770818 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bbf95-69d3-4fc4-9fd0-1d60e2bda1d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=058e2a896b8144edb94b7a8a4e1a0e6e, user_id=9be7e33fdac7412998c278187575188d, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:29.773985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bbf95-69d3-4fc4-9fd0-1d60e2bda1d0 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:29.788601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:29.812342 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 890/1778] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:29 2022] PUT /identity/v3/projects/058e2a896b8144edb94b7a8a4e1a0e6e/users/9be7e33fdac7412998c278187575188d/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:29.813211 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bbf95-69d3-4fc4-9fd0-1d60e2bda1d0 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:29.819590 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d45858-c80d-449f-abb2-27bafd25a184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d72d58ee794d39be199a1ccd429490, user_id=76b0cf8ddea4409baa8ddbd1de44d5e0, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:29.828464 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d45858-c80d-449f-abb2-27bafd25a184 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:29.830228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c73bbf95-69d3-4fc4-9fd0-1d60e2bda1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:29.888377 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 889/1779] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:29 2022] PUT /identity/v3/projects/25d72d58ee794d39be199a1ccd429490/users/76b0cf8ddea4409baa8ddbd1de44d5e0/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:29.891168 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3db62-bfdd-41c1-a211-a86b5c1bda02 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:29.891369 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3db62-bfdd-41c1-a211-a86b5c1bda02 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:29.891653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3db62-bfdd-41c1-a211-a86b5c1bda02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:30.007409 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8db3db62-bfdd-41c1-a211-a86b5c1bda02 None None] MFA Rules not processed for user `9be7e33fdac7412998c278187575188d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:30.008852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8db3db62-bfdd-41c1-a211-a86b5c1bda02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:30.045366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bbf95-69d3-4fc4-9fd0-1d60e2bda1d0 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:30.151227 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f421ab-34e4-4745-9e8d-cb18aec0be4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:30.152217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f421ab-34e4-4745-9e8d-cb18aec0be4e service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:30.152684 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f421ab-34e4-4745-9e8d-cb18aec0be4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:30.153014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f421ab-34e4-4745-9e8d-cb18aec0be4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:30.156825 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 890/1780] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:30.157702 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3db62-bfdd-41c1-a211-a86b5c1bda02 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:30.242382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:30.271361 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3db62-bfdd-41c1-a211-a86b5c1bda02 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:30.284948 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69a420-b44b-4eb2-b08f-44ef3e2e2a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:30.288030 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69a420-b44b-4eb2-b08f-44ef3e2e2a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:30.289507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69a420-b44b-4eb2-b08f-44ef3e2e2a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:30.289883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69a420-b44b-4eb2-b08f-44ef3e2e2a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:30.292467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69a420-b44b-4eb2-b08f-44ef3e2e2a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:30.296380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69a420-b44b-4eb2-b08f-44ef3e2e2a7b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:30.329695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 891/1781] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:30.331616 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69a420-b44b-4eb2-b08f-44ef3e2e2a7b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:30.337470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fb69a420-b44b-4eb2-b08f-44ef3e2e2a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:30.369222 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f421ab-34e4-4745-9e8d-cb18aec0be4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:30.371565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f421ab-34e4-4745-9e8d-cb18aec0be4e service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:30.433694 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 891/1782] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:29 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:30.434706 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f421ab-34e4-4745-9e8d-cb18aec0be4e service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:30.441458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a9f421ab-34e4-4745-9e8d-cb18aec0be4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:30.489200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f421ab-34e4-4745-9e8d-cb18aec0be4e service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:30.495814 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b708140-c558-4a84-9462-9d2bf4866383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:30.496638 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b708140-c558-4a84-9462-9d2bf4866383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:30.497111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b708140-c558-4a84-9462-9d2bf4866383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:30.497563 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b708140-c558-4a84-9462-9d2bf4866383 admin admin] PATH_INFO: `/v3/projects/567ca46f965a47a69dbc5fc40e4627a1` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:30.503710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b708140-c558-4a84-9462-9d2bf4866383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=567ca46f965a47a69dbc5fc40e4627a1)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:30.523436 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b708140-c558-4a84-9462-9d2bf4866383 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:30.628533 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:30.703479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69a420-b44b-4eb2-b08f-44ef3e2e2a7b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:30.718734 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1b708140-c558-4a84-9462-9d2bf4866383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '567ca46f965a47a69dbc5fc40e4627a1', 'request_id': 'req-1b708140-c558-4a84-9462-9d2bf4866383'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:30.740021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1b708140-c558-4a84-9462-9d2bf4866383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '567ca46f965a47a69dbc5fc40e4627a1', 'request_id': 'req-1b708140-c558-4a84-9462-9d2bf4866383'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:30.766930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1b708140-c558-4a84-9462-9d2bf4866383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '567ca46f965a47a69dbc5fc40e4627a1', 'request_id': 'req-1b708140-c558-4a84-9462-9d2bf4866383'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:30.801883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1b708140-c558-4a84-9462-9d2bf4866383 admin admin] The token cache is being invalidate because project 567ca46f965a47a69dbc5fc40e4627a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:30.804098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1b708140-c558-4a84-9462-9d2bf4866383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:30.807280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1b708140-c558-4a84-9462-9d2bf4866383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:30.813258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 892/1783] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:30 2022] DELETE /identity/v3/projects/567ca46f965a47a69dbc5fc40e4627a1 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:30.814365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b708140-c558-4a84-9462-9d2bf4866383 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:30.815989 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1b708140-c558-4a84-9462-9d2bf4866383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:30.921221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f53e8-6c4d-4b08-bea5-d3c2c2810b89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c295a3063c3b45be96b406f586180142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:30.921221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f53e8-6c4d-4b08-bea5-d3c2c2810b89 service swift] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:30.921221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f53e8-6c4d-4b08-bea5-d3c2c2810b89 service swift] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:30.921221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f53e8-6c4d-4b08-bea5-d3c2c2810b89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:30.924403 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-349f53e8-6c4d-4b08-bea5-d3c2c2810b89 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:30.993094 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b708140-c558-4a84-9462-9d2bf4866383 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:30.999083 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9f311-25e4-45d2-9056-149eb16f4a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:30.999910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9f311-25e4-45d2-9056-149eb16f4a0d admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:31.000388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9f311-25e4-45d2-9056-149eb16f4a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:31.000795 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9f311-25e4-45d2-9056-149eb16f4a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:31.001740 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9f311-25e4-45d2-9056-149eb16f4a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:31.004407 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9f311-25e4-45d2-9056-149eb16f4a0d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:31.039439 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f53e8-6c4d-4b08-bea5-d3c2c2810b89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:31.041710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f53e8-6c4d-4b08-bea5-d3c2c2810b89 service swift] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:31.048904 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 893/1784] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:30 2022] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:31.053804 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9f311-25e4-45d2-9056-149eb16f4a0d admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:31.055966 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-efd9f311-25e4-45d2-9056-149eb16f4a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:31.059902 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 892/1785] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 27 04:20:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:20:31.072761 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f53e8-6c4d-4b08-bea5-d3c2c2810b89 service swift] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:31.075472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-349f53e8-6c4d-4b08-bea5-d3c2c2810b89 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:31.126504 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f53e8-6c4d-4b08-bea5-d3c2c2810b89 service swift] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:31.132130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:31.271888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9f311-25e4-45d2-9056-149eb16f4a0d admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:31.286499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d784d-cd27-473d-86bc-e05e63b984de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:31.287496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d784d-cd27-473d-86bc-e05e63b984de admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:31.287928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d784d-cd27-473d-86bc-e05e63b984de admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:31.288352 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d784d-cd27-473d-86bc-e05e63b984de admin admin] PATH_INFO: `/v3/projects/25d72d58ee794d39be199a1ccd429490/users/76b0cf8ddea4409baa8ddbd1de44d5e0/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:31.293625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1d61f-a58c-4274-8e87-050a0f952670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:31.293936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d784d-cd27-473d-86bc-e05e63b984de admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d72d58ee794d39be199a1ccd429490, user_id=76b0cf8ddea4409baa8ddbd1de44d5e0, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:31.294318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1d61f-a58c-4274-8e87-050a0f952670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:31.294598 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1d61f-a58c-4274-8e87-050a0f952670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:31.296989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1d61f-a58c-4274-8e87-050a0f952670 admin admin] PATH_INFO: `/v3/users/44405bda057e4720b1c4ea87dd71b761` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:31.297297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d784d-cd27-473d-86bc-e05e63b984de admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:31.302227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1d61f-a58c-4274-8e87-050a0f952670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44405bda057e4720b1c4ea87dd71b761)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:31.307387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1d61f-a58c-4274-8e87-050a0f952670 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:31.327221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 894/1786] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:31 2022] PUT /identity/v3/projects/25d72d58ee794d39be199a1ccd429490/users/76b0cf8ddea4409baa8ddbd1de44d5e0/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:31.328415 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d784d-cd27-473d-86bc-e05e63b984de admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:31.339333 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-480d784d-cd27-473d-86bc-e05e63b984de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:31.454982 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:31.474683 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d2b1d61f-a58c-4274-8e87-050a0f952670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44405bda057e4720b1c4ea87dd71b761'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:31.490614 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d2b1d61f-a58c-4274-8e87-050a0f952670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44405bda057e4720b1c4ea87dd71b761'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:31.514190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d2b1d61f-a58c-4274-8e87-050a0f952670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44405bda057e4720b1c4ea87dd71b761'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:31.514190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d2b1d61f-a58c-4274-8e87-050a0f952670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44405bda057e4720b1c4ea87dd71b761'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:31.536195 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d2b1d61f-a58c-4274-8e87-050a0f952670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44405bda057e4720b1c4ea87dd71b761'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:31.537453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d784d-cd27-473d-86bc-e05e63b984de admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:31.550304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 893/1787] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:31 2022] DELETE /identity/v3/users/44405bda057e4720b1c4ea87dd71b761 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:31.550304 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1d61f-a58c-4274-8e87-050a0f952670 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:31.553440 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ffff2-ec47-423f-8f43-c739217aa1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:31.553582 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d2b1d61f-a58c-4274-8e87-050a0f952670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:31.554103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ffff2-ec47-423f-8f43-c739217aa1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:31.554387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ffff2-ec47-423f-8f43-c739217aa1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:31.554685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ffff2-ec47-423f-8f43-c739217aa1b8 admin admin] PATH_INFO: `/v3/users/9adbd11a9c6e498d9737f64eda239741` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:31.557112 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ffff2-ec47-423f-8f43-c739217aa1b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9adbd11a9c6e498d9737f64eda239741)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:31.559427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ffff2-ec47-423f-8f43-c739217aa1b8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:31.700969 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c95ffff2-ec47-423f-8f43-c739217aa1b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9adbd11a9c6e498d9737f64eda239741'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:31.734302 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c95ffff2-ec47-423f-8f43-c739217aa1b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9adbd11a9c6e498d9737f64eda239741'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:31.737293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1d61f-a58c-4274-8e87-050a0f952670 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:31.743274 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c95ffff2-ec47-423f-8f43-c739217aa1b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9adbd11a9c6e498d9737f64eda239741'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:31.754901 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a61fa8-3acf-4507-89d3-b72d729a1d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:31.755529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a61fa8-3acf-4507-89d3-b72d729a1d74 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:31.755813 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a61fa8-3acf-4507-89d3-b72d729a1d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:31.757975 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a61fa8-3acf-4507-89d3-b72d729a1d74 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:31.758663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a61fa8-3acf-4507-89d3-b72d729a1d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:31.765265 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a61fa8-3acf-4507-89d3-b72d729a1d74 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:31.803729 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c95ffff2-ec47-423f-8f43-c739217aa1b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9adbd11a9c6e498d9737f64eda239741'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:31.821402 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 894/1788] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:31 2022] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:31.822129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92cd3c-cfe1-4837-9c78-d15736d7dfec None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:31.825322 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92cd3c-cfe1-4837-9c78-d15736d7dfec None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:31.826265 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c95ffff2-ec47-423f-8f43-c739217aa1b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9adbd11a9c6e498d9737f64eda239741'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:31.827936 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92cd3c-cfe1-4837-9c78-d15736d7dfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:31.840826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 895/1789] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:31 2022] DELETE /identity/v3/users/9adbd11a9c6e498d9737f64eda239741 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:31.840826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf7807-7be0-45de-95b8-dc1c1b6f08aa None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:31.840826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf7807-7be0-45de-95b8-dc1c1b6f08aa None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:31.840826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf7807-7be0-45de-95b8-dc1c1b6f08aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:31.907188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-cddf7807-7be0-45de-95b8-dc1c1b6f08aa None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:31.910056 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cddf7807-7be0-45de-95b8-dc1c1b6f08aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:31.911725 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8d92cd3c-cfe1-4837-9c78-d15736d7dfec None None] MFA Rules not processed for user `76b0cf8ddea4409baa8ddbd1de44d5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:31.916333 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8d92cd3c-cfe1-4837-9c78-d15736d7dfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:32.055212 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:32.108811 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 896/1790] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:32.108811 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf7807-7be0-45de-95b8-dc1c1b6f08aa None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:32.126143 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 895/1791] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:32.126334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cddf7807-7be0-45de-95b8-dc1c1b6f08aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:32.130157 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92cd3c-cfe1-4837-9c78-d15736d7dfec None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:32.132086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8d92cd3c-cfe1-4837-9c78-d15736d7dfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:32.162906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf7807-7be0-45de-95b8-dc1c1b6f08aa None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:32.183629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b03547-f6f4-44e3-a97a-1c1c7b240a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:32.184314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b03547-f6f4-44e3-a97a-1c1c7b240a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:32.185022 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b03547-f6f4-44e3-a97a-1c1c7b240a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:32.185446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b03547-f6f4-44e3-a97a-1c1c7b240a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:32.186113 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b03547-f6f4-44e3-a97a-1c1c7b240a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:32.189227 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b03547-f6f4-44e3-a97a-1c1c7b240a35 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:32.205788 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 897/1792] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:32.205788 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b03547-f6f4-44e3-a97a-1c1c7b240a35 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:32.208166 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-53b03547-f6f4-44e3-a97a-1c1c7b240a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:32.248817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:32.310012 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92cd3c-cfe1-4837-9c78-d15736d7dfec None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:32.317915 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f994ac2-859b-4a0a-9f5b-f3a3b1720c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:32.319025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f994ac2-859b-4a0a-9f5b-f3a3b1720c3d service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:32.319461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f994ac2-859b-4a0a-9f5b-f3a3b1720c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:32.319837 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f994ac2-859b-4a0a-9f5b-f3a3b1720c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:32.339168 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f994ac2-859b-4a0a-9f5b-f3a3b1720c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:32.341960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f994ac2-859b-4a0a-9f5b-f3a3b1720c3d service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:32.368660 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b03547-f6f4-44e3-a97a-1c1c7b240a35 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:32.375086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5717c-bd55-4e12-bb06-20748128374d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:32.377147 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5717c-bd55-4e12-bb06-20748128374d service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:32.377856 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5717c-bd55-4e12-bb06-20748128374d service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:32.379132 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5717c-bd55-4e12-bb06-20748128374d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:32.381018 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 896/1793] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:32.381890 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f994ac2-859b-4a0a-9f5b-f3a3b1720c3d service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:32.398345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f994ac2-859b-4a0a-9f5b-f3a3b1720c3d service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:32.411456 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98d166-0da1-4aca-889c-3deeba33e95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:32.412089 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98d166-0da1-4aca-889c-3deeba33e95c admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:32.412374 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98d166-0da1-4aca-889c-3deeba33e95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:32.412651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98d166-0da1-4aca-889c-3deeba33e95c admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:32.413311 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98d166-0da1-4aca-889c-3deeba33e95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:32.415272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5717c-bd55-4e12-bb06-20748128374d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:32.417237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98d166-0da1-4aca-889c-3deeba33e95c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:32.419608 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5717c-bd55-4e12-bb06-20748128374d service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:32.438896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 898/1794] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:32.446281 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 897/1795] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:32.451291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5717c-bd55-4e12-bb06-20748128374d service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:32.494938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5717c-bd55-4e12-bb06-20748128374d service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:32.521403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca6150-3145-466b-83ad-55a8f3572b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:32.522270 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca6150-3145-466b-83ad-55a8f3572b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:32.523828 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca6150-3145-466b-83ad-55a8f3572b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:32.524159 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca6150-3145-466b-83ad-55a8f3572b98 admin admin] PATH_INFO: `/v3/projects/a49c8d8451f046639b9531b0fed6512a/users/57d12e1b426943138235ff54f122db31/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:32.544196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22b2e4-b7ac-418a-b2be-94168254de7a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:32.544753 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22b2e4-b7ac-418a-b2be-94168254de7a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:32.545191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22b2e4-b7ac-418a-b2be-94168254de7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:32.567147 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca6150-3145-466b-83ad-55a8f3572b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49c8d8451f046639b9531b0fed6512a, user_id=57d12e1b426943138235ff54f122db31, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:32.570470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca6150-3145-466b-83ad-55a8f3572b98 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:32.584871 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ec22b2e4-b7ac-418a-b2be-94168254de7a None None] MFA Rules not processed for user `e94f9a63cb4847c6916a84735d00b48f`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:32.586094 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ec22b2e4-b7ac-418a-b2be-94168254de7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:32.602555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 899/1796] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:32 2022] PUT /identity/v3/projects/a49c8d8451f046639b9531b0fed6512a/users/57d12e1b426943138235ff54f122db31/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:32.617738 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd5334-8131-4bd2-811c-aae309f572b4 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:32.618374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd5334-8131-4bd2-811c-aae309f572b4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:32.618985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd5334-8131-4bd2-811c-aae309f572b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:32.691247 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8dbd5334-8131-4bd2-811c-aae309f572b4 None None] MFA Rules not processed for user `57d12e1b426943138235ff54f122db31`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:32.693340 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8dbd5334-8131-4bd2-811c-aae309f572b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:32.734330 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 898/1797] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Sep 27 04:20:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:32.735521 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22b2e4-b7ac-418a-b2be-94168254de7a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:32.870969 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22b2e4-b7ac-418a-b2be-94168254de7a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:32.879391 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4f892-f0f2-400d-8055-2c848e042b59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:32.880028 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4f892-f0f2-400d-8055-2c848e042b59 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:32.880310 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4f892-f0f2-400d-8055-2c848e042b59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:32.880583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4f892-f0f2-400d-8055-2c848e042b59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:32.887973 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-80a4f892-f0f2-400d-8055-2c848e042b59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:32.911043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 900/1798] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:32.914490 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd5334-8131-4bd2-811c-aae309f572b4 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:33.029518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:33.044498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4f892-f0f2-400d-8055-2c848e042b59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:33.049207 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4f892-f0f2-400d-8055-2c848e042b59 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:33.091119 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 899/1799] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:33.094126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4f892-f0f2-400d-8055-2c848e042b59 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:33.099206 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-80a4f892-f0f2-400d-8055-2c848e042b59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:33.129964 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4f892-f0f2-400d-8055-2c848e042b59 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:33.144000 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9ea70-60dd-4c11-94d0-3e8433760d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:33.144701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9ea70-60dd-4c11-94d0-3e8433760d76 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:33.144988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9ea70-60dd-4c11-94d0-3e8433760d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:33.145318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9ea70-60dd-4c11-94d0-3e8433760d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:33.165078 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9ea70-60dd-4c11-94d0-3e8433760d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:33.168943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9ea70-60dd-4c11-94d0-3e8433760d76 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:33.170298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd5334-8131-4bd2-811c-aae309f572b4 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:33.187707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d5c00-c235-4bef-a5bb-db78fd47129c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:33.189047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d5c00-c235-4bef-a5bb-db78fd47129c admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:33.189047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d5c00-c235-4bef-a5bb-db78fd47129c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:33.189047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d5c00-c235-4bef-a5bb-db78fd47129c admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:33.190591 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d5c00-c235-4bef-a5bb-db78fd47129c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:33.200706 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d5c00-c235-4bef-a5bb-db78fd47129c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:33.203091 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 900/1800] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:33.289508 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 901/1801] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:32 2022] POST /identity/v3/projects => generated 379 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:33.294027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9ea70-60dd-4c11-94d0-3e8433760d76 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:33.320035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9ea70-60dd-4c11-94d0-3e8433760d76 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:33.360865 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:33.542413 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c050d5-b775-49b2-8575-08e69577a57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:33.543530 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c050d5-b775-49b2-8575-08e69577a57e admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:33.543987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c050d5-b775-49b2-8575-08e69577a57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:33.544514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c050d5-b775-49b2-8575-08e69577a57e admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:33.545323 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c050d5-b775-49b2-8575-08e69577a57e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:33.547854 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c050d5-b775-49b2-8575-08e69577a57e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:33.609120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 901/1802] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:33 2022] POST /identity/v3/users => generated 296 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:33.613417 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d5c00-c235-4bef-a5bb-db78fd47129c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:33.648678 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d5c00-c235-4bef-a5bb-db78fd47129c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:33.664860 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a0094-4e1c-4980-9cae-04c0ae274068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:33.665936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a0094-4e1c-4980-9cae-04c0ae274068 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:33.675511 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a0094-4e1c-4980-9cae-04c0ae274068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:33.675895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a0094-4e1c-4980-9cae-04c0ae274068 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:33.682327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a0094-4e1c-4980-9cae-04c0ae274068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:33.684428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a0094-4e1c-4980-9cae-04c0ae274068 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:33.702417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b5037-8c0f-4487-97b0-c751bd1f6600 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:33.703180 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b5037-8c0f-4487-97b0-c751bd1f6600 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:33.703180 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b5037-8c0f-4487-97b0-c751bd1f6600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:33.740180 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 902/1803] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:33.744835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a0094-4e1c-4980-9cae-04c0ae274068 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:33.773116 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-a52b5037-8c0f-4487-97b0-c751bd1f6600 None None] MFA Rules not processed for user `36c0cb5c49fc4756930a9af1244e60a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:33.774369 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a52b5037-8c0f-4487-97b0-c751bd1f6600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:33.790977 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a0094-4e1c-4980-9cae-04c0ae274068 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:33.810262 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c34d9-2e45-4d94-9a63-b68661c7ab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:33.811082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c34d9-2e45-4d94-9a63-b68661c7ab66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:33.811399 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c34d9-2e45-4d94-9a63-b68661c7ab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:33.811727 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c34d9-2e45-4d94-9a63-b68661c7ab66 admin admin] PATH_INFO: `/v3/projects/1e3f6db016654a2487df9e1b3b94b69c/users/568f80b1d9e54b8e86080204744abfee/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:33.864823 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c34d9-2e45-4d94-9a63-b68661c7ab66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3f6db016654a2487df9e1b3b94b69c, user_id=568f80b1d9e54b8e86080204744abfee, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:33.867633 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c34d9-2e45-4d94-9a63-b68661c7ab66 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:33.910851 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 903/1804] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:33 2022] PUT /identity/v3/projects/1e3f6db016654a2487df9e1b3b94b69c/users/568f80b1d9e54b8e86080204744abfee/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:33.912943 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c34d9-2e45-4d94-9a63-b68661c7ab66 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:33.976804 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 902/1805] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:34.097833 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c34d9-2e45-4d94-9a63-b68661c7ab66 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:34.113081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4dbe6-c212-4b2a-a5b4-e5bd87701bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:34.113862 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4dbe6-c212-4b2a-a5b4-e5bd87701bbf admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:34.114222 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4dbe6-c212-4b2a-a5b4-e5bd87701bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:34.114575 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4dbe6-c212-4b2a-a5b4-e5bd87701bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:34.117725 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4dbe6-c212-4b2a-a5b4-e5bd87701bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:34.124082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4dbe6-c212-4b2a-a5b4-e5bd87701bbf admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:34.148719 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 904/1806] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:20:34.149702 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b5037-8c0f-4487-97b0-c751bd1f6600 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:34.169199 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b5037-8c0f-4487-97b0-c751bd1f6600 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:34.196435 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934ecbf-f478-44b7-87fb-b68b1126a274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:34.197307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934ecbf-f478-44b7-87fb-b68b1126a274 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:34.197708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934ecbf-f478-44b7-87fb-b68b1126a274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:34.198103 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934ecbf-f478-44b7-87fb-b68b1126a274 admin admin] PATH_INFO: `/v3/projects/1e3f6db016654a2487df9e1b3b94b69c/users/568f80b1d9e54b8e86080204744abfee/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:34.200397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934ecbf-f478-44b7-87fb-b68b1126a274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3f6db016654a2487df9e1b3b94b69c, user_id=568f80b1d9e54b8e86080204744abfee, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:34.203414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934ecbf-f478-44b7-87fb-b68b1126a274 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:34.229419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 903/1807] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:34 2022] PUT /identity/v3/projects/1e3f6db016654a2487df9e1b3b94b69c/users/568f80b1d9e54b8e86080204744abfee/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:34.241214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa796adf-6416-4ebc-8ab2-01b50dc3d15b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:34.241483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa796adf-6416-4ebc-8ab2-01b50dc3d15b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:34.241767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa796adf-6416-4ebc-8ab2-01b50dc3d15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:34.307714 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-fa796adf-6416-4ebc-8ab2-01b50dc3d15b None None] MFA Rules not processed for user `568f80b1d9e54b8e86080204744abfee`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:34.309003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fa796adf-6416-4ebc-8ab2-01b50dc3d15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:34.511279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 905/1808] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:34.525146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934ecbf-f478-44b7-87fb-b68b1126a274 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:34.527023 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d934ecbf-f478-44b7-87fb-b68b1126a274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:34.687861 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934ecbf-f478-44b7-87fb-b68b1126a274 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:34.704899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77104ec-4650-432d-8704-47fcdce9eeda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:34.706300 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77104ec-4650-432d-8704-47fcdce9eeda service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:34.706637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77104ec-4650-432d-8704-47fcdce9eeda service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:34.706897 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77104ec-4650-432d-8704-47fcdce9eeda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:34.723675 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77104ec-4650-432d-8704-47fcdce9eeda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:34.725167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77104ec-4650-432d-8704-47fcdce9eeda service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:34.748009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 904/1809] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:34.842898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa796adf-6416-4ebc-8ab2-01b50dc3d15b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:34.860945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa796adf-6416-4ebc-8ab2-01b50dc3d15b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:34.879026 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf73d3-11ec-4897-9c14-b1cb931cf2ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:34.886471 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf73d3-11ec-4897-9c14-b1cb931cf2ca service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:34.887799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf73d3-11ec-4897-9c14-b1cb931cf2ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:34.887799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf73d3-11ec-4897-9c14-b1cb931cf2ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:34.893075 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-becf73d3-11ec-4897-9c14-b1cb931cf2ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:34.923151 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:35.151994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77104ec-4650-432d-8704-47fcdce9eeda service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:35.153594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f77104ec-4650-432d-8704-47fcdce9eeda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:35.154399 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf73d3-11ec-4897-9c14-b1cb931cf2ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:35.156025 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf73d3-11ec-4897-9c14-b1cb931cf2ca service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:35.215274 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 906/1810] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:35.302015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:35.414407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77104ec-4650-432d-8704-47fcdce9eeda service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:35.440957 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701200a-3ce2-449a-8380-58a21f1b3a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:35.447841 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701200a-3ce2-449a-8380-58a21f1b3a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:35.449002 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701200a-3ce2-449a-8380-58a21f1b3a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:35.449657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701200a-3ce2-449a-8380-58a21f1b3a61 admin admin] PATH_INFO: `/v3/projects/abd2630ad9224d26a16cf6d7e637ef41` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:35.452757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701200a-3ce2-449a-8380-58a21f1b3a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd2630ad9224d26a16cf6d7e637ef41)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:35.457895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701200a-3ce2-449a-8380-58a21f1b3a61 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:35.638459 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e701200a-3ce2-449a-8380-58a21f1b3a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd2630ad9224d26a16cf6d7e637ef41', 'request_id': 'req-e701200a-3ce2-449a-8380-58a21f1b3a61'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:35.660950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e701200a-3ce2-449a-8380-58a21f1b3a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd2630ad9224d26a16cf6d7e637ef41', 'request_id': 'req-e701200a-3ce2-449a-8380-58a21f1b3a61'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:35.683123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e701200a-3ce2-449a-8380-58a21f1b3a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd2630ad9224d26a16cf6d7e637ef41', 'request_id': 'req-e701200a-3ce2-449a-8380-58a21f1b3a61'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:35.725007 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e701200a-3ce2-449a-8380-58a21f1b3a61 admin admin] The token cache is being invalidate because project abd2630ad9224d26a16cf6d7e637ef41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:35.726456 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e701200a-3ce2-449a-8380-58a21f1b3a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:35.728968 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e701200a-3ce2-449a-8380-58a21f1b3a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:35.739595 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 905/1811] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:35 2022] DELETE /identity/v3/projects/abd2630ad9224d26a16cf6d7e637ef41 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:35.741140 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf73d3-11ec-4897-9c14-b1cb931cf2ca service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:35.756274 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf73d3-11ec-4897-9c14-b1cb931cf2ca service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:35.910403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9d0f4-ec4e-44b9-bc12-b5f775e0d68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:35.911153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9d0f4-ec4e-44b9-bc12-b5f775e0d68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:35.911281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9d0f4-ec4e-44b9-bc12-b5f775e0d68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:35.911722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9d0f4-ec4e-44b9-bc12-b5f775e0d68c admin admin] PATH_INFO: `/v3/users/12bb3529163c47c0a51d97681ec7a38d` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:35.913052 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9d0f4-ec4e-44b9-bc12-b5f775e0d68c admin admin] RBAC: Authorizing `identity:delete_user(user_id=12bb3529163c47c0a51d97681ec7a38d)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:35.915199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9d0f4-ec4e-44b9-bc12-b5f775e0d68c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:35.949581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701200a-3ce2-449a-8380-58a21f1b3a61 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:35.951640 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e701200a-3ce2-449a-8380-58a21f1b3a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:35.989877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701200a-3ce2-449a-8380-58a21f1b3a61 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:36.008865 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada6cd3-b729-4426-a4cf-949b7a451f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:36.011281 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada6cd3-b729-4426-a4cf-949b7a451f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:36.013527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada6cd3-b729-4426-a4cf-949b7a451f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:36.015328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada6cd3-b729-4426-a4cf-949b7a451f2b admin admin] PATH_INFO: `/v3/projects/b372c8724d6f458c8a5ffd8d12eaaff3` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:36.021652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada6cd3-b729-4426-a4cf-949b7a451f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b372c8724d6f458c8a5ffd8d12eaaff3)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:36.031051 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada6cd3-b729-4426-a4cf-949b7a451f2b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:36.035125 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b2c9d0f4-ec4e-44b9-bc12-b5f775e0d68c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12bb3529163c47c0a51d97681ec7a38d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:36.066986 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b2c9d0f4-ec4e-44b9-bc12-b5f775e0d68c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12bb3529163c47c0a51d97681ec7a38d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:36.070564 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b2c9d0f4-ec4e-44b9-bc12-b5f775e0d68c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12bb3529163c47c0a51d97681ec7a38d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:36.118321 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b2c9d0f4-ec4e-44b9-bc12-b5f775e0d68c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12bb3529163c47c0a51d97681ec7a38d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:36.145419 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b2c9d0f4-ec4e-44b9-bc12-b5f775e0d68c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12bb3529163c47c0a51d97681ec7a38d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:36.154502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 907/1812] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:35 2022] DELETE /identity/v3/users/12bb3529163c47c0a51d97681ec7a38d => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:36.310514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0ada6cd3-b729-4426-a4cf-949b7a451f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b372c8724d6f458c8a5ffd8d12eaaff3', 'request_id': 'req-0ada6cd3-b729-4426-a4cf-949b7a451f2b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:36.326187 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0ada6cd3-b729-4426-a4cf-949b7a451f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b372c8724d6f458c8a5ffd8d12eaaff3', 'request_id': 'req-0ada6cd3-b729-4426-a4cf-949b7a451f2b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:36.343771 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0ada6cd3-b729-4426-a4cf-949b7a451f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b372c8724d6f458c8a5ffd8d12eaaff3', 'request_id': 'req-0ada6cd3-b729-4426-a4cf-949b7a451f2b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:36.376739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0ada6cd3-b729-4426-a4cf-949b7a451f2b admin admin] The token cache is being invalidate because project b372c8724d6f458c8a5ffd8d12eaaff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:36.376942 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0ada6cd3-b729-4426-a4cf-949b7a451f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:36.378601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0ada6cd3-b729-4426-a4cf-949b7a451f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:36.381689 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 906/1813] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:35 2022] DELETE /identity/v3/projects/b372c8724d6f458c8a5ffd8d12eaaff3 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:20:36.387769 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5837a-4408-48f3-87fc-d2b89ad1ecd9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:36.388260 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5837a-4408-48f3-87fc-d2b89ad1ecd9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:36.388560 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5837a-4408-48f3-87fc-d2b89ad1ecd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:36.430148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-bea5837a-4408-48f3-87fc-d2b89ad1ecd9 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:36.431557 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-bea5837a-4408-48f3-87fc-d2b89ad1ecd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:36.478975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:36.521603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178607d-f173-4658-b808-44f972d949d4 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:36.522131 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178607d-f173-4658-b808-44f972d949d4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:36.522835 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178607d-f173-4658-b808-44f972d949d4 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:36.524663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 907/1814] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 27 04:20:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:20:36.564577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 908/1815] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:36.573548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96367e90-af8d-41f3-a2a0-7938757a87f4 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:36.574277 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96367e90-af8d-41f3-a2a0-7938757a87f4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:36.575724 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96367e90-af8d-41f3-a2a0-7938757a87f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:36.616743 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-96367e90-af8d-41f3-a2a0-7938757a87f4 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:36.621121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-96367e90-af8d-41f3-a2a0-7938757a87f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:36.646813 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 908/1816] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:36.650380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5837a-4408-48f3-87fc-d2b89ad1ecd9 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:36.662254 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5837a-4408-48f3-87fc-d2b89ad1ecd9 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:36.676738 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb10a8c-d04c-41d1-be8c-005d3bfb40f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:36.677521 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb10a8c-d04c-41d1-be8c-005d3bfb40f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:36.677910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb10a8c-d04c-41d1-be8c-005d3bfb40f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:36.678388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb10a8c-d04c-41d1-be8c-005d3bfb40f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:36.679222 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb10a8c-d04c-41d1-be8c-005d3bfb40f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:36.680387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb10a8c-d04c-41d1-be8c-005d3bfb40f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:36.688352 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb10a8c-d04c-41d1-be8c-005d3bfb40f4 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:36.708317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77dcfa-2018-4d3e-8477-12b3542248cf None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:36.708757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77dcfa-2018-4d3e-8477-12b3542248cf None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:36.709155 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77dcfa-2018-4d3e-8477-12b3542248cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:36.741663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 909/1817] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:36.742896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb10a8c-d04c-41d1-be8c-005d3bfb40f4 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:36.755501 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-7c77dcfa-2018-4d3e-8477-12b3542248cf None None] MFA Rules not processed for user `3960d52dee8443cf9ec8930a389a7b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:36.764596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7c77dcfa-2018-4d3e-8477-12b3542248cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:36.773504 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb10a8c-d04c-41d1-be8c-005d3bfb40f4 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:36.793994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101fcb9-1df0-47bf-bb87-d12f9ae491a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:36.802873 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101fcb9-1df0-47bf-bb87-d12f9ae491a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:36.803567 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101fcb9-1df0-47bf-bb87-d12f9ae491a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:36.805075 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101fcb9-1df0-47bf-bb87-d12f9ae491a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:36.805823 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101fcb9-1df0-47bf-bb87-d12f9ae491a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:36.808708 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101fcb9-1df0-47bf-bb87-d12f9ae491a9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:36.909549 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:36.929551 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 910/1818] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:36 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:36.934146 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101fcb9-1df0-47bf-bb87-d12f9ae491a9 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:36.991993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 909/1819] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 27 04:20:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:37.114387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101fcb9-1df0-47bf-bb87-d12f9ae491a9 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:37.135037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3303b84-7252-4ef2-8337-8544c08b0b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:37.141321 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3303b84-7252-4ef2-8337-8544c08b0b6a admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:37.141940 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3303b84-7252-4ef2-8337-8544c08b0b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:37.142407 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3303b84-7252-4ef2-8337-8544c08b0b6a admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:37.146534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3303b84-7252-4ef2-8337-8544c08b0b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:37.152844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3303b84-7252-4ef2-8337-8544c08b0b6a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:37.248177 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 911/1820] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:36 2022] POST /identity/v3/users => generated 294 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:37.252082 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77dcfa-2018-4d3e-8477-12b3542248cf None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:37.272593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77dcfa-2018-4d3e-8477-12b3542248cf None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:37.283019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354231c8-93af-4bb6-bffc-1381479063cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:37.285793 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354231c8-93af-4bb6-bffc-1381479063cd admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:37.286700 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354231c8-93af-4bb6-bffc-1381479063cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:37.287286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354231c8-93af-4bb6-bffc-1381479063cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:37.288291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354231c8-93af-4bb6-bffc-1381479063cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:37.290441 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354231c8-93af-4bb6-bffc-1381479063cd admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:37.318638 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 910/1821] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:37.322061 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3303b84-7252-4ef2-8337-8544c08b0b6a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:37.336771 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3303b84-7252-4ef2-8337-8544c08b0b6a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:37.350989 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6336743-cdfb-4422-9752-c9197aae669f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:37.351897 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6336743-cdfb-4422-9752-c9197aae669f admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:37.355480 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6336743-cdfb-4422-9752-c9197aae669f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:37.355984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6336743-cdfb-4422-9752-c9197aae669f admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:37.357149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6336743-cdfb-4422-9752-c9197aae669f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:37.359164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6336743-cdfb-4422-9752-c9197aae669f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:37.388568 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 912/1822] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:37.392820 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354231c8-93af-4bb6-bffc-1381479063cd admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:37.420871 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354231c8-93af-4bb6-bffc-1381479063cd admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:37.436846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d634e6-4b97-45b3-8e09-374cbd952200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:37.437631 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d634e6-4b97-45b3-8e09-374cbd952200 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:37.437983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d634e6-4b97-45b3-8e09-374cbd952200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:37.438326 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d634e6-4b97-45b3-8e09-374cbd952200 admin admin] PATH_INFO: `/v3/projects/949dda71a61a4b4ca8a03a64d1240f77/users/0884862560124bfcacfb175bd681a197/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:37.501990 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d634e6-4b97-45b3-8e09-374cbd952200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=949dda71a61a4b4ca8a03a64d1240f77, user_id=0884862560124bfcacfb175bd681a197, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:37.504405 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d634e6-4b97-45b3-8e09-374cbd952200 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:37.526812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 911/1823] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:37 2022] PUT /identity/v3/projects/949dda71a61a4b4ca8a03a64d1240f77/users/0884862560124bfcacfb175bd681a197/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:37.541545 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ee8cc-5567-450a-91bc-b1cc5670dab6 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:37.542055 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ee8cc-5567-450a-91bc-b1cc5670dab6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:37.542486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ee8cc-5567-450a-91bc-b1cc5670dab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:37.604619 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-628ee8cc-5567-450a-91bc-b1cc5670dab6 None None] MFA Rules not processed for user `0884862560124bfcacfb175bd681a197`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:37.604619 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-628ee8cc-5567-450a-91bc-b1cc5670dab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:37.808873 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 913/1824] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:37.813542 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d634e6-4b97-45b3-8e09-374cbd952200 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:37.981476 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d634e6-4b97-45b3-8e09-374cbd952200 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:37.995054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9edb36-74e5-4d90-ac58-139c0d3d0b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:37.996059 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9edb36-74e5-4d90-ac58-139c0d3d0b8d admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:37.996517 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9edb36-74e5-4d90-ac58-139c0d3d0b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:37.996938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9edb36-74e5-4d90-ac58-139c0d3d0b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:37.997742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9edb36-74e5-4d90-ac58-139c0d3d0b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:37.999895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9edb36-74e5-4d90-ac58-139c0d3d0b8d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:38.057532 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 912/1825] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:37 2022] POST /identity/v3/projects => generated 383 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:38.062563 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ee8cc-5567-450a-91bc-b1cc5670dab6 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:38.069426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:38.088046 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ee8cc-5567-450a-91bc-b1cc5670dab6 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:38.359785 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82e31a-76f5-411d-9ad1-62dbd98550eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:38.362503 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82e31a-76f5-411d-9ad1-62dbd98550eb admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:38.363277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82e31a-76f5-411d-9ad1-62dbd98550eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:38.364068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82e31a-76f5-411d-9ad1-62dbd98550eb admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:38.365598 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82e31a-76f5-411d-9ad1-62dbd98550eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:38.371088 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82e31a-76f5-411d-9ad1-62dbd98550eb admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:38.487174 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9edb36-74e5-4d90-ac58-139c0d3d0b8d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:38.492577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 914/1826] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:38 2022] POST /identity/v3/users => generated 292 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:38.505449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9edb36-74e5-4d90-ac58-139c0d3d0b8d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:38.530569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c05350-4274-4854-b9a8-4ec373fd2128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:38.531237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c05350-4274-4854-b9a8-4ec373fd2128 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:38.536097 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c05350-4274-4854-b9a8-4ec373fd2128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:38.536453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c05350-4274-4854-b9a8-4ec373fd2128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:38.537177 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c05350-4274-4854-b9a8-4ec373fd2128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:38.551647 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c05350-4274-4854-b9a8-4ec373fd2128 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:38.603487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82e31a-76f5-411d-9ad1-62dbd98550eb admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:38.608702 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 913/1827] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:38.620662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82e31a-76f5-411d-9ad1-62dbd98550eb admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:38.656107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8d2f7-a43d-41bc-833c-2ad6b2aacfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:38.657002 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8d2f7-a43d-41bc-833c-2ad6b2aacfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:38.663775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8d2f7-a43d-41bc-833c-2ad6b2aacfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:38.664430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8d2f7-a43d-41bc-833c-2ad6b2aacfc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:38.667498 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8d2f7-a43d-41bc-833c-2ad6b2aacfc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:38.669480 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8d2f7-a43d-41bc-833c-2ad6b2aacfc1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:38.739281 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c05350-4274-4854-b9a8-4ec373fd2128 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:38.756513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c05350-4274-4854-b9a8-4ec373fd2128 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:38.759972 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 915/1828] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:20:38.775597 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af0a20-1394-4bb8-bff5-a39ef3643629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:38.777430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af0a20-1394-4bb8-bff5-a39ef3643629 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:38.780246 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af0a20-1394-4bb8-bff5-a39ef3643629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:38.781348 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af0a20-1394-4bb8-bff5-a39ef3643629 admin admin] PATH_INFO: `/v3/projects/ce5af5510b854f1f8ba15f55086840d5/users/748efba2269a441a99f98537b9889e3c/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:38.881988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af0a20-1394-4bb8-bff5-a39ef3643629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5af5510b854f1f8ba15f55086840d5, user_id=748efba2269a441a99f98537b9889e3c, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:38.884820 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af0a20-1394-4bb8-bff5-a39ef3643629 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:38.935000 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 914/1829] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:38 2022] PUT /identity/v3/projects/ce5af5510b854f1f8ba15f55086840d5/users/748efba2269a441a99f98537b9889e3c/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:20:38.950217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e099f-0573-4206-8f9e-7351c0bcbd07 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:38.950667 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e099f-0573-4206-8f9e-7351c0bcbd07 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:38.951039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e099f-0573-4206-8f9e-7351c0bcbd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:39.054995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-860e099f-0573-4206-8f9e-7351c0bcbd07 None None] MFA Rules not processed for user `748efba2269a441a99f98537b9889e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:39.056787 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-860e099f-0573-4206-8f9e-7351c0bcbd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:39.152383 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af0a20-1394-4bb8-bff5-a39ef3643629 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:39.154127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b6af0a20-1394-4bb8-bff5-a39ef3643629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:39.277944 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 916/1830] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:39.294284 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f8da1-d1f3-4142-841b-af1fd8a05e6d None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:39.296530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f8da1-d1f3-4142-841b-af1fd8a05e6d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:39.297239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f8da1-d1f3-4142-841b-af1fd8a05e6d None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:39.301546 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 917/1831] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 27 04:20:39 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:20:39.303440 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f8da1-d1f3-4142-841b-af1fd8a05e6d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:39.304890 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:39.372770 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af0a20-1394-4bb8-bff5-a39ef3643629 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:39.405502 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba2937-7658-4ab6-be99-6813a341c07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:39.406320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba2937-7658-4ab6-be99-6813a341c07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:39.406708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba2937-7658-4ab6-be99-6813a341c07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:39.408140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba2937-7658-4ab6-be99-6813a341c07a admin admin] PATH_INFO: `/v3/projects/e8cb1bb5088c4b13b592874ccd490fe0` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:39.412179 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba2937-7658-4ab6-be99-6813a341c07a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8cb1bb5088c4b13b592874ccd490fe0)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:39.414689 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba2937-7658-4ab6-be99-6813a341c07a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:39.576484 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f8da1-d1f3-4142-841b-af1fd8a05e6d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:39.602287 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-63ba2937-7658-4ab6-be99-6813a341c07a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8cb1bb5088c4b13b592874ccd490fe0', 'request_id': 'req-63ba2937-7658-4ab6-be99-6813a341c07a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:39.613461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-63ba2937-7658-4ab6-be99-6813a341c07a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8cb1bb5088c4b13b592874ccd490fe0', 'request_id': 'req-63ba2937-7658-4ab6-be99-6813a341c07a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:39.620301 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:39.634979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-63ba2937-7658-4ab6-be99-6813a341c07a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8cb1bb5088c4b13b592874ccd490fe0', 'request_id': 'req-63ba2937-7658-4ab6-be99-6813a341c07a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:39.663957 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-63ba2937-7658-4ab6-be99-6813a341c07a admin admin] The token cache is being invalidate because project e8cb1bb5088c4b13b592874ccd490fe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:39.664299 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-63ba2937-7658-4ab6-be99-6813a341c07a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:39.666833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-63ba2937-7658-4ab6-be99-6813a341c07a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:39.671642 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 915/1832] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:39 2022] DELETE /identity/v3/projects/e8cb1bb5088c4b13b592874ccd490fe0 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:39.675677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df693706-d9a8-41a0-9d98-d3ac9b47d182 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:39.676541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df693706-d9a8-41a0-9d98-d3ac9b47d182 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:39.677168 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df693706-d9a8-41a0-9d98-d3ac9b47d182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:39.722521 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-df693706-d9a8-41a0-9d98-d3ac9b47d182 None None] MFA Rules not processed for user `3960d52dee8443cf9ec8930a389a7b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:39.724123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-df693706-d9a8-41a0-9d98-d3ac9b47d182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:39.795591 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1298d0d-9e3b-43a0-b803-3beeb840ffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:39.796231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1298d0d-9e3b-43a0-b803-3beeb840ffc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:39.796514 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1298d0d-9e3b-43a0-b803-3beeb840ffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:39.796787 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1298d0d-9e3b-43a0-b803-3beeb840ffc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:39.797430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1298d0d-9e3b-43a0-b803-3beeb840ffc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:39.799484 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1298d0d-9e3b-43a0-b803-3beeb840ffc3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:39.867449 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 918/1833] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:39 2022] POST /identity/v3/projects => generated 387 bytes in 565 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:39.871447 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1298d0d-9e3b-43a0-b803-3beeb840ffc3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:39.873964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b1298d0d-9e3b-43a0-b803-3beeb840ffc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:39.923382 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 916/1834] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 27 04:20:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:39.924722 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc18a7a-8b09-458f-b84e-1393dac8094c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:39.925009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc18a7a-8b09-458f-b84e-1393dac8094c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:39.925295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc18a7a-8b09-458f-b84e-1393dac8094c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:39.972178 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8fc18a7a-8b09-458f-b84e-1393dac8094c None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:39.973578 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8fc18a7a-8b09-458f-b84e-1393dac8094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:40.067294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1298d0d-9e3b-43a0-b803-3beeb840ffc3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:40.084812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae3b32-8f72-4ecc-a42f-ee11bbd2cfa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:40.085531 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae3b32-8f72-4ecc-a42f-ee11bbd2cfa0 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:40.085752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae3b32-8f72-4ecc-a42f-ee11bbd2cfa0 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:40.086303 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae3b32-8f72-4ecc-a42f-ee11bbd2cfa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:40.097497 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d0ae3b32-8f72-4ecc-a42f-ee11bbd2cfa0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:40.115061 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae3b32-8f72-4ecc-a42f-ee11bbd2cfa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:40.116689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae3b32-8f72-4ecc-a42f-ee11bbd2cfa0 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:40.130092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 919/1835] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:40.131435 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae3b32-8f72-4ecc-a42f-ee11bbd2cfa0 service nova] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:40.133150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d0ae3b32-8f72-4ecc-a42f-ee11bbd2cfa0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:40.160031 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae3b32-8f72-4ecc-a42f-ee11bbd2cfa0 service nova] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:40.160376 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 917/1836] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:40.160376 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc18a7a-8b09-458f-b84e-1393dac8094c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:40.161544 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8fc18a7a-8b09-458f-b84e-1393dac8094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:40.166233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14b4d3-b094-4906-99ae-8052389f37f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:40.167124 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14b4d3-b094-4906-99ae-8052389f37f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:40.167609 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14b4d3-b094-4906-99ae-8052389f37f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:40.168082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14b4d3-b094-4906-99ae-8052389f37f3 admin admin] PATH_INFO: `/v3/users/9be7e33fdac7412998c278187575188d` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:40.170569 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14b4d3-b094-4906-99ae-8052389f37f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be7e33fdac7412998c278187575188d)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:40.176354 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14b4d3-b094-4906-99ae-8052389f37f3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:40.195328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc18a7a-8b09-458f-b84e-1393dac8094c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:40.201063 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fd417-dae5-464f-ba9b-883edd7737e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:40.202923 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fd417-dae5-464f-ba9b-883edd7737e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:40.203284 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fd417-dae5-464f-ba9b-883edd7737e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:40.203618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fd417-dae5-464f-ba9b-883edd7737e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:40.204337 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fd417-dae5-464f-ba9b-883edd7737e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:40.207733 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fd417-dae5-464f-ba9b-883edd7737e9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:40.224089 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:40.245884 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 918/1837] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:40 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:40.248472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83801450-baf6-40e1-b106-a4e72c768413 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:40.248472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83801450-baf6-40e1-b106-a4e72c768413 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:40.249447 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83801450-baf6-40e1-b106-a4e72c768413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:40.279364 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4c14b4d3-b094-4906-99ae-8052389f37f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be7e33fdac7412998c278187575188d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:40.289800 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4c14b4d3-b094-4906-99ae-8052389f37f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be7e33fdac7412998c278187575188d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:40.290900 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4c14b4d3-b094-4906-99ae-8052389f37f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be7e33fdac7412998c278187575188d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:40.295852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-83801450-baf6-40e1-b106-a4e72c768413 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:40.297585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-83801450-baf6-40e1-b106-a4e72c768413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:40.319354 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4c14b4d3-b094-4906-99ae-8052389f37f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be7e33fdac7412998c278187575188d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:40.326566 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 919/1838] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:40.327824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83801450-baf6-40e1-b106-a4e72c768413 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:40.330442 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-83801450-baf6-40e1-b106-a4e72c768413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:40.331670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4c14b4d3-b094-4906-99ae-8052389f37f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be7e33fdac7412998c278187575188d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:40.336277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:40.357116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 920/1839] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:40 2022] DELETE /identity/v3/users/9be7e33fdac7412998c278187575188d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:40.358509 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14b4d3-b094-4906-99ae-8052389f37f3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:40.360985 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83801450-baf6-40e1-b106-a4e72c768413 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:40.498907 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78505cf-8854-4c15-9f17-a7a4d73ffe53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:40.509532 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78505cf-8854-4c15-9f17-a7a4d73ffe53 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:40.510088 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78505cf-8854-4c15-9f17-a7a4d73ffe53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:40.510656 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78505cf-8854-4c15-9f17-a7a4d73ffe53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:40.511803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78505cf-8854-4c15-9f17-a7a4d73ffe53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:40.513919 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78505cf-8854-4c15-9f17-a7a4d73ffe53 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:40.532393 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 920/1840] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:40.535529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d2358-8f58-485d-be53-b7e5de6d3e85 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:40.536303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d2358-8f58-485d-be53-b7e5de6d3e85 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:40.536848 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d2358-8f58-485d-be53-b7e5de6d3e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:40.548809 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14b4d3-b094-4906-99ae-8052389f37f3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:40.566253 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391fbfb-6d69-4245-b0eb-868bca9fe871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:40.566963 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391fbfb-6d69-4245-b0eb-868bca9fe871 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:40.567520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391fbfb-6d69-4245-b0eb-868bca9fe871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:40.567807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391fbfb-6d69-4245-b0eb-868bca9fe871 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:40.568483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391fbfb-6d69-4245-b0eb-868bca9fe871 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:40.568792 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391fbfb-6d69-4245-b0eb-868bca9fe871 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:40.570457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391fbfb-6d69-4245-b0eb-868bca9fe871 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:40.579866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e38d2358-8f58-485d-be53-b7e5de6d3e85 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:40.581582 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e38d2358-8f58-485d-be53-b7e5de6d3e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:40.602478 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 921/1841] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:40.603460 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391fbfb-6d69-4245-b0eb-868bca9fe871 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:40.634494 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 921/1842] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:40.636240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d2358-8f58-485d-be53-b7e5de6d3e85 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:40.638354 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e38d2358-8f58-485d-be53-b7e5de6d3e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:40.641588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391fbfb-6d69-4245-b0eb-868bca9fe871 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:40.661733 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe94b5-8d12-4b53-8ba8-f4dca7d89fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:40.662418 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe94b5-8d12-4b53-8ba8-f4dca7d89fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:40.662711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe94b5-8d12-4b53-8ba8-f4dca7d89fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:40.663078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe94b5-8d12-4b53-8ba8-f4dca7d89fe3 admin admin] PATH_INFO: `/v3/projects/60d1a3959a4e45fcb143e7e475eba350/users/9e4b7ba54bed4670931926eab354b3ee/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:40.692947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe94b5-8d12-4b53-8ba8-f4dca7d89fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d1a3959a4e45fcb143e7e475eba350, user_id=9e4b7ba54bed4670931926eab354b3ee, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:40.695725 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe94b5-8d12-4b53-8ba8-f4dca7d89fe3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:40.727403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 922/1843] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:40 2022] PUT /identity/v3/projects/60d1a3959a4e45fcb143e7e475eba350/users/9e4b7ba54bed4670931926eab354b3ee/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:40.727403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe94b5-8d12-4b53-8ba8-f4dca7d89fe3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:40.796677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d2358-8f58-485d-be53-b7e5de6d3e85 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:40.921857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe94b5-8d12-4b53-8ba8-f4dca7d89fe3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:40.922383 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf7333-4284-452b-bc77-cbffc2937201 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:40.923125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf7333-4284-452b-bc77-cbffc2937201 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:40.923475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf7333-4284-452b-bc77-cbffc2937201 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:40.923826 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf7333-4284-452b-bc77-cbffc2937201 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:40.926219 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-efcf7333-4284-452b-bc77-cbffc2937201 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:40.943389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf7333-4284-452b-bc77-cbffc2937201 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:40.944685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf7333-4284-452b-bc77-cbffc2937201 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:40.954451 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b42cba-2f65-4285-bc58-07d0502a2910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:40.955114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b42cba-2f65-4285-bc58-07d0502a2910 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:40.955970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b42cba-2f65-4285-bc58-07d0502a2910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:40.956250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b42cba-2f65-4285-bc58-07d0502a2910 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:40.956889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b42cba-2f65-4285-bc58-07d0502a2910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:40.958838 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b42cba-2f65-4285-bc58-07d0502a2910 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:40.960275 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 922/1844] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:40.961137 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf7333-4284-452b-bc77-cbffc2937201 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:40.963054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-efcf7333-4284-452b-bc77-cbffc2937201 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:40.968239 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:41.026587 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 923/1845] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:40 2022] POST /identity/v3/projects => generated 371 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:41.030073 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b42cba-2f65-4285-bc58-07d0502a2910 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:41.083127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf7333-4284-452b-bc77-cbffc2937201 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:41.152345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e1b24-ca5d-48b7-999c-cfd3c1d61edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:41.153014 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e1b24-ca5d-48b7-999c-cfd3c1d61edc service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:41.153300 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e1b24-ca5d-48b7-999c-cfd3c1d61edc service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:41.153686 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e1b24-ca5d-48b7-999c-cfd3c1d61edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:41.163077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:41.175639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e1b24-ca5d-48b7-999c-cfd3c1d61edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:41.177588 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e1b24-ca5d-48b7-999c-cfd3c1d61edc service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:41.188742 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b42cba-2f65-4285-bc58-07d0502a2910 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:41.199909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 923/1846] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:41.201596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e1b24-ca5d-48b7-999c-cfd3c1d61edc service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:41.203364 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcbecd-1e3a-4914-a25c-33bde8fa1d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:41.204001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcbecd-1e3a-4914-a25c-33bde8fa1d5e admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:41.204339 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcbecd-1e3a-4914-a25c-33bde8fa1d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:41.204570 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcbecd-1e3a-4914-a25c-33bde8fa1d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:41.205237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcbecd-1e3a-4914-a25c-33bde8fa1d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:41.214800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e1b24-ca5d-48b7-999c-cfd3c1d61edc service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:41.223743 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcbecd-1e3a-4914-a25c-33bde8fa1d5e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:41.239777 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a7d6c-3f9f-4baf-bbe8-2c8f7d12fe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:41.240876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a7d6c-3f9f-4baf-bbe8-2c8f7d12fe01 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:41.241760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a7d6c-3f9f-4baf-bbe8-2c8f7d12fe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:41.242286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a7d6c-3f9f-4baf-bbe8-2c8f7d12fe01 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:41.243115 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a7d6c-3f9f-4baf-bbe8-2c8f7d12fe01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:41.247367 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a7d6c-3f9f-4baf-bbe8-2c8f7d12fe01 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:41.252849 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 924/1847] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:41.253971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcbecd-1e3a-4914-a25c-33bde8fa1d5e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:41.273678 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcbecd-1e3a-4914-a25c-33bde8fa1d5e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:41.285055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 924/1848] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:41 2022] POST /identity/v3/users => generated 286 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:41.288993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a7d6c-3f9f-4baf-bbe8-2c8f7d12fe01 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:41.291716 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42978c-fb2a-477f-9598-1c814081462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:41.292403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42978c-fb2a-477f-9598-1c814081462d admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:41.293052 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42978c-fb2a-477f-9598-1c814081462d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:41.293535 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42978c-fb2a-477f-9598-1c814081462d admin admin] PATH_INFO: `/v3/projects/60d1a3959a4e45fcb143e7e475eba350/users/9e4b7ba54bed4670931926eab354b3ee/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:41.295867 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42978c-fb2a-477f-9598-1c814081462d admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d1a3959a4e45fcb143e7e475eba350, user_id=9e4b7ba54bed4670931926eab354b3ee, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:41.298783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42978c-fb2a-477f-9598-1c814081462d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:41.313983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a7d6c-3f9f-4baf-bbe8-2c8f7d12fe01 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:41.328794 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 925/1849] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:41 2022] PUT /identity/v3/projects/60d1a3959a4e45fcb143e7e475eba350/users/9e4b7ba54bed4670931926eab354b3ee/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:41.354846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041bacb-4bb0-4bd3-a0ad-b7370a628e01 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:41.355158 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041bacb-4bb0-4bd3-a0ad-b7370a628e01 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:41.355447 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041bacb-4bb0-4bd3-a0ad-b7370a628e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:41.462235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9041bacb-4bb0-4bd3-a0ad-b7370a628e01 None None] MFA Rules not processed for user `9e4b7ba54bed4670931926eab354b3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:41.463750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677c19b-03d6-42cf-9096-20c36741b688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:41.464807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9041bacb-4bb0-4bd3-a0ad-b7370a628e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:41.465088 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677c19b-03d6-42cf-9096-20c36741b688 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:41.465443 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677c19b-03d6-42cf-9096-20c36741b688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:41.465934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677c19b-03d6-42cf-9096-20c36741b688 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:41.467082 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677c19b-03d6-42cf-9096-20c36741b688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:41.469750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677c19b-03d6-42cf-9096-20c36741b688 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:41.501400 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 925/1850] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:41.502995 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677c19b-03d6-42cf-9096-20c36741b688 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:41.548080 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677c19b-03d6-42cf-9096-20c36741b688 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:41.579629 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e223442-f9fe-48a6-b77c-b4ef5b268c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:41.581453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e223442-f9fe-48a6-b77c-b4ef5b268c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:41.582440 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e223442-f9fe-48a6-b77c-b4ef5b268c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:41.583659 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e223442-f9fe-48a6-b77c-b4ef5b268c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:41.585552 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e223442-f9fe-48a6-b77c-b4ef5b268c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:41.599850 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e223442-f9fe-48a6-b77c-b4ef5b268c08 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:41.634180 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 926/1851] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:41.638447 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e223442-f9fe-48a6-b77c-b4ef5b268c08 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:41.682181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 926/1852] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:41.683145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e223442-f9fe-48a6-b77c-b4ef5b268c08 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:41.701639 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041bacb-4bb0-4bd3-a0ad-b7370a628e01 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:41.702446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9041bacb-4bb0-4bd3-a0ad-b7370a628e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:41.704455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d378f5-bf05-49f7-baea-7e2b5978c8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:41.705153 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d378f5-bf05-49f7-baea-7e2b5978c8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:41.706280 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d378f5-bf05-49f7-baea-7e2b5978c8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:41.706562 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d378f5-bf05-49f7-baea-7e2b5978c8f7 admin admin] PATH_INFO: `/v3/projects/cf05c9ad12de4c00acd68b67dec1d59f/users/62d93ee7c67c4d958cc883729b31db2f/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:41.772839 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d378f5-bf05-49f7-baea-7e2b5978c8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf05c9ad12de4c00acd68b67dec1d59f, user_id=62d93ee7c67c4d958cc883729b31db2f, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:41.775467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d378f5-bf05-49f7-baea-7e2b5978c8f7 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:41.823074 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 927/1853] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:41 2022] PUT /identity/v3/projects/cf05c9ad12de4c00acd68b67dec1d59f/users/62d93ee7c67c4d958cc883729b31db2f/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:41.825284 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047106aa-43d1-4b89-b642-b5bd490187c8 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:41.825284 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047106aa-43d1-4b89-b642-b5bd490187c8 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:41.825511 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047106aa-43d1-4b89-b642-b5bd490187c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:41.843771 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:41.892211 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-047106aa-43d1-4b89-b642-b5bd490187c8 None None] MFA Rules not processed for user `62d93ee7c67c4d958cc883729b31db2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:41.894219 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-047106aa-43d1-4b89-b642-b5bd490187c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:41.947308 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041bacb-4bb0-4bd3-a0ad-b7370a628e01 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:42.053879 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5d8d9-7198-4747-b270-60e6da3e9d0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:42.054520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5d8d9-7198-4747-b270-60e6da3e9d0f service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:42.054829 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5d8d9-7198-4747-b270-60e6da3e9d0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:42.055110 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5d8d9-7198-4747-b270-60e6da3e9d0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:42.061481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 928/1854] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:42.062991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047106aa-43d1-4b89-b642-b5bd490187c8 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:42.133726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:42.184072 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5d8d9-7198-4747-b270-60e6da3e9d0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:42.185862 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5d8d9-7198-4747-b270-60e6da3e9d0f service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:42.206527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 927/1855] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:42.230834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047106aa-43d1-4b89-b642-b5bd490187c8 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:42.239401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed323225-2a3b-4429-8317-3327c03eb239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:42.256941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed323225-2a3b-4429-8317-3327c03eb239 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:42.259003 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed323225-2a3b-4429-8317-3327c03eb239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:42.259395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed323225-2a3b-4429-8317-3327c03eb239 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:42.261059 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed323225-2a3b-4429-8317-3327c03eb239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:42.267496 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed323225-2a3b-4429-8317-3327c03eb239 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:42.402048 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 929/1856] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:42 2022] POST /identity/v3/projects => generated 373 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:20:42.403396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5d8d9-7198-4747-b270-60e6da3e9d0f service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:42.422501 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5d8d9-7198-4747-b270-60e6da3e9d0f service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:42.439088 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed323225-2a3b-4429-8317-3327c03eb239 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:42.441401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ed323225-2a3b-4429-8317-3327c03eb239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:42.641362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d521e1-36be-40a8-a958-ed30869ffa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:42.641975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d521e1-36be-40a8-a958-ed30869ffa0a admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:42.642259 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d521e1-36be-40a8-a958-ed30869ffa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:42.642535 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d521e1-36be-40a8-a958-ed30869ffa0a admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:42.643814 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d521e1-36be-40a8-a958-ed30869ffa0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:42.652245 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d521e1-36be-40a8-a958-ed30869ffa0a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:42.654268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed323225-2a3b-4429-8317-3327c03eb239 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:42.669876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea985c-57f2-4ec4-8237-a8c068bf8f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:42.670931 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea985c-57f2-4ec4-8237-a8c068bf8f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:42.671396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea985c-57f2-4ec4-8237-a8c068bf8f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:42.671866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea985c-57f2-4ec4-8237-a8c068bf8f4b admin admin] PATH_INFO: `/v3/projects/058e2a896b8144edb94b7a8a4e1a0e6e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:42.674830 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea985c-57f2-4ec4-8237-a8c068bf8f4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=058e2a896b8144edb94b7a8a4e1a0e6e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:42.680706 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea985c-57f2-4ec4-8237-a8c068bf8f4b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:42.706991 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 928/1857] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:42 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:20:42.709616 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d521e1-36be-40a8-a958-ed30869ffa0a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:42.732936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d521e1-36be-40a8-a958-ed30869ffa0a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:42.744355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdaca9-d2e2-4600-bab1-94536e7964e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:42.745640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdaca9-d2e2-4600-bab1-94536e7964e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:42.746167 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdaca9-d2e2-4600-bab1-94536e7964e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:42.746652 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdaca9-d2e2-4600-bab1-94536e7964e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:42.747650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdaca9-d2e2-4600-bab1-94536e7964e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:42.749716 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdaca9-d2e2-4600-bab1-94536e7964e6 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:42.750810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:42.776204 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 929/1858] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:42.778332 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdaca9-d2e2-4600-bab1-94536e7964e6 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:42.794042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdaca9-d2e2-4600-bab1-94536e7964e6 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:42.818698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-57ea985c-57f2-4ec4-8237-a8c068bf8f4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '058e2a896b8144edb94b7a8a4e1a0e6e', 'request_id': 'req-57ea985c-57f2-4ec4-8237-a8c068bf8f4b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:42.841921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-57ea985c-57f2-4ec4-8237-a8c068bf8f4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '058e2a896b8144edb94b7a8a4e1a0e6e', 'request_id': 'req-57ea985c-57f2-4ec4-8237-a8c068bf8f4b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:42.858226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-57ea985c-57f2-4ec4-8237-a8c068bf8f4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '058e2a896b8144edb94b7a8a4e1a0e6e', 'request_id': 'req-57ea985c-57f2-4ec4-8237-a8c068bf8f4b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:42.877248 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35545c12-c3c2-4549-917e-01b9af8600d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:42.878298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35545c12-c3c2-4549-917e-01b9af8600d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:42.879275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35545c12-c3c2-4549-917e-01b9af8600d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:42.879795 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35545c12-c3c2-4549-917e-01b9af8600d5 admin admin] PATH_INFO: `/v3/projects/1e6976f6ba8949faad18bc54da20887b/users/94ff6448cd914642a1fe67d38ec6a42d/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:42.896754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-57ea985c-57f2-4ec4-8237-a8c068bf8f4b admin admin] The token cache is being invalidate because project 058e2a896b8144edb94b7a8a4e1a0e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:42.897118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-57ea985c-57f2-4ec4-8237-a8c068bf8f4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:42.898267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-57ea985c-57f2-4ec4-8237-a8c068bf8f4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:42.903923 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 930/1859] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:42 2022] DELETE /identity/v3/projects/058e2a896b8144edb94b7a8a4e1a0e6e => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:20:42.909143 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea985c-57f2-4ec4-8237-a8c068bf8f4b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:42.912719 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-57ea985c-57f2-4ec4-8237-a8c068bf8f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:42.941907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35545c12-c3c2-4549-917e-01b9af8600d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6976f6ba8949faad18bc54da20887b, user_id=94ff6448cd914642a1fe67d38ec6a42d, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:42.948765 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35545c12-c3c2-4549-917e-01b9af8600d5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:42.950355 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea985c-57f2-4ec4-8237-a8c068bf8f4b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:42.976137 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d15e4-e5a1-417e-a6cc-8e86cfc9d1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:42.982308 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d15e4-e5a1-417e-a6cc-8e86cfc9d1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:42.982593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d15e4-e5a1-417e-a6cc-8e86cfc9d1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:42.982906 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d15e4-e5a1-417e-a6cc-8e86cfc9d1e4 admin admin] PATH_INFO: `/v3/users/57d12e1b426943138235ff54f122db31` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:42.987625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d15e4-e5a1-417e-a6cc-8e86cfc9d1e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d12e1b426943138235ff54f122db31)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:42.996268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d15e4-e5a1-417e-a6cc-8e86cfc9d1e4 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:43.003525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 930/1860] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:42 2022] PUT /identity/v3/projects/1e6976f6ba8949faad18bc54da20887b/users/94ff6448cd914642a1fe67d38ec6a42d/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:43.005047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35545c12-c3c2-4549-917e-01b9af8600d5 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:43.008812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-35545c12-c3c2-4549-917e-01b9af8600d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:43.170285 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:43.180277 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a08d15e4-e5a1-417e-a6cc-8e86cfc9d1e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d12e1b426943138235ff54f122db31'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:43.212864 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a08d15e4-e5a1-417e-a6cc-8e86cfc9d1e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d12e1b426943138235ff54f122db31'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:43.270518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a08d15e4-e5a1-417e-a6cc-8e86cfc9d1e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d12e1b426943138235ff54f122db31'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:43.274982 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a08d15e4-e5a1-417e-a6cc-8e86cfc9d1e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d12e1b426943138235ff54f122db31'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:43.293212 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35545c12-c3c2-4549-917e-01b9af8600d5 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:43.297733 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a08d15e4-e5a1-417e-a6cc-8e86cfc9d1e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d12e1b426943138235ff54f122db31'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:43.311460 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d900e-bf85-463d-86fa-7722c6373ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:43.317288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 931/1861] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:42 2022] DELETE /identity/v3/users/57d12e1b426943138235ff54f122db31 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:43.317780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d900e-bf85-463d-86fa-7722c6373ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:43.318164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d900e-bf85-463d-86fa-7722c6373ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:43.318451 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d900e-bf85-463d-86fa-7722c6373ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:43.319770 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d900e-bf85-463d-86fa-7722c6373ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:43.322464 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d900e-bf85-463d-86fa-7722c6373ef8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:43.340682 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d15e4-e5a1-417e-a6cc-8e86cfc9d1e4 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:43.342038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 931/1862] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:43.342781 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a08d15e4-e5a1-417e-a6cc-8e86cfc9d1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:43.345013 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d900e-bf85-463d-86fa-7722c6373ef8 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:43.354952 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6c8d900e-bf85-463d-86fa-7722c6373ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:43.522971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d15e4-e5a1-417e-a6cc-8e86cfc9d1e4 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:43.540351 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d900e-bf85-463d-86fa-7722c6373ef8 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:43.545067 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa61553-5e4b-4816-a614-4bb641ac72aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:43.548042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa61553-5e4b-4816-a614-4bb641ac72aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:43.550254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa61553-5e4b-4816-a614-4bb641ac72aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:43.551336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa61553-5e4b-4816-a614-4bb641ac72aa admin admin] PATH_INFO: `/v3/projects/1e6976f6ba8949faad18bc54da20887b/users/94ff6448cd914642a1fe67d38ec6a42d/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:43.555574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa61553-5e4b-4816-a614-4bb641ac72aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6976f6ba8949faad18bc54da20887b, user_id=94ff6448cd914642a1fe67d38ec6a42d, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:43.562798 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa61553-5e4b-4816-a614-4bb641ac72aa admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:43.594575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 932/1863] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:43 2022] PUT /identity/v3/projects/1e6976f6ba8949faad18bc54da20887b/users/94ff6448cd914642a1fe67d38ec6a42d/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:20:43.595736 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa61553-5e4b-4816-a614-4bb641ac72aa admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:43.597332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8fa61553-5e4b-4816-a614-4bb641ac72aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:43.652550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=17,keystone:SELECT=80,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:43.681792 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d9047-2d3d-4b0e-bf4b-e940a5fae1d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:43.682456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d9047-2d3d-4b0e-bf4b-e940a5fae1d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:43.682757 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d9047-2d3d-4b0e-bf4b-e940a5fae1d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:43.683042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d9047-2d3d-4b0e-bf4b-e940a5fae1d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:43.689495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c02d9047-2d3d-4b0e-bf4b-e940a5fae1d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:43.770701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa61553-5e4b-4816-a614-4bb641ac72aa admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:43.776784 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576fc00-c900-470a-880c-539d95739c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:43.777448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576fc00-c900-470a-880c-539d95739c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:43.777778 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576fc00-c900-470a-880c-539d95739c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:43.778032 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576fc00-c900-470a-880c-539d95739c84 admin admin] PATH_INFO: `/v3/users/5d9157836b6e446e9ccbfbcab9af61f7` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:43.779275 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576fc00-c900-470a-880c-539d95739c84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d9157836b6e446e9ccbfbcab9af61f7)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:43.781278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576fc00-c900-470a-880c-539d95739c84 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:43.821094 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d9047-2d3d-4b0e-bf4b-e940a5fae1d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:43.823007 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d9047-2d3d-4b0e-bf4b-e940a5fae1d8 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:43.837470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 932/1864] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:43.839266 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d418222-704a-49d0-89d1-7c76686bc706 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:43.839560 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d418222-704a-49d0-89d1-7c76686bc706 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:43.839834 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d418222-704a-49d0-89d1-7c76686bc706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:43.880796 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-3d418222-704a-49d0-89d1-7c76686bc706 None None] MFA Rules not processed for user `94ff6448cd914642a1fe67d38ec6a42d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:43.882246 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3d418222-704a-49d0-89d1-7c76686bc706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:43.892140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0576fc00-c900-470a-880c-539d95739c84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d9157836b6e446e9ccbfbcab9af61f7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:43.912827 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0576fc00-c900-470a-880c-539d95739c84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d9157836b6e446e9ccbfbcab9af61f7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:43.920803 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:43.938601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0576fc00-c900-470a-880c-539d95739c84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d9157836b6e446e9ccbfbcab9af61f7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:43.939555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0576fc00-c900-470a-880c-539d95739c84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d9157836b6e446e9ccbfbcab9af61f7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:43.961359 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0576fc00-c900-470a-880c-539d95739c84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d9157836b6e446e9ccbfbcab9af61f7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:44.011880 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 933/1865] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:43 2022] DELETE /identity/v3/users/5d9157836b6e446e9ccbfbcab9af61f7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:44.016085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d81bf-af66-49f6-aea4-d8752388dc9e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:44.016375 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d81bf-af66-49f6-aea4-d8752388dc9e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:44.016750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d81bf-af66-49f6-aea4-d8752388dc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:44.032423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 933/1866] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:44.044781 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d418222-704a-49d0-89d1-7c76686bc706 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:44.046592 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3d418222-704a-49d0-89d1-7c76686bc706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:44.083588 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5f1d81bf-af66-49f6-aea4-d8752388dc9e None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:44.087936 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5f1d81bf-af66-49f6-aea4-d8752388dc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:44.203548 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d418222-704a-49d0-89d1-7c76686bc706 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:44.316485 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 934/1867] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:44.331342 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df82e3-f15c-4652-8003-5aa09fcdfcf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:44.332058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df82e3-f15c-4652-8003-5aa09fcdfcf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:44.334667 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df82e3-f15c-4652-8003-5aa09fcdfcf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:44.337092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df82e3-f15c-4652-8003-5aa09fcdfcf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:44.349770 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d81bf-af66-49f6-aea4-d8752388dc9e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:44.352116 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5f1d81bf-af66-49f6-aea4-d8752388dc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:44.462645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:44.515784 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d81bf-af66-49f6-aea4-d8752388dc9e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:44.523128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df82e3-f15c-4652-8003-5aa09fcdfcf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:44.523968 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d584cc0-7772-4e00-82ec-f4ce8763fbac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:44.525688 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d584cc0-7772-4e00-82ec-f4ce8763fbac service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:44.526539 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d584cc0-7772-4e00-82ec-f4ce8763fbac service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:44.526943 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df82e3-f15c-4652-8003-5aa09fcdfcf2 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:44.527325 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d584cc0-7772-4e00-82ec-f4ce8763fbac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:44.552193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d584cc0-7772-4e00-82ec-f4ce8763fbac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:44.555165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 934/1868] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:44.556084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d584cc0-7772-4e00-82ec-f4ce8763fbac service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:44.570229 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 935/1869] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:20:44.663294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df82e3-f15c-4652-8003-5aa09fcdfcf2 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:44.680328 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df82e3-f15c-4652-8003-5aa09fcdfcf2 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:44.686921 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ccecc-392b-4adb-9dbb-b09da87e1deb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:44.686921 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ccecc-392b-4adb-9dbb-b09da87e1deb service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:44.686921 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ccecc-392b-4adb-9dbb-b09da87e1deb service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:44.687156 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ccecc-392b-4adb-9dbb-b09da87e1deb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:44.689808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-821ccecc-392b-4adb-9dbb-b09da87e1deb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:44.747055 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:44.813795 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ccecc-392b-4adb-9dbb-b09da87e1deb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:44.815552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ccecc-392b-4adb-9dbb-b09da87e1deb service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:44.828390 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 935/1870] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:45.087033 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d584cc0-7772-4e00-82ec-f4ce8763fbac service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:45.089101 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3d584cc0-7772-4e00-82ec-f4ce8763fbac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:45.104210 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d584cc0-7772-4e00-82ec-f4ce8763fbac service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:45.113840 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ccecc-392b-4adb-9dbb-b09da87e1deb service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:45.115937 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-821ccecc-392b-4adb-9dbb-b09da87e1deb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:45.127629 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bab50b-5d43-4622-8993-a329981f7b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:45.128639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bab50b-5d43-4622-8993-a329981f7b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:45.128776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bab50b-5d43-4622-8993-a329981f7b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:45.129045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bab50b-5d43-4622-8993-a329981f7b8b admin admin] PATH_INFO: `/v3/projects/a49c8d8451f046639b9531b0fed6512a` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:45.130479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bab50b-5d43-4622-8993-a329981f7b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a49c8d8451f046639b9531b0fed6512a)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:45.132608 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bab50b-5d43-4622-8993-a329981f7b8b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:45.133373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ccecc-392b-4adb-9dbb-b09da87e1deb service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:45.140270 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce60e1-8caa-429f-813d-daaeb7614909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:45.141108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce60e1-8caa-429f-813d-daaeb7614909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:45.141404 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce60e1-8caa-429f-813d-daaeb7614909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:45.141686 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce60e1-8caa-429f-813d-daaeb7614909 admin admin] PATH_INFO: `/v3/projects/7a0adb8afabb4c52a336ba6d055c2e15` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:45.143606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce60e1-8caa-429f-813d-daaeb7614909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a0adb8afabb4c52a336ba6d055c2e15)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:45.145900 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce60e1-8caa-429f-813d-daaeb7614909 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:45.197325 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-90bab50b-5d43-4622-8993-a329981f7b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a49c8d8451f046639b9531b0fed6512a', 'request_id': 'req-90bab50b-5d43-4622-8993-a329981f7b8b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.204882 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-90bab50b-5d43-4622-8993-a329981f7b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a49c8d8451f046639b9531b0fed6512a', 'request_id': 'req-90bab50b-5d43-4622-8993-a329981f7b8b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.205130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-58ce60e1-8caa-429f-813d-daaeb7614909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0adb8afabb4c52a336ba6d055c2e15', 'request_id': 'req-58ce60e1-8caa-429f-813d-daaeb7614909'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.213309 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-58ce60e1-8caa-429f-813d-daaeb7614909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0adb8afabb4c52a336ba6d055c2e15', 'request_id': 'req-58ce60e1-8caa-429f-813d-daaeb7614909'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.213619 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-90bab50b-5d43-4622-8993-a329981f7b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a49c8d8451f046639b9531b0fed6512a', 'request_id': 'req-90bab50b-5d43-4622-8993-a329981f7b8b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.220172 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-58ce60e1-8caa-429f-813d-daaeb7614909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0adb8afabb4c52a336ba6d055c2e15', 'request_id': 'req-58ce60e1-8caa-429f-813d-daaeb7614909'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.225981 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-90bab50b-5d43-4622-8993-a329981f7b8b admin admin] The token cache is being invalidate because project a49c8d8451f046639b9531b0fed6512a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:45.226184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-90bab50b-5d43-4622-8993-a329981f7b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.226870 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-90bab50b-5d43-4622-8993-a329981f7b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.228375 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 936/1871] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:45 2022] DELETE /identity/v3/projects/a49c8d8451f046639b9531b0fed6512a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:45.232731 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bab50b-5d43-4622-8993-a329981f7b8b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:45.234618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-90bab50b-5d43-4622-8993-a329981f7b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:45.237859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-58ce60e1-8caa-429f-813d-daaeb7614909 admin admin] The token cache is being invalidate because project 7a0adb8afabb4c52a336ba6d055c2e15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:45.238161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-58ce60e1-8caa-429f-813d-daaeb7614909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.238822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-58ce60e1-8caa-429f-813d-daaeb7614909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.240320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 936/1872] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:45 2022] DELETE /identity/v3/projects/7a0adb8afabb4c52a336ba6d055c2e15 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:45.244192 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce60e1-8caa-429f-813d-daaeb7614909 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:45.245665 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-58ce60e1-8caa-429f-813d-daaeb7614909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:45.306041 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bab50b-5d43-4622-8993-a329981f7b8b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:45.311361 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b3940-6dc0-4f85-8483-98752779610b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:45.311993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b3940-6dc0-4f85-8483-98752779610b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:45.312278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b3940-6dc0-4f85-8483-98752779610b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:45.312557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b3940-6dc0-4f85-8483-98752779610b admin admin] PATH_INFO: `/v3/users/568f80b1d9e54b8e86080204744abfee` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:45.313418 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce60e1-8caa-429f-813d-daaeb7614909 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:45.313951 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b3940-6dc0-4f85-8483-98752779610b admin admin] RBAC: Authorizing `identity:delete_user(user_id=568f80b1d9e54b8e86080204744abfee)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:45.316462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b3940-6dc0-4f85-8483-98752779610b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:45.319128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ecd8d-93ff-47ca-a85f-25cbad7d3487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:45.319874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ecd8d-93ff-47ca-a85f-25cbad7d3487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:45.320090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ecd8d-93ff-47ca-a85f-25cbad7d3487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:45.320376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ecd8d-93ff-47ca-a85f-25cbad7d3487 admin admin] PATH_INFO: `/v3/users/76b0cf8ddea4409baa8ddbd1de44d5e0` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:45.321659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ecd8d-93ff-47ca-a85f-25cbad7d3487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76b0cf8ddea4409baa8ddbd1de44d5e0)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:45.323741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ecd8d-93ff-47ca-a85f-25cbad7d3487 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:45.390231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f74ecd8d-93ff-47ca-a85f-25cbad7d3487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76b0cf8ddea4409baa8ddbd1de44d5e0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.391129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ed1b3940-6dc0-4f85-8483-98752779610b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568f80b1d9e54b8e86080204744abfee'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.402277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:45.407069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f74ecd8d-93ff-47ca-a85f-25cbad7d3487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76b0cf8ddea4409baa8ddbd1de44d5e0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.409204 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ed1b3940-6dc0-4f85-8483-98752779610b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568f80b1d9e54b8e86080204744abfee'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.409655 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f74ecd8d-93ff-47ca-a85f-25cbad7d3487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76b0cf8ddea4409baa8ddbd1de44d5e0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.417543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:45.428199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f74ecd8d-93ff-47ca-a85f-25cbad7d3487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76b0cf8ddea4409baa8ddbd1de44d5e0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.440442 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f74ecd8d-93ff-47ca-a85f-25cbad7d3487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76b0cf8ddea4409baa8ddbd1de44d5e0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.443050 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ed1b3940-6dc0-4f85-8483-98752779610b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568f80b1d9e54b8e86080204744abfee'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.444270 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ed1b3940-6dc0-4f85-8483-98752779610b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568f80b1d9e54b8e86080204744abfee'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.448368 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 937/1873] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:45 2022] DELETE /identity/v3/users/76b0cf8ddea4409baa8ddbd1de44d5e0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:45.455848 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ed1b3940-6dc0-4f85-8483-98752779610b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568f80b1d9e54b8e86080204744abfee'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:45.462764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 937/1874] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:45 2022] DELETE /identity/v3/users/568f80b1d9e54b8e86080204744abfee => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:20:45.793080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ecd8d-93ff-47ca-a85f-25cbad7d3487 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:45.794605 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f74ecd8d-93ff-47ca-a85f-25cbad7d3487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:45.855613 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b3940-6dc0-4f85-8483-98752779610b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:45.858186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ed1b3940-6dc0-4f85-8483-98752779610b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:45.889647 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ecd8d-93ff-47ca-a85f-25cbad7d3487 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:45.974035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b3940-6dc0-4f85-8483-98752779610b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:45.980814 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea86f43-1e6d-431e-b588-e9fb8a63e166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:45.982082 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea86f43-1e6d-431e-b588-e9fb8a63e166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:45.982897 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea86f43-1e6d-431e-b588-e9fb8a63e166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:45.983187 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea86f43-1e6d-431e-b588-e9fb8a63e166 admin admin] PATH_INFO: `/v3/projects/25d72d58ee794d39be199a1ccd429490` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:45.984880 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea86f43-1e6d-431e-b588-e9fb8a63e166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d72d58ee794d39be199a1ccd429490)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:45.988687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea86f43-1e6d-431e-b588-e9fb8a63e166 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:45.993086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3897d-4b9c-43d2-b4f6-143eb4fc7c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:45.993735 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3897d-4b9c-43d2-b4f6-143eb4fc7c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:45.994022 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3897d-4b9c-43d2-b4f6-143eb4fc7c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:45.994299 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3897d-4b9c-43d2-b4f6-143eb4fc7c36 admin admin] PATH_INFO: `/v3/projects/1e3f6db016654a2487df9e1b3b94b69c` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:45.995483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3897d-4b9c-43d2-b4f6-143eb4fc7c36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3f6db016654a2487df9e1b3b94b69c)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:45.997423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3897d-4b9c-43d2-b4f6-143eb4fc7c36 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:46.078778 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fea86f43-1e6d-431e-b588-e9fb8a63e166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d72d58ee794d39be199a1ccd429490', 'request_id': 'req-fea86f43-1e6d-431e-b588-e9fb8a63e166'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:46.087801 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fea86f43-1e6d-431e-b588-e9fb8a63e166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d72d58ee794d39be199a1ccd429490', 'request_id': 'req-fea86f43-1e6d-431e-b588-e9fb8a63e166'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:46.104122 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fea86f43-1e6d-431e-b588-e9fb8a63e166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d72d58ee794d39be199a1ccd429490', 'request_id': 'req-fea86f43-1e6d-431e-b588-e9fb8a63e166'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:46.118168 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3ff3897d-4b9c-43d2-b4f6-143eb4fc7c36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3f6db016654a2487df9e1b3b94b69c', 'request_id': 'req-3ff3897d-4b9c-43d2-b4f6-143eb4fc7c36'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:46.134396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fea86f43-1e6d-431e-b588-e9fb8a63e166 admin admin] The token cache is being invalidate because project 25d72d58ee794d39be199a1ccd429490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:46.134856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fea86f43-1e6d-431e-b588-e9fb8a63e166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:46.136162 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fea86f43-1e6d-431e-b588-e9fb8a63e166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:46.137037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3ff3897d-4b9c-43d2-b4f6-143eb4fc7c36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3f6db016654a2487df9e1b3b94b69c', 'request_id': 'req-3ff3897d-4b9c-43d2-b4f6-143eb4fc7c36'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:46.143620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 938/1875] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:45 2022] DELETE /identity/v3/projects/25d72d58ee794d39be199a1ccd429490 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:20:46.145815 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2989870-dd87-4b69-a434-561c0706f199 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:46.146109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2989870-dd87-4b69-a434-561c0706f199 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:46.146479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2989870-dd87-4b69-a434-561c0706f199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:46.151210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3ff3897d-4b9c-43d2-b4f6-143eb4fc7c36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3f6db016654a2487df9e1b3b94b69c', 'request_id': 'req-3ff3897d-4b9c-43d2-b4f6-143eb4fc7c36'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:46.183081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3ff3897d-4b9c-43d2-b4f6-143eb4fc7c36 admin admin] The token cache is being invalidate because project 1e3f6db016654a2487df9e1b3b94b69c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:46.183661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3ff3897d-4b9c-43d2-b4f6-143eb4fc7c36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:46.187296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3ff3897d-4b9c-43d2-b4f6-143eb4fc7c36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:46.200049 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 938/1876] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:45 2022] DELETE /identity/v3/projects/1e3f6db016654a2487df9e1b3b94b69c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:46.204180 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e018d51-e409-4dbc-9ce1-f813dc89fa81 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:46.204480 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e018d51-e409-4dbc-9ce1-f813dc89fa81 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:46.204762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e018d51-e409-4dbc-9ce1-f813dc89fa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:46.207850 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d2989870-dd87-4b69-a434-561c0706f199 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:46.213243 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d2989870-dd87-4b69-a434-561c0706f199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:46.242209 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:46.251018 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8e018d51-e409-4dbc-9ce1-f813dc89fa81 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:46.253774 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8e018d51-e409-4dbc-9ce1-f813dc89fa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:46.333594 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 939/1877] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:46.341695 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607476c-c6af-4a0d-8eca-52ff4c8da929 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:46.341988 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607476c-c6af-4a0d-8eca-52ff4c8da929 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:46.342660 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607476c-c6af-4a0d-8eca-52ff4c8da929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:46.365375 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 939/1878] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:46.367031 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7a7b8-6cc9-4dd4-ba55-d57013409df5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:46.367327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7a7b8-6cc9-4dd4-ba55-d57013409df5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:46.368434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7a7b8-6cc9-4dd4-ba55-d57013409df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:46.370582 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1607476c-c6af-4a0d-8eca-52ff4c8da929 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:46.372516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1607476c-c6af-4a0d-8eca-52ff4c8da929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:46.382730 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 940/1879] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:46.387890 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607476c-c6af-4a0d-8eca-52ff4c8da929 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:46.398656 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607476c-c6af-4a0d-8eca-52ff4c8da929 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:46.409769 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46a474-d79a-4c43-a1ab-1cb688b7a190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:46.410505 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46a474-d79a-4c43-a1ab-1cb688b7a190 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:46.410832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46a474-d79a-4c43-a1ab-1cb688b7a190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:46.412301 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46a474-d79a-4c43-a1ab-1cb688b7a190 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:46.413657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46a474-d79a-4c43-a1ab-1cb688b7a190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:46.413911 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5fd7a7b8-6cc9-4dd4-ba55-d57013409df5 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:46.414038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46a474-d79a-4c43-a1ab-1cb688b7a190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:46.415205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5fd7a7b8-6cc9-4dd4-ba55-d57013409df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:46.415845 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46a474-d79a-4c43-a1ab-1cb688b7a190 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:46.431777 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 941/1880] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:46.436170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46a474-d79a-4c43-a1ab-1cb688b7a190 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:46.442758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 940/1881] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:46.445796 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7a7b8-6cc9-4dd4-ba55-d57013409df5 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:46.449314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46a474-d79a-4c43-a1ab-1cb688b7a190 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:46.456335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508af8ea-3a7a-480b-a015-c24be597f5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:46.457006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508af8ea-3a7a-480b-a015-c24be597f5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:46.457294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508af8ea-3a7a-480b-a015-c24be597f5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:46.457667 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508af8ea-3a7a-480b-a015-c24be597f5c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:46.458525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508af8ea-3a7a-480b-a015-c24be597f5c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:46.460382 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:46.461024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508af8ea-3a7a-480b-a015-c24be597f5c5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:46.475960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7a7b8-6cc9-4dd4-ba55-d57013409df5 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:46.496618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7149f7e-4e20-4cf1-87d3-8b339c7f3947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:46.497248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7149f7e-4e20-4cf1-87d3-8b339c7f3947 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:46.497533 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7149f7e-4e20-4cf1-87d3-8b339c7f3947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:46.497963 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7149f7e-4e20-4cf1-87d3-8b339c7f3947 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:46.498905 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7149f7e-4e20-4cf1-87d3-8b339c7f3947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:46.499240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7149f7e-4e20-4cf1-87d3-8b339c7f3947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:46.501728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7149f7e-4e20-4cf1-87d3-8b339c7f3947 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:46.510372 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 942/1882] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:46 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:20:46.511797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508af8ea-3a7a-480b-a015-c24be597f5c5 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:46.531372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 941/1883] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:20:46.537819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7149f7e-4e20-4cf1-87d3-8b339c7f3947 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:46.563474 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7149f7e-4e20-4cf1-87d3-8b339c7f3947 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:46.644178 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508af8ea-3a7a-480b-a015-c24be597f5c5 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:46.650142 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b46453-a49d-4da7-9009-b7deba2e6647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:46.651783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b46453-a49d-4da7-9009-b7deba2e6647 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:46.652093 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b46453-a49d-4da7-9009-b7deba2e6647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:46.652384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b46453-a49d-4da7-9009-b7deba2e6647 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:46.653132 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b46453-a49d-4da7-9009-b7deba2e6647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:46.655913 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b46453-a49d-4da7-9009-b7deba2e6647 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:46.682033 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bb6ed-dfd3-4be5-888d-edbfd57399d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:46.684362 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bb6ed-dfd3-4be5-888d-edbfd57399d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:46.685786 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bb6ed-dfd3-4be5-888d-edbfd57399d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:46.686767 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bb6ed-dfd3-4be5-888d-edbfd57399d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:46.687742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bb6ed-dfd3-4be5-888d-edbfd57399d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:46.691372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bb6ed-dfd3-4be5-888d-edbfd57399d9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:46.699677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 943/1884] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:46 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:46.701163 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b46453-a49d-4da7-9009-b7deba2e6647 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:46.718668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b46453-a49d-4da7-9009-b7deba2e6647 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:46.726144 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2c946-b0d5-4831-88aa-1441a14ad8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:46.727290 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2c946-b0d5-4831-88aa-1441a14ad8fd admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:46.728710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2c946-b0d5-4831-88aa-1441a14ad8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:46.729238 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2c946-b0d5-4831-88aa-1441a14ad8fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:46.730150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2c946-b0d5-4831-88aa-1441a14ad8fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:46.759039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2c946-b0d5-4831-88aa-1441a14ad8fd admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:46.780466 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 942/1885] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:46 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:46.786584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bb6ed-dfd3-4be5-888d-edbfd57399d9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:46.789556 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 944/1886] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:46.793285 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2c946-b0d5-4831-88aa-1441a14ad8fd admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:46.817938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2c946-b0d5-4831-88aa-1441a14ad8fd admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:46.943826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:46.965755 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bb6ed-dfd3-4be5-888d-edbfd57399d9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:46.978117 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad96d4-1161-4079-8744-3a4cd4f2bf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:46.978967 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad96d4-1161-4079-8744-3a4cd4f2bf1d admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:46.979216 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad96d4-1161-4079-8744-3a4cd4f2bf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:46.979498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad96d4-1161-4079-8744-3a4cd4f2bf1d admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:46.980157 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad96d4-1161-4079-8744-3a4cd4f2bf1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:46.982366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad96d4-1161-4079-8744-3a4cd4f2bf1d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:46.983044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c4786-ebc2-4d32-a5b5-f8291d60426a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:46.983767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4786-ebc2-4d32-a5b5-f8291d60426a admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:46.984131 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4786-ebc2-4d32-a5b5-f8291d60426a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:46.984499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4786-ebc2-4d32-a5b5-f8291d60426a admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:46.985288 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c4786-ebc2-4d32-a5b5-f8291d60426a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:46.988336 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c4786-ebc2-4d32-a5b5-f8291d60426a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:47.000315 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 945/1887] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:20:47.005341 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c4786-ebc2-4d32-a5b5-f8291d60426a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:47.016447 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c4786-ebc2-4d32-a5b5-f8291d60426a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:47.018661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 943/1888] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:46 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:47.022254 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f330cc-858d-42a8-b002-52552dff5e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:47.023099 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f330cc-858d-42a8-b002-52552dff5e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:47.023392 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f330cc-858d-42a8-b002-52552dff5e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:47.023703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f330cc-858d-42a8-b002-52552dff5e9d admin admin] PATH_INFO: `/v3/projects/abab1281e2f648518891ffea3dc3da7d/users/2cf42785adeb4beba6d7f85d0fce4a1a/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:47.024527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad96d4-1161-4079-8744-3a4cd4f2bf1d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:47.035959 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad96d4-1161-4079-8744-3a4cd4f2bf1d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:47.040280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f330cc-858d-42a8-b002-52552dff5e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=abab1281e2f648518891ffea3dc3da7d, user_id=2cf42785adeb4beba6d7f85d0fce4a1a, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:47.041714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd0921-34af-4497-8ee6-3d138ffab288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:47.042686 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd0921-34af-4497-8ee6-3d138ffab288 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:47.042686 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd0921-34af-4497-8ee6-3d138ffab288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:47.043010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f330cc-858d-42a8-b002-52552dff5e9d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:47.043137 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd0921-34af-4497-8ee6-3d138ffab288 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:47.043903 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd0921-34af-4497-8ee6-3d138ffab288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:47.046111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd0921-34af-4497-8ee6-3d138ffab288 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:47.059071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 944/1889] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:47.062659 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd0921-34af-4497-8ee6-3d138ffab288 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:47.066892 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 946/1890] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:47 2022] PUT /identity/v3/projects/abab1281e2f648518891ffea3dc3da7d/users/2cf42785adeb4beba6d7f85d0fce4a1a/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:20:47.075666 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed45e3-0db2-4f46-a338-5900c5963a37 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:47.075959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed45e3-0db2-4f46-a338-5900c5963a37 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:47.076229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed45e3-0db2-4f46-a338-5900c5963a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:47.078572 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd0921-34af-4497-8ee6-3d138ffab288 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:47.122116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-96ed45e3-0db2-4f46-a338-5900c5963a37 None None] MFA Rules not processed for user `2cf42785adeb4beba6d7f85d0fce4a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:47.123645 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-96ed45e3-0db2-4f46-a338-5900c5963a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:47.148866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:47.176073 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f30419-2994-4892-92cc-6e218825f4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:47.176719 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f30419-2994-4892-92cc-6e218825f4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:47.177094 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f30419-2994-4892-92cc-6e218825f4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:47.177436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f30419-2994-4892-92cc-6e218825f4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:47.178444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f30419-2994-4892-92cc-6e218825f4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:47.180661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f30419-2994-4892-92cc-6e218825f4e6 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:47.198108 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 945/1891] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:20:47.199043 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f30419-2994-4892-92cc-6e218825f4e6 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:47.213439 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f30419-2994-4892-92cc-6e218825f4e6 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:47.218305 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942ca94-2d3d-44cd-a566-1907387b88f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:47.219072 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942ca94-2d3d-44cd-a566-1907387b88f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:47.219355 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942ca94-2d3d-44cd-a566-1907387b88f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:47.219701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942ca94-2d3d-44cd-a566-1907387b88f8 admin admin] PATH_INFO: `/v3/projects/b660d00d61b145a1b8967640dc8b1212/users/f35e9efba95e45fab8b633f0053c5483/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:47.224033 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 947/1892] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:47.236432 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed45e3-0db2-4f46-a338-5900c5963a37 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:47.238536 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-96ed45e3-0db2-4f46-a338-5900c5963a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:47.247408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942ca94-2d3d-44cd-a566-1907387b88f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b660d00d61b145a1b8967640dc8b1212, user_id=f35e9efba95e45fab8b633f0053c5483, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:47.250586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942ca94-2d3d-44cd-a566-1907387b88f8 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:47.272596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 946/1893] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:47 2022] PUT /identity/v3/projects/b660d00d61b145a1b8967640dc8b1212/users/f35e9efba95e45fab8b633f0053c5483/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:47.284782 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ecdea-468f-4cc6-b708-aa7b71c621b3 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:47.285216 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ecdea-468f-4cc6-b708-aa7b71c621b3 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:47.286052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ecdea-468f-4cc6-b708-aa7b71c621b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:47.320839 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-671ecdea-468f-4cc6-b708-aa7b71c621b3 None None] MFA Rules not processed for user `f35e9efba95e45fab8b633f0053c5483`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:47.322156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-671ecdea-468f-4cc6-b708-aa7b71c621b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:47.362012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed45e3-0db2-4f46-a338-5900c5963a37 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:47.458164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2f1ff-d953-4eb6-933a-59a984d31b88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:47.458851 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2f1ff-d953-4eb6-933a-59a984d31b88 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:47.459298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2f1ff-d953-4eb6-933a-59a984d31b88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:47.459644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2f1ff-d953-4eb6-933a-59a984d31b88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:47.465836 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 947/1894] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:47.466826 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ecdea-468f-4cc6-b708-aa7b71c621b3 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:47.484871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:47.571919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2f1ff-d953-4eb6-933a-59a984d31b88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:47.574061 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2f1ff-d953-4eb6-933a-59a984d31b88 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:47.596158 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ecdea-468f-4cc6-b708-aa7b71c621b3 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:47.599979 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 948/1895] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:47.603432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3933e5-6a0c-4929-b142-5a445e48b5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:47.604105 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3933e5-6a0c-4929-b142-5a445e48b5ac admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:47.604393 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3933e5-6a0c-4929-b142-5a445e48b5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:47.604673 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3933e5-6a0c-4929-b142-5a445e48b5ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:47.605744 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3933e5-6a0c-4929-b142-5a445e48b5ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:47.607765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3933e5-6a0c-4929-b142-5a445e48b5ac admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:47.622973 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2f1ff-d953-4eb6-933a-59a984d31b88 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:47.631757 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2f1ff-d953-4eb6-933a-59a984d31b88 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:47.650590 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c91b95-197a-4443-b892-def741a34294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:47.651787 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c91b95-197a-4443-b892-def741a34294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:47.652075 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c91b95-197a-4443-b892-def741a34294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:47.652354 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c91b95-197a-4443-b892-def741a34294 admin admin] PATH_INFO: `/v3/users/2cf42785adeb4beba6d7f85d0fce4a1a` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:47.654948 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 948/1896] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:47 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:47.659826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c91b95-197a-4443-b892-def741a34294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf42785adeb4beba6d7f85d0fce4a1a)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:47.661973 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3933e5-6a0c-4929-b142-5a445e48b5ac admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:47.662313 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c91b95-197a-4443-b892-def741a34294 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:47.722280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-59c91b95-197a-4443-b892-def741a34294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf42785adeb4beba6d7f85d0fce4a1a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:47.724738 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:47.730589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-59c91b95-197a-4443-b892-def741a34294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf42785adeb4beba6d7f85d0fce4a1a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:47.731378 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-59c91b95-197a-4443-b892-def741a34294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf42785adeb4beba6d7f85d0fce4a1a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:47.744570 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-59c91b95-197a-4443-b892-def741a34294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf42785adeb4beba6d7f85d0fce4a1a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:47.745501 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3933e5-6a0c-4929-b142-5a445e48b5ac admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:47.750346 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d203f5-c7e5-4465-bd3a-6a9086d05468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:47.750986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d203f5-c7e5-4465-bd3a-6a9086d05468 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:47.751272 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d203f5-c7e5-4465-bd3a-6a9086d05468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:47.751569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d203f5-c7e5-4465-bd3a-6a9086d05468 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:47.752760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-59c91b95-197a-4443-b892-def741a34294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf42785adeb4beba6d7f85d0fce4a1a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:47.752940 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d203f5-c7e5-4465-bd3a-6a9086d05468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:47.754944 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d203f5-c7e5-4465-bd3a-6a9086d05468 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:47.759009 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 949/1897] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:47 2022] DELETE /identity/v3/users/2cf42785adeb4beba6d7f85d0fce4a1a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:47.763341 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44604e-a084-4221-a6a5-3a4ec239fd12 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:47.763625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44604e-a084-4221-a6a5-3a4ec239fd12 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:47.764266 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44604e-a084-4221-a6a5-3a4ec239fd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:47.780716 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 949/1898] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:47 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:20:47.781762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d203f5-c7e5-4465-bd3a-6a9086d05468 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:47.783564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-17d203f5-c7e5-4465-bd3a-6a9086d05468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:47.784049 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8d44604e-a084-4221-a6a5-3a4ec239fd12 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:47.785238 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8d44604e-a084-4221-a6a5-3a4ec239fd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:47.796218 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d203f5-c7e5-4465-bd3a-6a9086d05468 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:47.844650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 950/1899] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:47.854549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44604e-a084-4221-a6a5-3a4ec239fd12 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:47.856107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8d44604e-a084-4221-a6a5-3a4ec239fd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:47.861506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1513c8-37c8-4c1f-a4b0-8036d8342844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:47.862133 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1513c8-37c8-4c1f-a4b0-8036d8342844 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:47.862414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1513c8-37c8-4c1f-a4b0-8036d8342844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:47.862731 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1513c8-37c8-4c1f-a4b0-8036d8342844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:47.863764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1513c8-37c8-4c1f-a4b0-8036d8342844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:47.865766 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1513c8-37c8-4c1f-a4b0-8036d8342844 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:47.877678 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 950/1900] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:47.881554 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1513c8-37c8-4c1f-a4b0-8036d8342844 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:47.890418 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:47.894211 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1513c8-37c8-4c1f-a4b0-8036d8342844 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:47.899756 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0926247-c662-4799-a32f-49505c539168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:47.900267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0926247-c662-4799-a32f-49505c539168 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:47.900524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0926247-c662-4799-a32f-49505c539168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:47.900812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0926247-c662-4799-a32f-49505c539168 admin admin] PATH_INFO: `/v3/projects/35d80f08c6554d40928009e2e07490be/users/8e5a8eb54ea841e8a56eb806cf1e896a/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:47.916821 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0926247-c662-4799-a32f-49505c539168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d80f08c6554d40928009e2e07490be, user_id=8e5a8eb54ea841e8a56eb806cf1e896a, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:47.919627 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0926247-c662-4799-a32f-49505c539168 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:47.926294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44604e-a084-4221-a6a5-3a4ec239fd12 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:47.930622 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121367c-d629-4c28-bdcb-60258963bcee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:47.931295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121367c-d629-4c28-bdcb-60258963bcee service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:47.931971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121367c-d629-4c28-bdcb-60258963bcee service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:47.932415 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121367c-d629-4c28-bdcb-60258963bcee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:47.939072 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 951/1901] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:47 2022] PUT /identity/v3/projects/35d80f08c6554d40928009e2e07490be/users/8e5a8eb54ea841e8a56eb806cf1e896a/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:47.943789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0926247-c662-4799-a32f-49505c539168 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:47.973591 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121367c-d629-4c28-bdcb-60258963bcee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:47.975214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121367c-d629-4c28-bdcb-60258963bcee service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:47.995688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 951/1902] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:48.039393 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0926247-c662-4799-a32f-49505c539168 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:48.045022 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414665f-c189-4a99-b57c-b25f584a3d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:48.046216 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414665f-c189-4a99-b57c-b25f584a3d68 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:48.046900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414665f-c189-4a99-b57c-b25f584a3d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:48.048028 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414665f-c189-4a99-b57c-b25f584a3d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:48.049394 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414665f-c189-4a99-b57c-b25f584a3d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:48.051592 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414665f-c189-4a99-b57c-b25f584a3d68 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:48.072701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 952/1903] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:48.073855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121367c-d629-4c28-bdcb-60258963bcee service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:48.084036 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121367c-d629-4c28-bdcb-60258963bcee service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:48.089224 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae7fd2-22b3-45a9-8be6-544ac65b859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:48.089983 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae7fd2-22b3-45a9-8be6-544ac65b859a admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:48.090265 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae7fd2-22b3-45a9-8be6-544ac65b859a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:48.090620 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae7fd2-22b3-45a9-8be6-544ac65b859a admin admin] PATH_INFO: `/v3/projects/35d80f08c6554d40928009e2e07490be/users/8e5a8eb54ea841e8a56eb806cf1e896a/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:48.092844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae7fd2-22b3-45a9-8be6-544ac65b859a admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d80f08c6554d40928009e2e07490be, user_id=8e5a8eb54ea841e8a56eb806cf1e896a, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:48.095797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae7fd2-22b3-45a9-8be6-544ac65b859a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:48.116489 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 952/1904] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:48 2022] PUT /identity/v3/projects/35d80f08c6554d40928009e2e07490be/users/8e5a8eb54ea841e8a56eb806cf1e896a/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:48.121809 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f246b-fa6b-4f92-aa80-fc0409c25199 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:48.122144 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f246b-fa6b-4f92-aa80-fc0409c25199 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:48.122425 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f246b-fa6b-4f92-aa80-fc0409c25199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:48.187424 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0e0f246b-fa6b-4f92-aa80-fc0409c25199 None None] MFA Rules not processed for user `8e5a8eb54ea841e8a56eb806cf1e896a`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:48.188827 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0e0f246b-fa6b-4f92-aa80-fc0409c25199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:48.226458 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:48.283043 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 953/1905] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:48.297465 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae7fd2-22b3-45a9-8be6-544ac65b859a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:48.302424 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4bae7fd2-22b3-45a9-8be6-544ac65b859a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:48.371603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae7fd2-22b3-45a9-8be6-544ac65b859a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:48.375385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131c593-c042-42c5-a633-a0e7a70ead27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:48.376130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131c593-c042-42c5-a633-a0e7a70ead27 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:48.376418 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131c593-c042-42c5-a633-a0e7a70ead27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:48.376694 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131c593-c042-42c5-a633-a0e7a70ead27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:48.387530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131c593-c042-42c5-a633-a0e7a70ead27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:48.389298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131c593-c042-42c5-a633-a0e7a70ead27 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:48.400899 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 953/1906] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:48.407889 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f246b-fa6b-4f92-aa80-fc0409c25199 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:48.410704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0e0f246b-fa6b-4f92-aa80-fc0409c25199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:48.488903 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f246b-fa6b-4f92-aa80-fc0409c25199 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:48.493736 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3ec4e-8264-4943-8fdc-0457e86680da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:48.494368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3ec4e-8264-4943-8fdc-0457e86680da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:48.494649 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3ec4e-8264-4943-8fdc-0457e86680da admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:48.494950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3ec4e-8264-4943-8fdc-0457e86680da admin admin] PATH_INFO: `/v3/projects/abab1281e2f648518891ffea3dc3da7d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:48.496073 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3ec4e-8264-4943-8fdc-0457e86680da admin admin] RBAC: Authorizing `identity:delete_project(project_id=abab1281e2f648518891ffea3dc3da7d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:48.497726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131c593-c042-42c5-a633-a0e7a70ead27 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:48.497977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3ec4e-8264-4943-8fdc-0457e86680da admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:48.507868 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131c593-c042-42c5-a633-a0e7a70ead27 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:48.512783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a1f9-9784-4319-9d76-3da179249f31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:48.513623 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a1f9-9784-4319-9d76-3da179249f31 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:48.514072 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a1f9-9784-4319-9d76-3da179249f31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:48.514346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a1f9-9784-4319-9d76-3da179249f31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:48.516338 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3d44a1f9-9784-4319-9d76-3da179249f31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:48.554998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-22b3ec4e-8264-4943-8fdc-0457e86680da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abab1281e2f648518891ffea3dc3da7d', 'request_id': 'req-22b3ec4e-8264-4943-8fdc-0457e86680da'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:48.562860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-22b3ec4e-8264-4943-8fdc-0457e86680da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abab1281e2f648518891ffea3dc3da7d', 'request_id': 'req-22b3ec4e-8264-4943-8fdc-0457e86680da'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:48.576475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-22b3ec4e-8264-4943-8fdc-0457e86680da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abab1281e2f648518891ffea3dc3da7d', 'request_id': 'req-22b3ec4e-8264-4943-8fdc-0457e86680da'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:48.591436 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44a1f9-9784-4319-9d76-3da179249f31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:48.591961 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-22b3ec4e-8264-4943-8fdc-0457e86680da admin admin] The token cache is being invalidate because project abab1281e2f648518891ffea3dc3da7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:48.593067 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-22b3ec4e-8264-4943-8fdc-0457e86680da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:48.593187 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44a1f9-9784-4319-9d76-3da179249f31 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:48.593760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-22b3ec4e-8264-4943-8fdc-0457e86680da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:48.597012 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 954/1907] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:48 2022] DELETE /identity/v3/projects/abab1281e2f648518891ffea3dc3da7d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:48.602755 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e66340-8090-47b9-a455-7c4354c0d454 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:48.603204 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e66340-8090-47b9-a455-7c4354c0d454 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:48.603551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e66340-8090-47b9-a455-7c4354c0d454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:48.628554 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 954/1908] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:20:48.629378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-72e66340-8090-47b9-a455-7c4354c0d454 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:48.631066 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-72e66340-8090-47b9-a455-7c4354c0d454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:48.747476 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:48.784557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 955/1909] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:48.792576 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a875659-cacc-4d2a-a8ec-b3ebd72e30ea None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:48.792892 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a875659-cacc-4d2a-a8ec-b3ebd72e30ea None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:48.793198 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a875659-cacc-4d2a-a8ec-b3ebd72e30ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:48.814274 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-2a875659-cacc-4d2a-a8ec-b3ebd72e30ea None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:48.815557 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2a875659-cacc-4d2a-a8ec-b3ebd72e30ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:48.824011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 955/1910] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:48.828251 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e66340-8090-47b9-a455-7c4354c0d454 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:48.839316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e66340-8090-47b9-a455-7c4354c0d454 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:48.852141 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c7af0-eda6-4674-be3d-b4493b717104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:48.852765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c7af0-eda6-4674-be3d-b4493b717104 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:48.853372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c7af0-eda6-4674-be3d-b4493b717104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:48.853652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c7af0-eda6-4674-be3d-b4493b717104 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:48.854318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c7af0-eda6-4674-be3d-b4493b717104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:48.854626 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c7af0-eda6-4674-be3d-b4493b717104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:48.856976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c7af0-eda6-4674-be3d-b4493b717104 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:48.877758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 956/1911] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:48.884972 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a875659-cacc-4d2a-a8ec-b3ebd72e30ea None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:48.894902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a875659-cacc-4d2a-a8ec-b3ebd72e30ea None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:48.900373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ec824-d675-47f4-8416-047d51c5d86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:48.901599 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ec824-d675-47f4-8416-047d51c5d86b admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:48.902119 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ec824-d675-47f4-8416-047d51c5d86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:48.902585 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ec824-d675-47f4-8416-047d51c5d86b admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:48.903607 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ec824-d675-47f4-8416-047d51c5d86b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:48.907917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ec824-d675-47f4-8416-047d51c5d86b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:48.960222 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 956/1912] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:48 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:20:48.962552 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c7af0-eda6-4674-be3d-b4493b717104 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:48.969164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ec824-d675-47f4-8416-047d51c5d86b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:48.971524 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-393ec824-d675-47f4-8416-047d51c5d86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:48.975979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c7af0-eda6-4674-be3d-b4493b717104 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:49.013412 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:49.038945 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c406b74-c4f2-4876-9920-7359c8ae8697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:49.039556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c406b74-c4f2-4876-9920-7359c8ae8697 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:49.039841 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c406b74-c4f2-4876-9920-7359c8ae8697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:49.040121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c406b74-c4f2-4876-9920-7359c8ae8697 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:49.040756 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c406b74-c4f2-4876-9920-7359c8ae8697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:49.042779 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c406b74-c4f2-4876-9920-7359c8ae8697 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:49.046100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ec824-d675-47f4-8416-047d51c5d86b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:49.050669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced09eb1-f75b-4fe1-a461-d6f08aa7276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:49.051325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced09eb1-f75b-4fe1-a461-d6f08aa7276a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:49.051606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced09eb1-f75b-4fe1-a461-d6f08aa7276a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:49.051882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced09eb1-f75b-4fe1-a461-d6f08aa7276a admin admin] PATH_INFO: `/v3/users/f35e9efba95e45fab8b633f0053c5483` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:49.053037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced09eb1-f75b-4fe1-a461-d6f08aa7276a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f35e9efba95e45fab8b633f0053c5483)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:49.054961 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced09eb1-f75b-4fe1-a461-d6f08aa7276a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:49.066700 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 957/1913] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:48 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:49.067774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c406b74-c4f2-4876-9920-7359c8ae8697 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:49.069931 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5c406b74-c4f2-4876-9920-7359c8ae8697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:49.104882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ced09eb1-f75b-4fe1-a461-d6f08aa7276a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f35e9efba95e45fab8b633f0053c5483'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:49.112085 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ced09eb1-f75b-4fe1-a461-d6f08aa7276a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f35e9efba95e45fab8b633f0053c5483'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:49.112834 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ced09eb1-f75b-4fe1-a461-d6f08aa7276a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f35e9efba95e45fab8b633f0053c5483'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:49.125639 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ced09eb1-f75b-4fe1-a461-d6f08aa7276a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f35e9efba95e45fab8b633f0053c5483'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:49.129248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c406b74-c4f2-4876-9920-7359c8ae8697 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:49.133446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddb41e-f3ec-492b-9d7c-53b62dbf4c7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:49.134150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddb41e-f3ec-492b-9d7c-53b62dbf4c7c service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:49.134378 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ced09eb1-f75b-4fe1-a461-d6f08aa7276a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f35e9efba95e45fab8b633f0053c5483'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:49.134484 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddb41e-f3ec-492b-9d7c-53b62dbf4c7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:49.134852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddb41e-f3ec-492b-9d7c-53b62dbf4c7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:49.136730 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ebddb41e-f3ec-492b-9d7c-53b62dbf4c7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:49.140388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 957/1914] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:48 2022] DELETE /identity/v3/users/f35e9efba95e45fab8b633f0053c5483 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:20:49.141236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced09eb1-f75b-4fe1-a461-d6f08aa7276a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:49.142562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ced09eb1-f75b-4fe1-a461-d6f08aa7276a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:49.206322 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddb41e-f3ec-492b-9d7c-53b62dbf4c7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:49.207704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddb41e-f3ec-492b-9d7c-53b62dbf4c7c service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:49.217087 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 958/1915] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:49.218385 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acb9b2-1f71-437c-9e39-81e76dd41963 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:49.218670 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acb9b2-1f71-437c-9e39-81e76dd41963 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:49.218967 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acb9b2-1f71-437c-9e39-81e76dd41963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:49.219073 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced09eb1-f75b-4fe1-a461-d6f08aa7276a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:49.227195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ac0cf-c13f-40f6-a941-f972e0956b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:49.227834 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ac0cf-c13f-40f6-a941-f972e0956b27 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:49.228125 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ac0cf-c13f-40f6-a941-f972e0956b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:49.228482 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ac0cf-c13f-40f6-a941-f972e0956b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:49.229065 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ac0cf-c13f-40f6-a941-f972e0956b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:49.230694 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ac0cf-c13f-40f6-a941-f972e0956b27 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:49.239703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-41acb9b2-1f71-437c-9e39-81e76dd41963 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:49.240921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-41acb9b2-1f71-437c-9e39-81e76dd41963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:49.242306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 958/1916] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:49.247581 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ac0cf-c13f-40f6-a941-f972e0956b27 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:49.249098 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 959/1917] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:49.260427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ac0cf-c13f-40f6-a941-f972e0956b27 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:49.266088 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acb9b2-1f71-437c-9e39-81e76dd41963 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:49.269096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-41acb9b2-1f71-437c-9e39-81e76dd41963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:49.270711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cf287-9996-41be-ac90-c98099c4406a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:49.271430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cf287-9996-41be-ac90-c98099c4406a admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:49.271768 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cf287-9996-41be-ac90-c98099c4406a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:49.272053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cf287-9996-41be-ac90-c98099c4406a admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:49.272956 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cf287-9996-41be-ac90-c98099c4406a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:49.274487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cf287-9996-41be-ac90-c98099c4406a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:49.289004 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 959/1918] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:49.293432 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cf287-9996-41be-ac90-c98099c4406a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:49.306632 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cf287-9996-41be-ac90-c98099c4406a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:49.308279 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:49.316970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5096e50-af4c-4213-8a0d-acb392175dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:49.317631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5096e50-af4c-4213-8a0d-acb392175dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:49.318052 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5096e50-af4c-4213-8a0d-acb392175dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:49.318377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5096e50-af4c-4213-8a0d-acb392175dcf admin admin] PATH_INFO: `/v3/projects/f02a9ea9eefe49ba9a533e7b0672b9a9/users/8526a97b881f44d8838f39b7f863fd87/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:49.417494 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acb9b2-1f71-437c-9e39-81e76dd41963 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:49.431209 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84243ae6-105d-467b-ad9b-4828dcb997c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:49.432058 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84243ae6-105d-467b-ad9b-4828dcb997c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:49.432443 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84243ae6-105d-467b-ad9b-4828dcb997c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:49.432864 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84243ae6-105d-467b-ad9b-4828dcb997c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:49.472794 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84243ae6-105d-467b-ad9b-4828dcb997c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:49.474538 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84243ae6-105d-467b-ad9b-4828dcb997c3 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:49.504445 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5096e50-af4c-4213-8a0d-acb392175dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02a9ea9eefe49ba9a533e7b0672b9a9, user_id=8526a97b881f44d8838f39b7f863fd87, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:49.505972 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 960/1919] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:49.508816 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5096e50-af4c-4213-8a0d-acb392175dcf admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:49.536984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 960/1920] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:49 2022] PUT /identity/v3/projects/f02a9ea9eefe49ba9a533e7b0672b9a9/users/8526a97b881f44d8838f39b7f863fd87/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:49.548610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55fb98-3220-4cee-8885-b0339efb7319 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:49.549466 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55fb98-3220-4cee-8885-b0339efb7319 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:49.550318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55fb98-3220-4cee-8885-b0339efb7319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:49.595962 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-2b55fb98-3220-4cee-8885-b0339efb7319 None None] MFA Rules not processed for user `8526a97b881f44d8838f39b7f863fd87`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:49.598080 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2b55fb98-3220-4cee-8885-b0339efb7319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:49.687077 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 961/1921] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:49.968526 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5096e50-af4c-4213-8a0d-acb392175dcf admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:49.971974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d5096e50-af4c-4213-8a0d-acb392175dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:50.011625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:50.098398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5096e50-af4c-4213-8a0d-acb392175dcf admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:50.104674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5b5eb-cbc3-4f36-ae07-c1fc188f8197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:50.105438 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5b5eb-cbc3-4f36-ae07-c1fc188f8197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:50.105851 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5b5eb-cbc3-4f36-ae07-c1fc188f8197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:50.106226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5b5eb-cbc3-4f36-ae07-c1fc188f8197 admin admin] PATH_INFO: `/v3/projects/b660d00d61b145a1b8967640dc8b1212` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:50.108518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5b5eb-cbc3-4f36-ae07-c1fc188f8197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b660d00d61b145a1b8967640dc8b1212)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:50.110773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5b5eb-cbc3-4f36-ae07-c1fc188f8197 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:50.130828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55fb98-3220-4cee-8885-b0339efb7319 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:50.132477 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2b55fb98-3220-4cee-8885-b0339efb7319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:50.173201 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-48c5b5eb-cbc3-4f36-ae07-c1fc188f8197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b660d00d61b145a1b8967640dc8b1212', 'request_id': 'req-48c5b5eb-cbc3-4f36-ae07-c1fc188f8197'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:50.180176 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-48c5b5eb-cbc3-4f36-ae07-c1fc188f8197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b660d00d61b145a1b8967640dc8b1212', 'request_id': 'req-48c5b5eb-cbc3-4f36-ae07-c1fc188f8197'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:50.189164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-48c5b5eb-cbc3-4f36-ae07-c1fc188f8197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b660d00d61b145a1b8967640dc8b1212', 'request_id': 'req-48c5b5eb-cbc3-4f36-ae07-c1fc188f8197'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:50.203356 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55fb98-3220-4cee-8885-b0339efb7319 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:50.204243 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-48c5b5eb-cbc3-4f36-ae07-c1fc188f8197 admin admin] The token cache is being invalidate because project b660d00d61b145a1b8967640dc8b1212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:50.204542 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-48c5b5eb-cbc3-4f36-ae07-c1fc188f8197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:50.206849 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-48c5b5eb-cbc3-4f36-ae07-c1fc188f8197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:50.208395 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 961/1922] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:49 2022] DELETE /identity/v3/projects/b660d00d61b145a1b8967640dc8b1212 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:50.212283 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5b5eb-cbc3-4f36-ae07-c1fc188f8197 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:50.213834 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-48c5b5eb-cbc3-4f36-ae07-c1fc188f8197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:50.275294 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe397b16-a43a-42e1-9f5d-e4887f339300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:50.276734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe397b16-a43a-42e1-9f5d-e4887f339300 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:50.277225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe397b16-a43a-42e1-9f5d-e4887f339300 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:50.277674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe397b16-a43a-42e1-9f5d-e4887f339300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:50.279921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fe397b16-a43a-42e1-9f5d-e4887f339300 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:50.294257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5b5eb-cbc3-4f36-ae07-c1fc188f8197 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:50.300081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da878ac5-2da4-46fa-8982-797341b42e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:50.300840 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da878ac5-2da4-46fa-8982-797341b42e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:50.301322 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da878ac5-2da4-46fa-8982-797341b42e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:50.301785 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da878ac5-2da4-46fa-8982-797341b42e45 admin admin] PATH_INFO: `/v3/users/8e5a8eb54ea841e8a56eb806cf1e896a` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:50.303044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da878ac5-2da4-46fa-8982-797341b42e45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e5a8eb54ea841e8a56eb806cf1e896a)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:50.305000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da878ac5-2da4-46fa-8982-797341b42e45 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:50.307389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:50.357565 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe397b16-a43a-42e1-9f5d-e4887f339300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:50.358080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:50.359065 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe397b16-a43a-42e1-9f5d-e4887f339300 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:50.362344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-da878ac5-2da4-46fa-8982-797341b42e45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e5a8eb54ea841e8a56eb806cf1e896a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:50.373355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-da878ac5-2da4-46fa-8982-797341b42e45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e5a8eb54ea841e8a56eb806cf1e896a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:50.374437 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-da878ac5-2da4-46fa-8982-797341b42e45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e5a8eb54ea841e8a56eb806cf1e896a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:50.381179 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 962/1923] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:50.410022 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-da878ac5-2da4-46fa-8982-797341b42e45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e5a8eb54ea841e8a56eb806cf1e896a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:50.419236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-da878ac5-2da4-46fa-8982-797341b42e45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e5a8eb54ea841e8a56eb806cf1e896a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:50.427708 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 962/1924] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:50 2022] DELETE /identity/v3/users/8e5a8eb54ea841e8a56eb806cf1e896a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:20:50.950712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe397b16-a43a-42e1-9f5d-e4887f339300 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:50.962178 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe397b16-a43a-42e1-9f5d-e4887f339300 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:51.025281 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004daaf-05ab-405a-85fc-0bc22c773695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:51.025874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004daaf-05ab-405a-85fc-0bc22c773695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:51.026151 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004daaf-05ab-405a-85fc-0bc22c773695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:51.026421 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004daaf-05ab-405a-85fc-0bc22c773695 admin admin] PATH_INFO: `/v3/projects/35d80f08c6554d40928009e2e07490be` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:51.027630 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004daaf-05ab-405a-85fc-0bc22c773695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d80f08c6554d40928009e2e07490be)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:51.029705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004daaf-05ab-405a-85fc-0bc22c773695 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:51.089777 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2004daaf-05ab-405a-85fc-0bc22c773695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d80f08c6554d40928009e2e07490be', 'request_id': 'req-2004daaf-05ab-405a-85fc-0bc22c773695'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:51.096396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2004daaf-05ab-405a-85fc-0bc22c773695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d80f08c6554d40928009e2e07490be', 'request_id': 'req-2004daaf-05ab-405a-85fc-0bc22c773695'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:51.105484 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2004daaf-05ab-405a-85fc-0bc22c773695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d80f08c6554d40928009e2e07490be', 'request_id': 'req-2004daaf-05ab-405a-85fc-0bc22c773695'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:51.124832 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2004daaf-05ab-405a-85fc-0bc22c773695 admin admin] The token cache is being invalidate because project 35d80f08c6554d40928009e2e07490be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:51.125175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2004daaf-05ab-405a-85fc-0bc22c773695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:51.125955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2004daaf-05ab-405a-85fc-0bc22c773695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:51.130573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 963/1925] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:50 2022] DELETE /identity/v3/projects/35d80f08c6554d40928009e2e07490be => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:51.133164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a1663-49c5-4e6f-b249-409e973b71fc None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:51.133646 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a1663-49c5-4e6f-b249-409e973b71fc None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:51.133755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a1663-49c5-4e6f-b249-409e973b71fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:51.153851 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d46a1663-49c5-4e6f-b249-409e973b71fc None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:51.155120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d46a1663-49c5-4e6f-b249-409e973b71fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:51.226839 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 963/1926] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:51.234996 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea528bd-4284-4c60-8b13-0bba13ceec47 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:51.235293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea528bd-4284-4c60-8b13-0bba13ceec47 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:51.235576 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea528bd-4284-4c60-8b13-0bba13ceec47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:51.257285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-eea528bd-4284-4c60-8b13-0bba13ceec47 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:51.258705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-eea528bd-4284-4c60-8b13-0bba13ceec47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:51.266658 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 964/1927] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:51.271950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a1663-49c5-4e6f-b249-409e973b71fc None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:51.281679 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a1663-49c5-4e6f-b249-409e973b71fc None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:51.286090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0375a-e832-4596-b62d-707fc6aa4965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:51.286678 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0375a-e832-4596-b62d-707fc6aa4965 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:51.286993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0375a-e832-4596-b62d-707fc6aa4965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:51.287264 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0375a-e832-4596-b62d-707fc6aa4965 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:51.287920 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0375a-e832-4596-b62d-707fc6aa4965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:51.288223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0375a-e832-4596-b62d-707fc6aa4965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:51.289817 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0375a-e832-4596-b62d-707fc6aa4965 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:51.302267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 964/1928] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:20:51.306587 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea528bd-4284-4c60-8b13-0bba13ceec47 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:51.316555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea528bd-4284-4c60-8b13-0bba13ceec47 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:51.322335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85f561-7b04-4927-a5a0-c7424fec7beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:51.323237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85f561-7b04-4927-a5a0-c7424fec7beb admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:51.323752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85f561-7b04-4927-a5a0-c7424fec7beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:51.324264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85f561-7b04-4927-a5a0-c7424fec7beb admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:51.325394 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85f561-7b04-4927-a5a0-c7424fec7beb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:51.327400 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85f561-7b04-4927-a5a0-c7424fec7beb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:51.364501 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 965/1929] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:51 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:20:51.368858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0375a-e832-4596-b62d-707fc6aa4965 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:51.378879 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0375a-e832-4596-b62d-707fc6aa4965 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:51.438044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439f6a5-61db-4f72-8f90-1d12f559fcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:51.438652 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439f6a5-61db-4f72-8f90-1d12f559fcb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:51.438968 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439f6a5-61db-4f72-8f90-1d12f559fcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:51.439249 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439f6a5-61db-4f72-8f90-1d12f559fcb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:51.439943 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439f6a5-61db-4f72-8f90-1d12f559fcb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:51.442188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439f6a5-61db-4f72-8f90-1d12f559fcb6 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:51.462986 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 965/1930] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:51 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:20:51.467291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85f561-7b04-4927-a5a0-c7424fec7beb admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:51.478028 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85f561-7b04-4927-a5a0-c7424fec7beb admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:51.482907 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa84e09-7d59-4aba-b75d-e745282c65e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:51.483507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa84e09-7d59-4aba-b75d-e745282c65e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:51.483790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa84e09-7d59-4aba-b75d-e745282c65e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:51.484065 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa84e09-7d59-4aba-b75d-e745282c65e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:51.484712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa84e09-7d59-4aba-b75d-e745282c65e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:51.486989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa84e09-7d59-4aba-b75d-e745282c65e6 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:51.496845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 966/1931] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:51.500559 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439f6a5-61db-4f72-8f90-1d12f559fcb6 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:51.510366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439f6a5-61db-4f72-8f90-1d12f559fcb6 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:51.515071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4705d-3672-42fa-a01f-85324d404493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:51.515676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4705d-3672-42fa-a01f-85324d404493 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:51.515962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4705d-3672-42fa-a01f-85324d404493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:51.516250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4705d-3672-42fa-a01f-85324d404493 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:51.516887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4705d-3672-42fa-a01f-85324d404493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:51.518570 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4705d-3672-42fa-a01f-85324d404493 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:51.528916 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 966/1932] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:51.533721 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa84e09-7d59-4aba-b75d-e745282c65e6 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:51.543940 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa84e09-7d59-4aba-b75d-e745282c65e6 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:51.549668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5340f0-01b7-4a58-b82f-bd16a6ff6671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:51.550336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5340f0-01b7-4a58-b82f-bd16a6ff6671 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:51.550606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5340f0-01b7-4a58-b82f-bd16a6ff6671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:51.550916 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5340f0-01b7-4a58-b82f-bd16a6ff6671 admin admin] PATH_INFO: `/v3/projects/2629bb2296a74447b7fcd974cffd5da9/users/ccc19ebd67644683a9e199820f715b3a/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:51.564228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:51.569675 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5340f0-01b7-4a58-b82f-bd16a6ff6671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2629bb2296a74447b7fcd974cffd5da9, user_id=ccc19ebd67644683a9e199820f715b3a, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:51.572681 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5340f0-01b7-4a58-b82f-bd16a6ff6671 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:51.589090 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 967/1933] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:51 2022] PUT /identity/v3/projects/2629bb2296a74447b7fcd974cffd5da9/users/ccc19ebd67644683a9e199820f715b3a/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:51.599923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b18b57-a4e6-4e64-b9a1-363651d76445 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:51.600337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b18b57-a4e6-4e64-b9a1-363651d76445 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:51.600626 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b18b57-a4e6-4e64-b9a1-363651d76445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:51.642310 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f5b18b57-a4e6-4e64-b9a1-363651d76445 None None] MFA Rules not processed for user `ccc19ebd67644683a9e199820f715b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:51.643926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f5b18b57-a4e6-4e64-b9a1-363651d76445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:51.658737 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:51.721869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 967/1934] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:51.726457 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5340f0-01b7-4a58-b82f-bd16a6ff6671 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:51.884831 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5340f0-01b7-4a58-b82f-bd16a6ff6671 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:51.898777 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b06e6-b2ca-478d-a66e-53a78198c59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:51.899540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b06e6-b2ca-478d-a66e-53a78198c59b admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:51.899727 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b06e6-b2ca-478d-a66e-53a78198c59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:51.899956 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b06e6-b2ca-478d-a66e-53a78198c59b admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:51.903779 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b06e6-b2ca-478d-a66e-53a78198c59b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:51.907512 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b06e6-b2ca-478d-a66e-53a78198c59b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:51.974504 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 968/1935] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:51 2022] POST /identity/v3/projects => generated 375 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:51.978341 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b18b57-a4e6-4e64-b9a1-363651d76445 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:51.997693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b18b57-a4e6-4e64-b9a1-363651d76445 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:52.200805 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3561d-115d-44b4-99f7-259b0f1837a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:52.201487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3561d-115d-44b4-99f7-259b0f1837a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:52.201745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3561d-115d-44b4-99f7-259b0f1837a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:52.202012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3561d-115d-44b4-99f7-259b0f1837a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:52.202643 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3561d-115d-44b4-99f7-259b0f1837a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:52.207271 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3561d-115d-44b4-99f7-259b0f1837a0 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:52.269244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 968/1936] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:51 2022] POST /identity/v3/users => generated 294 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:52.273521 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b06e6-b2ca-478d-a66e-53a78198c59b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:52.291793 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b06e6-b2ca-478d-a66e-53a78198c59b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:52.300442 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb065de-3761-4341-b1a3-09367b230778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:52.301222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb065de-3761-4341-b1a3-09367b230778 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:52.301490 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb065de-3761-4341-b1a3-09367b230778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:52.301859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb065de-3761-4341-b1a3-09367b230778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:52.307078 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb065de-3761-4341-b1a3-09367b230778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:52.308896 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb065de-3761-4341-b1a3-09367b230778 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:52.331308 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 969/1937] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:52.347855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3561d-115d-44b4-99f7-259b0f1837a0 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:52.362693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3561d-115d-44b4-99f7-259b0f1837a0 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:52.383534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a819ef4-93d8-4445-8244-36b11a6474f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:52.385263 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a819ef4-93d8-4445-8244-36b11a6474f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:52.385934 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a819ef4-93d8-4445-8244-36b11a6474f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:52.388165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a819ef4-93d8-4445-8244-36b11a6474f3 admin admin] PATH_INFO: `/v3/projects/0b01cfee00d248708e905657e558519b/users/4c20574230044158b4306fa79df269fc/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:52.446883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a819ef4-93d8-4445-8244-36b11a6474f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b01cfee00d248708e905657e558519b, user_id=4c20574230044158b4306fa79df269fc, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:52.456511 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a819ef4-93d8-4445-8244-36b11a6474f3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:52.491301 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 969/1938] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:52 2022] PUT /identity/v3/projects/0b01cfee00d248708e905657e558519b/users/4c20574230044158b4306fa79df269fc/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:52.495413 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb065de-3761-4341-b1a3-09367b230778 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:52.517381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb065de-3761-4341-b1a3-09367b230778 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:52.637357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2abb6-d3a8-4f5b-b41f-b21cbb323d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:52.638149 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2abb6-d3a8-4f5b-b41f-b21cbb323d64 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:52.638438 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2abb6-d3a8-4f5b-b41f-b21cbb323d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:52.638746 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2abb6-d3a8-4f5b-b41f-b21cbb323d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:52.640149 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2abb6-d3a8-4f5b-b41f-b21cbb323d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:52.642339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2abb6-d3a8-4f5b-b41f-b21cbb323d64 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:52.663377 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 970/1939] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:20:52.667403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a819ef4-93d8-4445-8244-36b11a6474f3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:52.685272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a819ef4-93d8-4445-8244-36b11a6474f3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:52.702581 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b68af-d6d9-4ed0-b89e-f3e61291bdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:52.706091 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b68af-d6d9-4ed0-b89e-f3e61291bdf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:52.709106 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b68af-d6d9-4ed0-b89e-f3e61291bdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:52.709820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b68af-d6d9-4ed0-b89e-f3e61291bdf6 admin admin] PATH_INFO: `/v3/projects/0b01cfee00d248708e905657e558519b/users/4c20574230044158b4306fa79df269fc/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:52.720069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b68af-d6d9-4ed0-b89e-f3e61291bdf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b01cfee00d248708e905657e558519b, user_id=4c20574230044158b4306fa79df269fc, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:52.730002 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b68af-d6d9-4ed0-b89e-f3e61291bdf6 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:52.775492 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 970/1940] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:52 2022] PUT /identity/v3/projects/0b01cfee00d248708e905657e558519b/users/4c20574230044158b4306fa79df269fc/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:52.786581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8362bf8-a625-45ea-9a84-744da48acd18 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:52.787136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8362bf8-a625-45ea-9a84-744da48acd18 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:52.787597 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8362bf8-a625-45ea-9a84-744da48acd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:52.840935 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-a8362bf8-a625-45ea-9a84-744da48acd18 None None] MFA Rules not processed for user `4c20574230044158b4306fa79df269fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:52.842365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a8362bf8-a625-45ea-9a84-744da48acd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:52.900336 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b68af-d6d9-4ed0-b89e-f3e61291bdf6 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:52.902136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-185b68af-d6d9-4ed0-b89e-f3e61291bdf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:52.907039 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:52.937153 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 971/1941] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:52.945257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8362bf8-a625-45ea-9a84-744da48acd18 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:52.947893 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a8362bf8-a625-45ea-9a84-744da48acd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:53.011790 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b68af-d6d9-4ed0-b89e-f3e61291bdf6 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:53.016408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d77db-4b11-436f-aba6-e2e24b39a084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:53.017040 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d77db-4b11-436f-aba6-e2e24b39a084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:53.017338 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d77db-4b11-436f-aba6-e2e24b39a084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:53.017634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d77db-4b11-436f-aba6-e2e24b39a084 admin admin] PATH_INFO: `/v3/users/0884862560124bfcacfb175bd681a197` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:53.018810 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d77db-4b11-436f-aba6-e2e24b39a084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0884862560124bfcacfb175bd681a197)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:53.020749 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d77db-4b11-436f-aba6-e2e24b39a084 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:53.031797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:53.032785 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8362bf8-a625-45ea-9a84-744da48acd18 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:53.037142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bed9b6-4b1b-4924-943f-f0a19e78223a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:53.037749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bed9b6-4b1b-4924-943f-f0a19e78223a service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:53.038079 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bed9b6-4b1b-4924-943f-f0a19e78223a service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:53.038449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bed9b6-4b1b-4924-943f-f0a19e78223a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:53.071031 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-df8d77db-4b11-436f-aba6-e2e24b39a084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0884862560124bfcacfb175bd681a197'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:53.078480 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-df8d77db-4b11-436f-aba6-e2e24b39a084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0884862560124bfcacfb175bd681a197'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:53.079245 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-df8d77db-4b11-436f-aba6-e2e24b39a084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0884862560124bfcacfb175bd681a197'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:53.091057 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-df8d77db-4b11-436f-aba6-e2e24b39a084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0884862560124bfcacfb175bd681a197'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:53.099378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bed9b6-4b1b-4924-943f-f0a19e78223a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:53.100039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-df8d77db-4b11-436f-aba6-e2e24b39a084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0884862560124bfcacfb175bd681a197'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:53.100876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bed9b6-4b1b-4924-943f-f0a19e78223a service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:53.108396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 971/1942] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:52 2022] DELETE /identity/v3/users/0884862560124bfcacfb175bd681a197 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:53.113360 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f81acf-6dca-4fd5-b74f-460c7d032552 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:53.113651 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f81acf-6dca-4fd5-b74f-460c7d032552 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:53.113930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f81acf-6dca-4fd5-b74f-460c7d032552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:53.114406 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 972/1943] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:20:53.134786 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-67f81acf-6dca-4fd5-b74f-460c7d032552 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:53.135962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-67f81acf-6dca-4fd5-b74f-460c7d032552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:53.199025 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 972/1944] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:53.210298 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bed9b6-4b1b-4924-943f-f0a19e78223a service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:53.211822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-82bed9b6-4b1b-4924-943f-f0a19e78223a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:53.289710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bed9b6-4b1b-4924-943f-f0a19e78223a service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:53.368197 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ab52b-45ab-4657-87f5-c0d9f8d95d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:53.370029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ab52b-45ab-4657-87f5-c0d9f8d95d6f service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:53.370029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ab52b-45ab-4657-87f5-c0d9f8d95d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:53.370232 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ab52b-45ab-4657-87f5-c0d9f8d95d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:53.395728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ab52b-45ab-4657-87f5-c0d9f8d95d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:53.398008 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ab52b-45ab-4657-87f5-c0d9f8d95d6f service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:53.405464 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:53.423503 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 973/1945] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:54.003663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f81acf-6dca-4fd5-b74f-460c7d032552 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:54.006940 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-67f81acf-6dca-4fd5-b74f-460c7d032552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:54.034461 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f81acf-6dca-4fd5-b74f-460c7d032552 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:54.050171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473f027-e32f-498b-92f8-55a4a5ff9acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:54.052232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473f027-e32f-498b-92f8-55a4a5ff9acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:54.052711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473f027-e32f-498b-92f8-55a4a5ff9acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:54.053158 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473f027-e32f-498b-92f8-55a4a5ff9acd admin admin] PATH_INFO: `/v3/projects/949dda71a61a4b4ca8a03a64d1240f77` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:54.057705 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473f027-e32f-498b-92f8-55a4a5ff9acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=949dda71a61a4b4ca8a03a64d1240f77)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:54.063089 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473f027-e32f-498b-92f8-55a4a5ff9acd admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:54.086196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79789f2d-0560-40e0-8690-8290eb985c31 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:54.086472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79789f2d-0560-40e0-8690-8290eb985c31 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:54.086771 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79789f2d-0560-40e0-8690-8290eb985c31 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:54.088128 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 974/1946] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 27 04:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:20:54.117065 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52d8a2-ca03-495c-892c-ff5419429475 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:54.117369 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52d8a2-ca03-495c-892c-ff5419429475 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:54.117678 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52d8a2-ca03-495c-892c-ff5419429475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:54.141885 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1c52d8a2-ca03-495c-892c-ff5419429475 None None] MFA Rules not processed for user `3960d52dee8443cf9ec8930a389a7b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:54.144642 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1c52d8a2-ca03-495c-892c-ff5419429475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:54.150256 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c473f027-e32f-498b-92f8-55a4a5ff9acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '949dda71a61a4b4ca8a03a64d1240f77', 'request_id': 'req-c473f027-e32f-498b-92f8-55a4a5ff9acd'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:54.170817 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c473f027-e32f-498b-92f8-55a4a5ff9acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '949dda71a61a4b4ca8a03a64d1240f77', 'request_id': 'req-c473f027-e32f-498b-92f8-55a4a5ff9acd'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:54.181013 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c473f027-e32f-498b-92f8-55a4a5ff9acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '949dda71a61a4b4ca8a03a64d1240f77', 'request_id': 'req-c473f027-e32f-498b-92f8-55a4a5ff9acd'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:54.199711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c473f027-e32f-498b-92f8-55a4a5ff9acd admin admin] The token cache is being invalidate because project 949dda71a61a4b4ca8a03a64d1240f77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:54.200431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c473f027-e32f-498b-92f8-55a4a5ff9acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:54.201397 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c473f027-e32f-498b-92f8-55a4a5ff9acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:54.203781 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 973/1947] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:54 2022] DELETE /identity/v3/projects/949dda71a61a4b4ca8a03a64d1240f77 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:54.208184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473f027-e32f-498b-92f8-55a4a5ff9acd admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:54.211847 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c473f027-e32f-498b-92f8-55a4a5ff9acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:54.230083 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:54.259199 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 975/1948] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 27 04:20:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:54.342472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473f027-e32f-498b-92f8-55a4a5ff9acd admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:54.342472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fd12c-c319-439c-a3b9-d98bc4ff1c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:54.342472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fd12c-c319-439c-a3b9-d98bc4ff1c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:54.342472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fd12c-c319-439c-a3b9-d98bc4ff1c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:54.343023 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fd12c-c319-439c-a3b9-d98bc4ff1c57 admin admin] PATH_INFO: `/v3/users/748efba2269a441a99f98537b9889e3c` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:54.343100 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52d8a2-ca03-495c-892c-ff5419429475 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:54.343195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fd12c-c319-439c-a3b9-d98bc4ff1c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=748efba2269a441a99f98537b9889e3c)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:54.343296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1c52d8a2-ca03-495c-892c-ff5419429475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:54.343381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fd12c-c319-439c-a3b9-d98bc4ff1c57 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:54.353861 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52d8a2-ca03-495c-892c-ff5419429475 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:54.363921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee04d6-e435-4009-ac79-b6811575a8fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:54.364581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee04d6-e435-4009-ac79-b6811575a8fe service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:54.364879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee04d6-e435-4009-ac79-b6811575a8fe service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:54.365265 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee04d6-e435-4009-ac79-b6811575a8fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:54.377717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee04d6-e435-4009-ac79-b6811575a8fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:54.379455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee04d6-e435-4009-ac79-b6811575a8fe service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:54.391301 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 976/1949] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:54.418033 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f42fd12c-c319-439c-a3b9-d98bc4ff1c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '748efba2269a441a99f98537b9889e3c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:54.424858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f42fd12c-c319-439c-a3b9-d98bc4ff1c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '748efba2269a441a99f98537b9889e3c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:54.425557 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f42fd12c-c319-439c-a3b9-d98bc4ff1c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '748efba2269a441a99f98537b9889e3c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:54.440213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f42fd12c-c319-439c-a3b9-d98bc4ff1c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '748efba2269a441a99f98537b9889e3c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:54.448207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f42fd12c-c319-439c-a3b9-d98bc4ff1c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '748efba2269a441a99f98537b9889e3c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:54.454281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 974/1950] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:54 2022] DELETE /identity/v3/users/748efba2269a441a99f98537b9889e3c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:54.743431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee04d6-e435-4009-ac79-b6811575a8fe service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:54.781014 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee04d6-e435-4009-ac79-b6811575a8fe service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:54.853462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e542e-fddd-417f-b8e6-e54b9c54afc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:54.854498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e542e-fddd-417f-b8e6-e54b9c54afc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:54.854996 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e542e-fddd-417f-b8e6-e54b9c54afc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:54.855353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e542e-fddd-417f-b8e6-e54b9c54afc2 admin admin] PATH_INFO: `/v3/projects/ce5af5510b854f1f8ba15f55086840d5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:54.856886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e542e-fddd-417f-b8e6-e54b9c54afc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5af5510b854f1f8ba15f55086840d5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:54.859414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e542e-fddd-417f-b8e6-e54b9c54afc2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:54.960345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c20e542e-fddd-417f-b8e6-e54b9c54afc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5af5510b854f1f8ba15f55086840d5', 'request_id': 'req-c20e542e-fddd-417f-b8e6-e54b9c54afc2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:54.975491 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c20e542e-fddd-417f-b8e6-e54b9c54afc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5af5510b854f1f8ba15f55086840d5', 'request_id': 'req-c20e542e-fddd-417f-b8e6-e54b9c54afc2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:54.989294 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c20e542e-fddd-417f-b8e6-e54b9c54afc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5af5510b854f1f8ba15f55086840d5', 'request_id': 'req-c20e542e-fddd-417f-b8e6-e54b9c54afc2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:55.028740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c20e542e-fddd-417f-b8e6-e54b9c54afc2 admin admin] The token cache is being invalidate because project ce5af5510b854f1f8ba15f55086840d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:55.029404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c20e542e-fddd-417f-b8e6-e54b9c54afc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:55.030501 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c20e542e-fddd-417f-b8e6-e54b9c54afc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:55.032583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 977/1951] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:54 2022] DELETE /identity/v3/projects/ce5af5510b854f1f8ba15f55086840d5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:55.037119 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fd12c-c319-439c-a3b9-d98bc4ff1c57 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:55.039665 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f42fd12c-c319-439c-a3b9-d98bc4ff1c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:55.058036 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fd12c-c319-439c-a3b9-d98bc4ff1c57 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:55.127202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8a870-a198-4add-b79d-4f3c68da3bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:55.127779 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8a870-a198-4add-b79d-4f3c68da3bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:55.128009 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8a870-a198-4add-b79d-4f3c68da3bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:55.128328 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8a870-a198-4add-b79d-4f3c68da3bee admin admin] PATH_INFO: `/v3/users/9e4b7ba54bed4670931926eab354b3ee` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:55.129536 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8a870-a198-4add-b79d-4f3c68da3bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e4b7ba54bed4670931926eab354b3ee)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:55.131575 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8a870-a198-4add-b79d-4f3c68da3bee admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:55.175482 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:55.194057 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-56b8a870-a198-4add-b79d-4f3c68da3bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e4b7ba54bed4670931926eab354b3ee'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:55.201297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-56b8a870-a198-4add-b79d-4f3c68da3bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e4b7ba54bed4670931926eab354b3ee'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:55.202006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-56b8a870-a198-4add-b79d-4f3c68da3bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e4b7ba54bed4670931926eab354b3ee'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:55.214754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-56b8a870-a198-4add-b79d-4f3c68da3bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e4b7ba54bed4670931926eab354b3ee'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:55.222501 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-56b8a870-a198-4add-b79d-4f3c68da3bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e4b7ba54bed4670931926eab354b3ee'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:55.228513 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 975/1952] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:55 2022] DELETE /identity/v3/users/9e4b7ba54bed4670931926eab354b3ee => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:20:55.619613 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e542e-fddd-417f-b8e6-e54b9c54afc2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:55.621058 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c20e542e-fddd-417f-b8e6-e54b9c54afc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:55.634480 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e542e-fddd-417f-b8e6-e54b9c54afc2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:55.638774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:55.716830 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c2c84-381c-4c26-b4aa-00ab5115cb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:55.717472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c2c84-381c-4c26-b4aa-00ab5115cb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:55.717752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c2c84-381c-4c26-b4aa-00ab5115cb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:55.718020 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c2c84-381c-4c26-b4aa-00ab5115cb34 admin admin] PATH_INFO: `/v3/projects/60d1a3959a4e45fcb143e7e475eba350` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:55.719166 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c2c84-381c-4c26-b4aa-00ab5115cb34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d1a3959a4e45fcb143e7e475eba350)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:55.721666 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c2c84-381c-4c26-b4aa-00ab5115cb34 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:55.770967 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-186c2c84-381c-4c26-b4aa-00ab5115cb34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d1a3959a4e45fcb143e7e475eba350', 'request_id': 'req-186c2c84-381c-4c26-b4aa-00ab5115cb34'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:55.777888 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-186c2c84-381c-4c26-b4aa-00ab5115cb34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d1a3959a4e45fcb143e7e475eba350', 'request_id': 'req-186c2c84-381c-4c26-b4aa-00ab5115cb34'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:55.787737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-186c2c84-381c-4c26-b4aa-00ab5115cb34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d1a3959a4e45fcb143e7e475eba350', 'request_id': 'req-186c2c84-381c-4c26-b4aa-00ab5115cb34'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:55.802370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-186c2c84-381c-4c26-b4aa-00ab5115cb34 admin admin] The token cache is being invalidate because project 60d1a3959a4e45fcb143e7e475eba350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:55.802944 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-186c2c84-381c-4c26-b4aa-00ab5115cb34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:55.803685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-186c2c84-381c-4c26-b4aa-00ab5115cb34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:55.805392 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 978/1953] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:55 2022] DELETE /identity/v3/projects/60d1a3959a4e45fcb143e7e475eba350 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:55.811326 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e0ba8-4796-4aaf-9f3b-3f5191d25d34 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:55.811784 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e0ba8-4796-4aaf-9f3b-3f5191d25d34 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:55.812107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e0ba8-4796-4aaf-9f3b-3f5191d25d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:55.834106 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5f1e0ba8-4796-4aaf-9f3b-3f5191d25d34 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:55.835363 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5f1e0ba8-4796-4aaf-9f3b-3f5191d25d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:55.865589 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c2c84-381c-4c26-b4aa-00ab5115cb34 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:55.867341 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-186c2c84-381c-4c26-b4aa-00ab5115cb34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:55.917006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 976/1954] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:55.927195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95df83-8d0c-4cc4-8a40-79faea8f69af None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:55.927611 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95df83-8d0c-4cc4-8a40-79faea8f69af None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:55.927925 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95df83-8d0c-4cc4-8a40-79faea8f69af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:55.962862 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-6f95df83-8d0c-4cc4-8a40-79faea8f69af None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:55.964084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c2c84-381c-4c26-b4aa-00ab5115cb34 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:55.965183 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6f95df83-8d0c-4cc4-8a40-79faea8f69af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:55.969748 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6db956-bf2f-4738-891c-c7e3e266f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:55.970653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6db956-bf2f-4738-891c-c7e3e266f882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:55.971169 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6db956-bf2f-4738-891c-c7e3e266f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:55.971817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6db956-bf2f-4738-891c-c7e3e266f882 admin admin] PATH_INFO: `/v3/users/ccc19ebd67644683a9e199820f715b3a` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:55.973067 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6db956-bf2f-4738-891c-c7e3e266f882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc19ebd67644683a9e199820f715b3a)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:55.975139 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6db956-bf2f-4738-891c-c7e3e266f882 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:55.978897 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 977/1955] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:55.989014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95df83-8d0c-4cc4-8a40-79faea8f69af None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:56.005681 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95df83-8d0c-4cc4-8a40-79faea8f69af None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:56.011945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e4109-f0e1-47e2-a4ae-095d65a804e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:56.012570 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e4109-f0e1-47e2-a4ae-095d65a804e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:56.013036 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e4109-f0e1-47e2-a4ae-095d65a804e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:56.013319 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e4109-f0e1-47e2-a4ae-095d65a804e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:56.014502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e4109-f0e1-47e2-a4ae-095d65a804e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:56.015427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e4109-f0e1-47e2-a4ae-095d65a804e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:56.018608 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e4109-f0e1-47e2-a4ae-095d65a804e2 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:56.042634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 978/1956] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:20:56.044458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e4109-f0e1-47e2-a4ae-095d65a804e2 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:56.045412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:56.055765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0c6db956-bf2f-4738-891c-c7e3e266f882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc19ebd67644683a9e199820f715b3a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:56.062908 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e4109-f0e1-47e2-a4ae-095d65a804e2 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:56.070277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2ca06-3fed-4dfc-8c68-b601f2540bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:56.071012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2ca06-3fed-4dfc-8c68-b601f2540bcd admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:56.071336 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2ca06-3fed-4dfc-8c68-b601f2540bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:56.071667 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2ca06-3fed-4dfc-8c68-b601f2540bcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:56.072733 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2ca06-3fed-4dfc-8c68-b601f2540bcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:56.073231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0c6db956-bf2f-4738-891c-c7e3e266f882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc19ebd67644683a9e199820f715b3a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:56.075620 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2ca06-3fed-4dfc-8c68-b601f2540bcd admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:56.105537 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0c6db956-bf2f-4738-891c-c7e3e266f882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc19ebd67644683a9e199820f715b3a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:56.106327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0c6db956-bf2f-4738-891c-c7e3e266f882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc19ebd67644683a9e199820f715b3a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:56.116154 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0c6db956-bf2f-4738-891c-c7e3e266f882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc19ebd67644683a9e199820f715b3a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:56.122545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 979/1957] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:55 2022] DELETE /identity/v3/users/ccc19ebd67644683a9e199820f715b3a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:20:56.125792 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 979/1958] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:56 2022] POST /identity/v3/projects => generated 393 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:56.127904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf0069-9c40-4043-886a-c6f42c247599 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:56.128016 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2ca06-3fed-4dfc-8c68-b601f2540bcd admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:56.128273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf0069-9c40-4043-886a-c6f42c247599 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:56.128650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf0069-9c40-4043-886a-c6f42c247599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:56.130094 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6cc2ca06-3fed-4dfc-8c68-b601f2540bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:56.151266 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-94cf0069-9c40-4043-886a-c6f42c247599 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:56.152552 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-94cf0069-9c40-4043-886a-c6f42c247599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:56.212583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2ca06-3fed-4dfc-8c68-b601f2540bcd admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:56.238422 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:56.254689 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 980/1959] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:56.267391 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf0069-9c40-4043-886a-c6f42c247599 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:56.268933 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-94cf0069-9c40-4043-886a-c6f42c247599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:56.313794 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdfac7-5aee-4624-a542-ce28b13025f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:56.315319 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdfac7-5aee-4624-a542-ce28b13025f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:56.315672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdfac7-5aee-4624-a542-ce28b13025f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:56.316021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdfac7-5aee-4624-a542-ce28b13025f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:56.316807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdfac7-5aee-4624-a542-ce28b13025f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:56.318783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdfac7-5aee-4624-a542-ce28b13025f8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:56.343550 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 980/1960] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:56 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:56.347592 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdfac7-5aee-4624-a542-ce28b13025f8 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:56.351493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf0069-9c40-4043-886a-c6f42c247599 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:56.355509 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89bac3-85c6-4898-b2e0-8204e13b3e69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:56.356233 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89bac3-85c6-4898-b2e0-8204e13b3e69 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:56.356456 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89bac3-85c6-4898-b2e0-8204e13b3e69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:56.356996 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89bac3-85c6-4898-b2e0-8204e13b3e69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:56.363868 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdfac7-5aee-4624-a542-ce28b13025f8 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:56.367786 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89bac3-85c6-4898-b2e0-8204e13b3e69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:56.368997 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033284e5-adfa-4c66-ba97-44de5b543524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:56.369517 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89bac3-85c6-4898-b2e0-8204e13b3e69 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:56.369660 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033284e5-adfa-4c66-ba97-44de5b543524 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:56.369971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033284e5-adfa-4c66-ba97-44de5b543524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:56.370267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033284e5-adfa-4c66-ba97-44de5b543524 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:56.371035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033284e5-adfa-4c66-ba97-44de5b543524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:56.372833 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033284e5-adfa-4c66-ba97-44de5b543524 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:56.381274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 981/1961] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:20:56.386090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 981/1962] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:56.390172 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89bac3-85c6-4898-b2e0-8204e13b3e69 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:56.402532 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89bac3-85c6-4898-b2e0-8204e13b3e69 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:56.410508 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ed17f-b31a-4349-b696-bca82c511a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:56.411293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ed17f-b31a-4349-b696-bca82c511a4c admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:56.411590 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ed17f-b31a-4349-b696-bca82c511a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:56.412052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ed17f-b31a-4349-b696-bca82c511a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:56.412834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ed17f-b31a-4349-b696-bca82c511a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:56.415237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ed17f-b31a-4349-b696-bca82c511a4c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:56.430403 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 982/1963] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:56.434194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033284e5-adfa-4c66-ba97-44de5b543524 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:56.447181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033284e5-adfa-4c66-ba97-44de5b543524 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:56.452619 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad3a71-5168-423f-9775-067518cfa074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:56.453380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad3a71-5168-423f-9775-067518cfa074 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:56.453733 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad3a71-5168-423f-9775-067518cfa074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:56.454233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad3a71-5168-423f-9775-067518cfa074 admin admin] PATH_INFO: `/v3/projects/fd76bcff404c49a39f214a73d434dbf6/users/91edab5d2f3f45e4b08b40a4ed2c07e2/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:56.489806 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad3a71-5168-423f-9775-067518cfa074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd76bcff404c49a39f214a73d434dbf6, user_id=91edab5d2f3f45e4b08b40a4ed2c07e2, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:56.493895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad3a71-5168-423f-9775-067518cfa074 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:56.526543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 982/1964] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:56 2022] PUT /identity/v3/projects/fd76bcff404c49a39f214a73d434dbf6/users/91edab5d2f3f45e4b08b40a4ed2c07e2/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:20:56.538594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ee032-ff8a-4d38-9c15-32ca02a4b9bc None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:56.538928 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ee032-ff8a-4d38-9c15-32ca02a4b9bc None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:56.539217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ee032-ff8a-4d38-9c15-32ca02a4b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:56.572583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-406ee032-ff8a-4d38-9c15-32ca02a4b9bc None None] MFA Rules not processed for user `91edab5d2f3f45e4b08b40a4ed2c07e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:56.573937 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-406ee032-ff8a-4d38-9c15-32ca02a4b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:56.597760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad3a71-5168-423f-9775-067518cfa074 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:56.600730 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ebad3a71-5168-423f-9775-067518cfa074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:56.628309 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:56.662999 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 983/1965] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:56.665669 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ee032-ff8a-4d38-9c15-32ca02a4b9bc None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:56.745840 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ee032-ff8a-4d38-9c15-32ca02a4b9bc None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:56.749808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad3a71-5168-423f-9775-067518cfa074 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:56.751894 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d5787-da78-4a2e-8a1e-2ba9e8de1a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:56.752680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d5787-da78-4a2e-8a1e-2ba9e8de1a94 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:56.753248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d5787-da78-4a2e-8a1e-2ba9e8de1a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:56.754026 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d5787-da78-4a2e-8a1e-2ba9e8de1a94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:56.755930 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d5787-da78-4a2e-8a1e-2ba9e8de1a94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:56.756725 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1c17d-43d4-4f06-940f-edf8ffe4285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:56.757471 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1c17d-43d4-4f06-940f-edf8ffe4285d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:56.757850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1c17d-43d4-4f06-940f-edf8ffe4285d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:56.758222 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1c17d-43d4-4f06-940f-edf8ffe4285d admin admin] PATH_INFO: `/v3/users/8526a97b881f44d8838f39b7f863fd87` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:56.759141 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d5787-da78-4a2e-8a1e-2ba9e8de1a94 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:56.760146 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1c17d-43d4-4f06-940f-edf8ffe4285d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8526a97b881f44d8838f39b7f863fd87)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:56.762481 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1c17d-43d4-4f06-940f-edf8ffe4285d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:56.801929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 984/1966] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:56 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:20:56.808336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d5787-da78-4a2e-8a1e-2ba9e8de1a94 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:56.827582 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-58f1c17d-43d4-4f06-940f-edf8ffe4285d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8526a97b881f44d8838f39b7f863fd87'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:56.835381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-58f1c17d-43d4-4f06-940f-edf8ffe4285d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8526a97b881f44d8838f39b7f863fd87'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:56.846288 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-58f1c17d-43d4-4f06-940f-edf8ffe4285d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8526a97b881f44d8838f39b7f863fd87'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:56.859911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:56.862094 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-58f1c17d-43d4-4f06-940f-edf8ffe4285d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8526a97b881f44d8838f39b7f863fd87'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:56.874709 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-58f1c17d-43d4-4f06-940f-edf8ffe4285d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8526a97b881f44d8838f39b7f863fd87'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:56.883296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 983/1967] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:56 2022] DELETE /identity/v3/users/8526a97b881f44d8838f39b7f863fd87 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:56.887471 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d5787-da78-4a2e-8a1e-2ba9e8de1a94 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:56.888238 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5616033-6542-4b4e-818c-d096d165583d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:56.888823 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5616033-6542-4b4e-818c-d096d165583d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:56.889275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5616033-6542-4b4e-818c-d096d165583d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:56.911554 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d5616033-6542-4b4e-818c-d096d165583d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:56.912774 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d5616033-6542-4b4e-818c-d096d165583d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:56.951704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3bd0c-5ab0-44d8-bc08-3f726e826d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:56.952315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3bd0c-5ab0-44d8-bc08-3f726e826d66 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:56.952591 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3bd0c-5ab0-44d8-bc08-3f726e826d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:56.952868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3bd0c-5ab0-44d8-bc08-3f726e826d66 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:56.953500 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3bd0c-5ab0-44d8-bc08-3f726e826d66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:56.957895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3bd0c-5ab0-44d8-bc08-3f726e826d66 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:56.979102 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:56.985866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 985/1968] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:56 2022] POST /identity/v3/users => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:56.990759 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3bd0c-5ab0-44d8-bc08-3f726e826d66 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:56.991670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 984/1969] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:56.992835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5616033-6542-4b4e-818c-d096d165583d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:56.993353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8ce3bd0c-5ab0-44d8-bc08-3f726e826d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:56.994383 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d5616033-6542-4b4e-818c-d096d165583d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:57.010682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5616033-6542-4b4e-818c-d096d165583d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:57.011183 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3bd0c-5ab0-44d8-bc08-3f726e826d66 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:57.016050 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2ca09-495d-42f6-92a5-0d5382a29438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:57.016196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc057e-8b59-4b8a-95db-9d234148bf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:57.016773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2ca09-495d-42f6-92a5-0d5382a29438 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:57.016879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc057e-8b59-4b8a-95db-9d234148bf62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:57.017064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2ca09-495d-42f6-92a5-0d5382a29438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:57.017137 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc057e-8b59-4b8a-95db-9d234148bf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:57.017901 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc057e-8b59-4b8a-95db-9d234148bf62 admin admin] PATH_INFO: `/v3/projects/2629bb2296a74447b7fcd974cffd5da9` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:57.018007 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2ca09-495d-42f6-92a5-0d5382a29438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:57.018800 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2ca09-495d-42f6-92a5-0d5382a29438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:57.019061 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc057e-8b59-4b8a-95db-9d234148bf62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2629bb2296a74447b7fcd974cffd5da9)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:57.021034 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc057e-8b59-4b8a-95db-9d234148bf62 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:57.021368 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2ca09-495d-42f6-92a5-0d5382a29438 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:57.040797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 985/1970] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:57.040797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2ca09-495d-42f6-92a5-0d5382a29438 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:57.040797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b7a2ca09-495d-42f6-92a5-0d5382a29438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:57.072351 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-cefc057e-8b59-4b8a-95db-9d234148bf62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2629bb2296a74447b7fcd974cffd5da9', 'request_id': 'req-cefc057e-8b59-4b8a-95db-9d234148bf62'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:57.080742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-cefc057e-8b59-4b8a-95db-9d234148bf62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2629bb2296a74447b7fcd974cffd5da9', 'request_id': 'req-cefc057e-8b59-4b8a-95db-9d234148bf62'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:57.089325 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-cefc057e-8b59-4b8a-95db-9d234148bf62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2629bb2296a74447b7fcd974cffd5da9', 'request_id': 'req-cefc057e-8b59-4b8a-95db-9d234148bf62'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:57.102204 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-cefc057e-8b59-4b8a-95db-9d234148bf62 admin admin] The token cache is being invalidate because project 2629bb2296a74447b7fcd974cffd5da9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:57.102600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-cefc057e-8b59-4b8a-95db-9d234148bf62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:57.103269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-cefc057e-8b59-4b8a-95db-9d234148bf62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:57.107979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 986/1971] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:56 2022] DELETE /identity/v3/projects/2629bb2296a74447b7fcd974cffd5da9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:20:57.109048 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc057e-8b59-4b8a-95db-9d234148bf62 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:57.110365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-cefc057e-8b59-4b8a-95db-9d234148bf62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:57.111000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2ca09-495d-42f6-92a5-0d5382a29438 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:57.168350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df82bfc-69dd-4c80-8521-a2993433426f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:57.169077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df82bfc-69dd-4c80-8521-a2993433426f service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:57.169436 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df82bfc-69dd-4c80-8521-a2993433426f service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:57.169790 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df82bfc-69dd-4c80-8521-a2993433426f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:57.172228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2df82bfc-69dd-4c80-8521-a2993433426f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:57.183184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc057e-8b59-4b8a-95db-9d234148bf62 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:57.185440 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df82bfc-69dd-4c80-8521-a2993433426f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:57.187196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df82bfc-69dd-4c80-8521-a2993433426f service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:57.188590 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be96d14-6251-4d57-b443-8d650b339051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:57.189363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be96d14-6251-4d57-b443-8d650b339051 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:57.189720 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be96d14-6251-4d57-b443-8d650b339051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:57.189988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be96d14-6251-4d57-b443-8d650b339051 admin admin] PATH_INFO: `/v3/projects/13cb5db087314b309464fc2622f70f06/users/3a88c6cc33634f96b38f040331a0a9d5/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:57.201465 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 986/1972] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:57.202447 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df82bfc-69dd-4c80-8521-a2993433426f service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:57.204502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2df82bfc-69dd-4c80-8521-a2993433426f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:57.208591 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be96d14-6251-4d57-b443-8d650b339051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13cb5db087314b309464fc2622f70f06, user_id=3a88c6cc33634f96b38f040331a0a9d5, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:57.211954 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be96d14-6251-4d57-b443-8d650b339051 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:57.219412 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df82bfc-69dd-4c80-8521-a2993433426f service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:57.227117 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 987/1973] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:57 2022] PUT /identity/v3/projects/13cb5db087314b309464fc2622f70f06/users/3a88c6cc33634f96b38f040331a0a9d5/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:57.230568 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be96d14-6251-4d57-b443-8d650b339051 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:57.284480 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:57.320141 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be96d14-6251-4d57-b443-8d650b339051 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:57.332062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03848a-1a60-462d-b513-8638ba4b65dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:57.332845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83029659-0a9b-4308-9676-3b76a7aa759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:57.333519 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83029659-0a9b-4308-9676-3b76a7aa759d admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:57.334704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03848a-1a60-462d-b513-8638ba4b65dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:57.335108 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83029659-0a9b-4308-9676-3b76a7aa759d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:57.335554 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83029659-0a9b-4308-9676-3b76a7aa759d admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:57.336385 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83029659-0a9b-4308-9676-3b76a7aa759d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:57.336728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03848a-1a60-462d-b513-8638ba4b65dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:57.337087 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03848a-1a60-462d-b513-8638ba4b65dc admin admin] PATH_INFO: `/v3/users/4c20574230044158b4306fa79df269fc` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:57.338646 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03848a-1a60-462d-b513-8638ba4b65dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c20574230044158b4306fa79df269fc)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:57.339416 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83029659-0a9b-4308-9676-3b76a7aa759d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:57.344414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03848a-1a60-462d-b513-8638ba4b65dc admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:57.354806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 988/1974] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:20:57.359230 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83029659-0a9b-4308-9676-3b76a7aa759d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:57.365320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:57.373100 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83029659-0a9b-4308-9676-3b76a7aa759d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:57.383115 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8846008-adc4-4153-80e9-06acc9249b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:57.384580 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8846008-adc4-4153-80e9-06acc9249b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:57.384966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8846008-adc4-4153-80e9-06acc9249b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:57.385384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8846008-adc4-4153-80e9-06acc9249b74 admin admin] PATH_INFO: `/v3/projects/13cb5db087314b309464fc2622f70f06/users/3a88c6cc33634f96b38f040331a0a9d5/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:57.388945 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8846008-adc4-4153-80e9-06acc9249b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13cb5db087314b309464fc2622f70f06, user_id=3a88c6cc33634f96b38f040331a0a9d5, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:57.394968 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8846008-adc4-4153-80e9-06acc9249b74 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:57.413989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 989/1975] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:57 2022] PUT /identity/v3/projects/13cb5db087314b309464fc2622f70f06/users/3a88c6cc33634f96b38f040331a0a9d5/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:57.425554 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478463ec-45c9-4b08-97e0-f0341fcfb976 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:57.425897 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478463ec-45c9-4b08-97e0-f0341fcfb976 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:57.426270 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478463ec-45c9-4b08-97e0-f0341fcfb976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:57.444556 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-7f03848a-1a60-462d-b513-8638ba4b65dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c20574230044158b4306fa79df269fc'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:57.455457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-7f03848a-1a60-462d-b513-8638ba4b65dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c20574230044158b4306fa79df269fc'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:57.456363 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-7f03848a-1a60-462d-b513-8638ba4b65dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c20574230044158b4306fa79df269fc'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:57.476412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-478463ec-45c9-4b08-97e0-f0341fcfb976 None None] MFA Rules not processed for user `3a88c6cc33634f96b38f040331a0a9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:57.478107 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-478463ec-45c9-4b08-97e0-f0341fcfb976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:57.480107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-7f03848a-1a60-462d-b513-8638ba4b65dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c20574230044158b4306fa79df269fc'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:57.490153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-7f03848a-1a60-462d-b513-8638ba4b65dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c20574230044158b4306fa79df269fc'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:57.500071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 987/1976] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:20:57 2022] DELETE /identity/v3/users/4c20574230044158b4306fa79df269fc => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:57.606045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 990/1977] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:57 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:57.618934 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03848a-1a60-462d-b513-8638ba4b65dc admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:57.620659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7f03848a-1a60-462d-b513-8638ba4b65dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:57.744012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03848a-1a60-462d-b513-8638ba4b65dc admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:57.753690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee328e-38e3-4db8-b16c-9303ecdd4c2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:57.755841 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee328e-38e3-4db8-b16c-9303ecdd4c2f service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:57.757530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee328e-38e3-4db8-b16c-9303ecdd4c2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:57.758568 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee328e-38e3-4db8-b16c-9303ecdd4c2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:57.906016 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee328e-38e3-4db8-b16c-9303ecdd4c2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:57.909054 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee328e-38e3-4db8-b16c-9303ecdd4c2f service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:57.943353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 988/1978] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:57 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:58.059374 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478463ec-45c9-4b08-97e0-f0341fcfb976 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:58.186899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478463ec-45c9-4b08-97e0-f0341fcfb976 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:58.192301 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90aadf-ee64-40c0-a15a-69c69aba89ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:58.193623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90aadf-ee64-40c0-a15a-69c69aba89ca service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:58.194234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90aadf-ee64-40c0-a15a-69c69aba89ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:58.194709 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90aadf-ee64-40c0-a15a-69c69aba89ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:58.215125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3d90aadf-ee64-40c0-a15a-69c69aba89ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:58.357908 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90aadf-ee64-40c0-a15a-69c69aba89ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:58.359296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90aadf-ee64-40c0-a15a-69c69aba89ca service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:58.370913 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 991/1979] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:20:58.429349 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee328e-38e3-4db8-b16c-9303ecdd4c2f service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:58.431129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f4ee328e-38e3-4db8-b16c-9303ecdd4c2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:58.448591 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:58.583630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee328e-38e3-4db8-b16c-9303ecdd4c2f service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:58.591023 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19db209-e3f5-4093-8949-ff7a46e7a60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:58.592080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19db209-e3f5-4093-8949-ff7a46e7a60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:58.592616 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19db209-e3f5-4093-8949-ff7a46e7a60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:58.593124 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19db209-e3f5-4093-8949-ff7a46e7a60e admin admin] PATH_INFO: `/v3/projects/f02a9ea9eefe49ba9a533e7b0672b9a9` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:58.595452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19db209-e3f5-4093-8949-ff7a46e7a60e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f02a9ea9eefe49ba9a533e7b0672b9a9)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:58.598307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19db209-e3f5-4093-8949-ff7a46e7a60e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:58.603741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90aadf-ee64-40c0-a15a-69c69aba89ca service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:58.605022 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3d90aadf-ee64-40c0-a15a-69c69aba89ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:58.644863 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90aadf-ee64-40c0-a15a-69c69aba89ca service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:58.656575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fb738-c433-4da2-be0c-21555df95c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:58.657577 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fb738-c433-4da2-be0c-21555df95c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:58.657863 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fb738-c433-4da2-be0c-21555df95c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:58.659646 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fb738-c433-4da2-be0c-21555df95c8b admin admin] PATH_INFO: `/v3/projects/0b01cfee00d248708e905657e558519b` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:58.660881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fb738-c433-4da2-be0c-21555df95c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b01cfee00d248708e905657e558519b)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:58.664372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fb738-c433-4da2-be0c-21555df95c8b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:58.668411 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d19db209-e3f5-4093-8949-ff7a46e7a60e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f02a9ea9eefe49ba9a533e7b0672b9a9', 'request_id': 'req-d19db209-e3f5-4093-8949-ff7a46e7a60e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:58.674362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d19db209-e3f5-4093-8949-ff7a46e7a60e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f02a9ea9eefe49ba9a533e7b0672b9a9', 'request_id': 'req-d19db209-e3f5-4093-8949-ff7a46e7a60e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:58.681708 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d19db209-e3f5-4093-8949-ff7a46e7a60e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f02a9ea9eefe49ba9a533e7b0672b9a9', 'request_id': 'req-d19db209-e3f5-4093-8949-ff7a46e7a60e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:58.699329 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d19db209-e3f5-4093-8949-ff7a46e7a60e admin admin] The token cache is being invalidate because project f02a9ea9eefe49ba9a533e7b0672b9a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:58.699807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d19db209-e3f5-4093-8949-ff7a46e7a60e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:58.700171 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:58.700631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d19db209-e3f5-4093-8949-ff7a46e7a60e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:58.702628 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 989/1980] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:58 2022] DELETE /identity/v3/projects/f02a9ea9eefe49ba9a533e7b0672b9a9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:58.708265 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bdca3-75e5-48a1-9271-f57fcdbfe0ce None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:58.708892 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bdca3-75e5-48a1-9271-f57fcdbfe0ce None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:58.709240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bdca3-75e5-48a1-9271-f57fcdbfe0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:58.737577 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-572fb738-c433-4da2-be0c-21555df95c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b01cfee00d248708e905657e558519b', 'request_id': 'req-572fb738-c433-4da2-be0c-21555df95c8b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:58.746049 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-572fb738-c433-4da2-be0c-21555df95c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b01cfee00d248708e905657e558519b', 'request_id': 'req-572fb738-c433-4da2-be0c-21555df95c8b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:58.753171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-2c2bdca3-75e5-48a1-9271-f57fcdbfe0ce None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:58.755564 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2c2bdca3-75e5-48a1-9271-f57fcdbfe0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:58.759288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-572fb738-c433-4da2-be0c-21555df95c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b01cfee00d248708e905657e558519b', 'request_id': 'req-572fb738-c433-4da2-be0c-21555df95c8b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:58.784368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-572fb738-c433-4da2-be0c-21555df95c8b admin admin] The token cache is being invalidate because project 0b01cfee00d248708e905657e558519b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:20:58.784734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-572fb738-c433-4da2-be0c-21555df95c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:58.785983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-572fb738-c433-4da2-be0c-21555df95c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:20:58.789522 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 992/1981] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:20:58 2022] DELETE /identity/v3/projects/0b01cfee00d248708e905657e558519b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:20:58.796131 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8054304-57d6-4aeb-9eab-31499c52b83f None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:58.796422 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8054304-57d6-4aeb-9eab-31499c52b83f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:58.796724 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8054304-57d6-4aeb-9eab-31499c52b83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:58.850284 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-a8054304-57d6-4aeb-9eab-31499c52b83f None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:58.851541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a8054304-57d6-4aeb-9eab-31499c52b83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:58.918902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 990/1982] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:58.920431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32228c10-a092-4151-8d90-90e8cd0ecc80 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:58.920729 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32228c10-a092-4151-8d90-90e8cd0ecc80 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:58.921012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32228c10-a092-4151-8d90-90e8cd0ecc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:58.941817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 993/1983] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:58.949268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6db53-afe6-48fd-b112-511ec194b5d6 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:58.949554 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6db53-afe6-48fd-b112-511ec194b5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:58.949827 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6db53-afe6-48fd-b112-511ec194b5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:58.951431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-32228c10-a092-4151-8d90-90e8cd0ecc80 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:58.952830 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-32228c10-a092-4151-8d90-90e8cd0ecc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:58.963479 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 991/1984] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:20:58.967641 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32228c10-a092-4151-8d90-90e8cd0ecc80 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:58.971540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-02e6db53-afe6-48fd-b112-511ec194b5d6 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:58.972765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-02e6db53-afe6-48fd-b112-511ec194b5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:58.977388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32228c10-a092-4151-8d90-90e8cd0ecc80 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:58.982434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 994/1985] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:58.983143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5122ab1-6864-4c60-98e7-8d62a9796c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:58.983865 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5122ab1-6864-4c60-98e7-8d62a9796c90 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:58.984232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5122ab1-6864-4c60-98e7-8d62a9796c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:58.984807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5122ab1-6864-4c60-98e7-8d62a9796c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:58.985617 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5122ab1-6864-4c60-98e7-8d62a9796c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:58.985992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5122ab1-6864-4c60-98e7-8d62a9796c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:58.986477 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6db53-afe6-48fd-b112-511ec194b5d6 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:58.988064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5122ab1-6864-4c60-98e7-8d62a9796c90 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:58.998355 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6db53-afe6-48fd-b112-511ec194b5d6 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:59.002798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 992/1986] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:20:59.003223 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19afde-8e0f-46ae-ab6b-cb29ddf04bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:59.003912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19afde-8e0f-46ae-ab6b-cb29ddf04bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:59.004347 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19afde-8e0f-46ae-ab6b-cb29ddf04bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:59.004635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19afde-8e0f-46ae-ab6b-cb29ddf04bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:59.005569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19afde-8e0f-46ae-ab6b-cb29ddf04bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:20:59.006108 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19afde-8e0f-46ae-ab6b-cb29ddf04bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:59.007598 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5122ab1-6864-4c60-98e7-8d62a9796c90 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:59.007886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19afde-8e0f-46ae-ab6b-cb29ddf04bd2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:59.018977 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5122ab1-6864-4c60-98e7-8d62a9796c90 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:59.021178 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 995/1987] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:20:59.025405 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19afde-8e0f-46ae-ab6b-cb29ddf04bd2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:59.025791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d51c62-3dbb-491f-b49e-b4203ffeffb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:59.026589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d51c62-3dbb-491f-b49e-b4203ffeffb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:59.027214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d51c62-3dbb-491f-b49e-b4203ffeffb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:59.027632 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d51c62-3dbb-491f-b49e-b4203ffeffb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:59.028589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d51c62-3dbb-491f-b49e-b4203ffeffb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:59.030684 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d51c62-3dbb-491f-b49e-b4203ffeffb8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:59.035529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19afde-8e0f-46ae-ab6b-cb29ddf04bd2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:59.040598 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b121e-96d2-46cf-a48f-c616a0afa9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:59.041205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b121e-96d2-46cf-a48f-c616a0afa9fc admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:59.041497 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b121e-96d2-46cf-a48f-c616a0afa9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:59.041766 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b121e-96d2-46cf-a48f-c616a0afa9fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:59.042585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b121e-96d2-46cf-a48f-c616a0afa9fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:59.044505 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b121e-96d2-46cf-a48f-c616a0afa9fc admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:59.050752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:59.066382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 993/1988] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:59 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:59.070789 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d51c62-3dbb-491f-b49e-b4203ffeffb8 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:59.084598 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 996/1989] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:59 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:20:59.088714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b121e-96d2-46cf-a48f-c616a0afa9fc admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:59.142841 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d51c62-3dbb-491f-b49e-b4203ffeffb8 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:59.160994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b121e-96d2-46cf-a48f-c616a0afa9fc admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:59.165705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878dd32-d1da-4ce2-baca-5810a91117cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:59.166384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878dd32-d1da-4ce2-baca-5810a91117cb admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:59.166756 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878dd32-d1da-4ce2-baca-5810a91117cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:59.167107 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878dd32-d1da-4ce2-baca-5810a91117cb admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:59.167815 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878dd32-d1da-4ce2-baca-5810a91117cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:59.169806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878dd32-d1da-4ce2-baca-5810a91117cb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:59.187995 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:59.194467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 997/1990] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:59 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:59.198336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878dd32-d1da-4ce2-baca-5810a91117cb admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:59.202203 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea5525-837f-449d-90c4-d8c0ec4730a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:59.203057 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea5525-837f-449d-90c4-d8c0ec4730a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:59.203348 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea5525-837f-449d-90c4-d8c0ec4730a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:59.203624 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea5525-837f-449d-90c4-d8c0ec4730a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:59.204266 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea5525-837f-449d-90c4-d8c0ec4730a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:59.206780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea5525-837f-449d-90c4-d8c0ec4730a5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:59.209298 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878dd32-d1da-4ce2-baca-5810a91117cb admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:59.213954 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07294d-3513-4356-b770-28e118a75774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:59.214545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07294d-3513-4356-b770-28e118a75774 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:59.214855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07294d-3513-4356-b770-28e118a75774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:59.215129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07294d-3513-4356-b770-28e118a75774 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:59.215763 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07294d-3513-4356-b770-28e118a75774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:59.217357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07294d-3513-4356-b770-28e118a75774 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:59.228107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 994/1991] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:59 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:59.228285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 998/1992] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:59.232662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea5525-837f-449d-90c4-d8c0ec4730a5 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:59.232798 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07294d-3513-4356-b770-28e118a75774 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:59.242254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07294d-3513-4356-b770-28e118a75774 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:59.243710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea5525-837f-449d-90c4-d8c0ec4730a5 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:59.246854 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c00f0-1a45-4b37-b040-85ae9e4bebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:59.247441 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c00f0-1a45-4b37-b040-85ae9e4bebfe admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:59.247723 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c00f0-1a45-4b37-b040-85ae9e4bebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:59.248069 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c00f0-1a45-4b37-b040-85ae9e4bebfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:59.248623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c00f0-1a45-4b37-b040-85ae9e4bebfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:59.248810 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf367a-a10e-4de4-be24-92081239ee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:59.249396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf367a-a10e-4de4-be24-92081239ee91 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:59.249679 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf367a-a10e-4de4-be24-92081239ee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:59.249958 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf367a-a10e-4de4-be24-92081239ee91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:59.250297 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c00f0-1a45-4b37-b040-85ae9e4bebfe admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:59.250626 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf367a-a10e-4de4-be24-92081239ee91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:59.252331 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf367a-a10e-4de4-be24-92081239ee91 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:59.261313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 999/1993] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:20:59.262907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 995/1994] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:59.268768 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf367a-a10e-4de4-be24-92081239ee91 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:59.268892 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c00f0-1a45-4b37-b040-85ae9e4bebfe admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:59.278857 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c00f0-1a45-4b37-b040-85ae9e4bebfe admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:59.279121 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf367a-a10e-4de4-be24-92081239ee91 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:59.284259 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93732d1a-e89f-40e4-94f7-e994428f8c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:59.284391 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0932dd3-d0b1-4d58-a294-f071fdffc890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:59.284876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0932dd3-d0b1-4d58-a294-f071fdffc890 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:59.284984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732d1a-e89f-40e4-94f7-e994428f8c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:59.285205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0932dd3-d0b1-4d58-a294-f071fdffc890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:59.285339 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732d1a-e89f-40e4-94f7-e994428f8c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:59.285416 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0932dd3-d0b1-4d58-a294-f071fdffc890 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:59.285485 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732d1a-e89f-40e4-94f7-e994428f8c1e admin admin] PATH_INFO: `/v3/projects/475dda6239144fa38cb03b60b0b2f0a2/users/0071a2745cf34f5d870b10c8cf4785c2/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:59.286041 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0932dd3-d0b1-4d58-a294-f071fdffc890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:59.287785 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0932dd3-d0b1-4d58-a294-f071fdffc890 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:59.299404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1000/1995] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:20:59.302048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93732d1a-e89f-40e4-94f7-e994428f8c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=475dda6239144fa38cb03b60b0b2f0a2, user_id=0071a2745cf34f5d870b10c8cf4785c2, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:59.303653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0932dd3-d0b1-4d58-a294-f071fdffc890 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:59.304835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93732d1a-e89f-40e4-94f7-e994428f8c1e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:59.314456 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0932dd3-d0b1-4d58-a294-f071fdffc890 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:59.320450 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 996/1996] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:59 2022] PUT /identity/v3/projects/475dda6239144fa38cb03b60b0b2f0a2/users/0071a2745cf34f5d870b10c8cf4785c2/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:20:59.332720 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd255bd-6b31-4f5b-a9b9-95a07184126d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:59.333232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd255bd-6b31-4f5b-a9b9-95a07184126d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:59.333649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd255bd-6b31-4f5b-a9b9-95a07184126d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:59.382541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-2fd255bd-6b31-4f5b-a9b9-95a07184126d None None] MFA Rules not processed for user `0071a2745cf34f5d870b10c8cf4785c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:59.384268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2fd255bd-6b31-4f5b-a9b9-95a07184126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:59.389341 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506f4ef-1b9d-44f5-9f7b-45c2331dd1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:59.390608 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506f4ef-1b9d-44f5-9f7b-45c2331dd1ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:59.390938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506f4ef-1b9d-44f5-9f7b-45c2331dd1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:59.391233 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506f4ef-1b9d-44f5-9f7b-45c2331dd1ae admin admin] PATH_INFO: `/v3/projects/b3859ada0c284ad2b568a4ac2ab5d758/users/0ccdb90c674f4b70aec05b7bac7232c5/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:59.428894 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506f4ef-1b9d-44f5-9f7b-45c2331dd1ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3859ada0c284ad2b568a4ac2ab5d758, user_id=0ccdb90c674f4b70aec05b7bac7232c5, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:59.432354 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506f4ef-1b9d-44f5-9f7b-45c2331dd1ae admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:59.448919 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1001/1997] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:20:59 2022] PUT /identity/v3/projects/b3859ada0c284ad2b568a4ac2ab5d758/users/0ccdb90c674f4b70aec05b7bac7232c5/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:20:59.456442 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:59.460459 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41ca76-0a8a-4f0d-a5d1-305de9383356 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:59.460758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41ca76-0a8a-4f0d-a5d1-305de9383356 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:59.461037 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41ca76-0a8a-4f0d-a5d1-305de9383356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:59.481019 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 997/1998] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:59.492756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd255bd-6b31-4f5b-a9b9-95a07184126d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:59.493237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-9d41ca76-0a8a-4f0d-a5d1-305de9383356 None None] MFA Rules not processed for user `0ccdb90c674f4b70aec05b7bac7232c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:20:59.494322 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2fd255bd-6b31-4f5b-a9b9-95a07184126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:59.496230 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9d41ca76-0a8a-4f0d-a5d1-305de9383356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:20:59.592448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1002/1999] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:20:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:20:59.595605 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd255bd-6b31-4f5b-a9b9-95a07184126d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:59.598023 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41ca76-0a8a-4f0d-a5d1-305de9383356 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:59.664073 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:20:59.670652 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c514d-15da-498d-9abb-1b98a827fc6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '405499a1b5dc4fb6ac7af73910c3d992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:59.671507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c514d-15da-498d-9abb-1b98a827fc6d service glance] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:59.672351 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c514d-15da-498d-9abb-1b98a827fc6d service glance] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:59.672471 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c514d-15da-498d-9abb-1b98a827fc6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:59.715928 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41ca76-0a8a-4f0d-a5d1-305de9383356 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:59.730674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d51d7-4844-4724-a3a4-5f92b0d860c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:59.732572 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d51d7-4844-4724-a3a4-5f92b0d860c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:59.732946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d51d7-4844-4724-a3a4-5f92b0d860c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:59.736325 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d51d7-4844-4724-a3a4-5f92b0d860c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:59.737030 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d51d7-4844-4724-a3a4-5f92b0d860c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:59.739010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d51d7-4844-4724-a3a4-5f92b0d860c3 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:59.794312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1003/2000] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:20:59 2022] POST /identity/v3/projects => generated 377 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:20:59.796145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d51d7-4844-4724-a3a4-5f92b0d860c3 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:20:59.825913 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c514d-15da-498d-9abb-1b98a827fc6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:59.827996 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c514d-15da-498d-9abb-1b98a827fc6d service glance] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:59.843610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 998/2001] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:20:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:20:59.921207 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d51d7-4844-4724-a3a4-5f92b0d860c3 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:20:59.930248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572a149-3c7c-416d-9c6e-8918370dcb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:20:59.932488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572a149-3c7c-416d-9c6e-8918370dcb49 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:20:59.932488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572a149-3c7c-416d-9c6e-8918370dcb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:20:59.932488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572a149-3c7c-416d-9c6e-8918370dcb49 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:20:59.932488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572a149-3c7c-416d-9c6e-8918370dcb49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:20:59.944301 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572a149-3c7c-416d-9c6e-8918370dcb49 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:20:59.980173 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1004/2002] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:20:59 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:20:59.982240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c514d-15da-498d-9abb-1b98a827fc6d service glance] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:00.006465 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c514d-15da-498d-9abb-1b98a827fc6d service glance] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:00.017410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebd935-ef86-413a-849e-5d85ae8b6c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:00.018036 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebd935-ef86-413a-849e-5d85ae8b6c45 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:00.018325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebd935-ef86-413a-849e-5d85ae8b6c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:00.020697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebd935-ef86-413a-849e-5d85ae8b6c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:00.022297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebd935-ef86-413a-849e-5d85ae8b6c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:00.024193 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebd935-ef86-413a-849e-5d85ae8b6c45 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:00.050394 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 999/2003] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:00.051895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572a149-3c7c-416d-9c6e-8918370dcb49 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:00.066207 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572a149-3c7c-416d-9c6e-8918370dcb49 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:00.082328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a65bb4-5e70-4866-8b7d-ce7165628a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:00.083724 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a65bb4-5e70-4866-8b7d-ce7165628a34 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:00.084054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a65bb4-5e70-4866-8b7d-ce7165628a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:00.084337 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a65bb4-5e70-4866-8b7d-ce7165628a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:00.085007 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a65bb4-5e70-4866-8b7d-ce7165628a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:00.092124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a65bb4-5e70-4866-8b7d-ce7165628a34 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:00.121765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1005/2004] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:00.125959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebd935-ef86-413a-849e-5d85ae8b6c45 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:00.143003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebd935-ef86-413a-849e-5d85ae8b6c45 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:00.155770 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5eb58-13a3-4ea2-b5a5-3856e2219c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:00.156711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5eb58-13a3-4ea2-b5a5-3856e2219c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:00.157207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5eb58-13a3-4ea2-b5a5-3856e2219c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:00.158797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5eb58-13a3-4ea2-b5a5-3856e2219c0e admin admin] PATH_INFO: `/v3/projects/f7d96c9808b84f9d9528d90fce6bcc9d/users/f1deea2a60fc4c6fa0e498940b6f4084/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:00.202781 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5eb58-13a3-4ea2-b5a5-3856e2219c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d96c9808b84f9d9528d90fce6bcc9d, user_id=f1deea2a60fc4c6fa0e498940b6f4084, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:00.202781 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5eb58-13a3-4ea2-b5a5-3856e2219c0e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:00.226607 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1000/2005] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:00 2022] PUT /identity/v3/projects/f7d96c9808b84f9d9528d90fce6bcc9d/users/f1deea2a60fc4c6fa0e498940b6f4084/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:00.239419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73a374-2d4a-474f-8421-7f128b64bdbb None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:00.239632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73a374-2d4a-474f-8421-7f128b64bdbb None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:00.239956 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73a374-2d4a-474f-8421-7f128b64bdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:00.272978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-6f73a374-2d4a-474f-8421-7f128b64bdbb None None] MFA Rules not processed for user `f1deea2a60fc4c6fa0e498940b6f4084`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:00.274999 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6f73a374-2d4a-474f-8421-7f128b64bdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:00.378624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1006/2006] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:00.380654 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5eb58-13a3-4ea2-b5a5-3856e2219c0e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:00.388123 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:00.500430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5eb58-13a3-4ea2-b5a5-3856e2219c0e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:00.506272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec9aa3-c1bf-4a90-a8d5-bb77e98391ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:00.506918 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec9aa3-c1bf-4a90-a8d5-bb77e98391ad admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:00.507199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec9aa3-c1bf-4a90-a8d5-bb77e98391ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:00.507477 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec9aa3-c1bf-4a90-a8d5-bb77e98391ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:00.508178 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec9aa3-c1bf-4a90-a8d5-bb77e98391ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:00.510100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec9aa3-c1bf-4a90-a8d5-bb77e98391ad admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:00.566488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1001/2007] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:00 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:00.568049 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73a374-2d4a-474f-8421-7f128b64bdbb None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:00.589886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73a374-2d4a-474f-8421-7f128b64bdbb None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:00.642895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:00.701102 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1350c-c72f-4bed-b5ab-26ff219aa3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:00.701799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1350c-c72f-4bed-b5ab-26ff219aa3a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:00.702066 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1350c-c72f-4bed-b5ab-26ff219aa3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:00.702346 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1350c-c72f-4bed-b5ab-26ff219aa3a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:00.703020 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1350c-c72f-4bed-b5ab-26ff219aa3a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:00.705564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1350c-c72f-4bed-b5ab-26ff219aa3a7 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:00.730830 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1007/2008] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:00 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:00.732668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec9aa3-c1bf-4a90-a8d5-bb77e98391ad admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:00.743972 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec9aa3-c1bf-4a90-a8d5-bb77e98391ad admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:00.749250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4051bab-f3b5-447c-8520-ae9fee22bc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:00.749871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4051bab-f3b5-447c-8520-ae9fee22bc32 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:00.750159 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4051bab-f3b5-447c-8520-ae9fee22bc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:00.750482 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4051bab-f3b5-447c-8520-ae9fee22bc32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:00.751145 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4051bab-f3b5-447c-8520-ae9fee22bc32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:00.752807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4051bab-f3b5-447c-8520-ae9fee22bc32 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:00.768131 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1002/2009] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:00.771949 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1350c-c72f-4bed-b5ab-26ff219aa3a7 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:00.785309 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1350c-c72f-4bed-b5ab-26ff219aa3a7 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:00.790736 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace29f8-617a-484f-9199-2f0fe3fb6fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:00.791611 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace29f8-617a-484f-9199-2f0fe3fb6fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:00.792056 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace29f8-617a-484f-9199-2f0fe3fb6fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:00.793043 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace29f8-617a-484f-9199-2f0fe3fb6fbc admin admin] PATH_INFO: `/v3/projects/11a030aae9654fa6b2539f28015ca889/users/25408c83833d41d4968dbc072e3876c5/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:00.809299 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace29f8-617a-484f-9199-2f0fe3fb6fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a030aae9654fa6b2539f28015ca889, user_id=25408c83833d41d4968dbc072e3876c5, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:00.812401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace29f8-617a-484f-9199-2f0fe3fb6fbc admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:00.830563 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1008/2010] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:00 2022] PUT /identity/v3/projects/11a030aae9654fa6b2539f28015ca889/users/25408c83833d41d4968dbc072e3876c5/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:00.834281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4051bab-f3b5-447c-8520-ae9fee22bc32 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:00.846037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4051bab-f3b5-447c-8520-ae9fee22bc32 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:00.935171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6cd4f-9ab7-42f3-81c3-4d30b8e84a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:00.937857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6cd4f-9ab7-42f3-81c3-4d30b8e84a25 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:00.938359 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6cd4f-9ab7-42f3-81c3-4d30b8e84a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:00.938872 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6cd4f-9ab7-42f3-81c3-4d30b8e84a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:00.940783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6cd4f-9ab7-42f3-81c3-4d30b8e84a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:00.942900 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6cd4f-9ab7-42f3-81c3-4d30b8e84a25 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:00.962807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1003/2011] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:00.991315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace29f8-617a-484f-9199-2f0fe3fb6fbc admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:01.004559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace29f8-617a-484f-9199-2f0fe3fb6fbc admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:01.011349 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192bcf3-a579-4c13-8818-05289a48de1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:01.012122 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192bcf3-a579-4c13-8818-05289a48de1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:01.013146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192bcf3-a579-4c13-8818-05289a48de1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:01.013146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192bcf3-a579-4c13-8818-05289a48de1e admin admin] PATH_INFO: `/v3/projects/11a030aae9654fa6b2539f28015ca889/users/25408c83833d41d4968dbc072e3876c5/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:01.015021 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192bcf3-a579-4c13-8818-05289a48de1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a030aae9654fa6b2539f28015ca889, user_id=25408c83833d41d4968dbc072e3876c5, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:01.018217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192bcf3-a579-4c13-8818-05289a48de1e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:01.038686 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1009/2012] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:00 2022] PUT /identity/v3/projects/11a030aae9654fa6b2539f28015ca889/users/25408c83833d41d4968dbc072e3876c5/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:01.050077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19086df5-aff7-4124-b0bf-7185fefdf11b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:01.050390 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19086df5-aff7-4124-b0bf-7185fefdf11b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:01.050675 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19086df5-aff7-4124-b0bf-7185fefdf11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:01.091278 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-19086df5-aff7-4124-b0bf-7185fefdf11b None None] MFA Rules not processed for user `25408c83833d41d4968dbc072e3876c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:01.092535 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-19086df5-aff7-4124-b0bf-7185fefdf11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:01.163755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:01.169670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1004/2013] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:01.181867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192bcf3-a579-4c13-8818-05289a48de1e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:01.184013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3192bcf3-a579-4c13-8818-05289a48de1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:01.245066 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192bcf3-a579-4c13-8818-05289a48de1e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:01.248728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a71205-c381-4686-9863-203494cfb5c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:01.249341 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a71205-c381-4686-9863-203494cfb5c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:01.249629 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a71205-c381-4686-9863-203494cfb5c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:01.249913 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a71205-c381-4686-9863-203494cfb5c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:01.309814 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a71205-c381-4686-9863-203494cfb5c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:01.311319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a71205-c381-4686-9863-203494cfb5c4 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:01.321983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1010/2014] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:02.319331 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19086df5-aff7-4124-b0bf-7185fefdf11b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:02.320932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-19086df5-aff7-4124-b0bf-7185fefdf11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:02.389489 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19086df5-aff7-4124-b0bf-7185fefdf11b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:02.401990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb980-6a1e-48f3-881c-64397bcb6a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:02.403219 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb980-6a1e-48f3-881c-64397bcb6a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:02.404007 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb980-6a1e-48f3-881c-64397bcb6a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:02.404436 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb980-6a1e-48f3-881c-64397bcb6a0e admin admin] PATH_INFO: `/v3/users/91edab5d2f3f45e4b08b40a4ed2c07e2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:02.405906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afb980-6a1e-48f3-881c-64397bcb6a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=91edab5d2f3f45e4b08b40a4ed2c07e2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:02.409971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afb980-6a1e-48f3-881c-64397bcb6a0e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:02.488215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-50afb980-6a1e-48f3-881c-64397bcb6a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91edab5d2f3f45e4b08b40a4ed2c07e2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:02.497965 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-50afb980-6a1e-48f3-881c-64397bcb6a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91edab5d2f3f45e4b08b40a4ed2c07e2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:02.499685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-50afb980-6a1e-48f3-881c-64397bcb6a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91edab5d2f3f45e4b08b40a4ed2c07e2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:02.527380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-50afb980-6a1e-48f3-881c-64397bcb6a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91edab5d2f3f45e4b08b40a4ed2c07e2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:02.539633 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-50afb980-6a1e-48f3-881c-64397bcb6a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91edab5d2f3f45e4b08b40a4ed2c07e2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:02.553368 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1005/2015] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:02 2022] DELETE /identity/v3/users/91edab5d2f3f45e4b08b40a4ed2c07e2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:02.558136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5c009-48b3-43e2-b5da-5e4c602acd2d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:02.559086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5c009-48b3-43e2-b5da-5e4c602acd2d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:02.559086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5c009-48b3-43e2-b5da-5e4c602acd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:02.600345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c0e5c009-48b3-43e2-b5da-5e4c602acd2d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:02.602095 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c0e5c009-48b3-43e2-b5da-5e4c602acd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:02.704569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:02.805429 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1011/2016] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:02.813248 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb980-6a1e-48f3-881c-64397bcb6a0e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:02.815974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-50afb980-6a1e-48f3-881c-64397bcb6a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:02.895381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb980-6a1e-48f3-881c-64397bcb6a0e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:02.899838 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e41ac5-16f9-43bb-bd3e-bbe36a25ca1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:02.900746 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e41ac5-16f9-43bb-bd3e-bbe36a25ca1e service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:02.901392 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e41ac5-16f9-43bb-bd3e-bbe36a25ca1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:02.901772 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e41ac5-16f9-43bb-bd3e-bbe36a25ca1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:02.912450 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e41ac5-16f9-43bb-bd3e-bbe36a25ca1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:02.914153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e41ac5-16f9-43bb-bd3e-bbe36a25ca1e service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:02.938810 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1006/2017] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:02.985383 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5c009-48b3-43e2-b5da-5e4c602acd2d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:02.988575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c0e5c009-48b3-43e2-b5da-5e4c602acd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:03.056889 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5c009-48b3-43e2-b5da-5e4c602acd2d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:03.060677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6072f2-8967-427f-ae6f-2578d3e11a8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:03.061297 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6072f2-8967-427f-ae6f-2578d3e11a8b service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:03.061604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6072f2-8967-427f-ae6f-2578d3e11a8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:03.061885 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6072f2-8967-427f-ae6f-2578d3e11a8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:03.063902 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bb6072f2-8967-427f-ae6f-2578d3e11a8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:03.136315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6072f2-8967-427f-ae6f-2578d3e11a8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:03.138328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6072f2-8967-427f-ae6f-2578d3e11a8b service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:03.149768 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1012/2018] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:03.593843 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e41ac5-16f9-43bb-bd3e-bbe36a25ca1e service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:03.599627 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e9e41ac5-16f9-43bb-bd3e-bbe36a25ca1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:03.615021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e41ac5-16f9-43bb-bd3e-bbe36a25ca1e service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:03.620548 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70993175-223a-4fc6-8cb9-e595b3b8ebaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:03.621531 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70993175-223a-4fc6-8cb9-e595b3b8ebaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:03.621930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70993175-223a-4fc6-8cb9-e595b3b8ebaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:03.622331 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70993175-223a-4fc6-8cb9-e595b3b8ebaf admin admin] PATH_INFO: `/v3/projects/fd76bcff404c49a39f214a73d434dbf6` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:03.624125 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70993175-223a-4fc6-8cb9-e595b3b8ebaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd76bcff404c49a39f214a73d434dbf6)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:03.626316 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70993175-223a-4fc6-8cb9-e595b3b8ebaf admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:03.644976 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:03.696202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-70993175-223a-4fc6-8cb9-e595b3b8ebaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd76bcff404c49a39f214a73d434dbf6', 'request_id': 'req-70993175-223a-4fc6-8cb9-e595b3b8ebaf'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:03.705854 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-70993175-223a-4fc6-8cb9-e595b3b8ebaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd76bcff404c49a39f214a73d434dbf6', 'request_id': 'req-70993175-223a-4fc6-8cb9-e595b3b8ebaf'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:03.712991 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-70993175-223a-4fc6-8cb9-e595b3b8ebaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd76bcff404c49a39f214a73d434dbf6', 'request_id': 'req-70993175-223a-4fc6-8cb9-e595b3b8ebaf'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:03.728810 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-70993175-223a-4fc6-8cb9-e595b3b8ebaf admin admin] The token cache is being invalidate because project fd76bcff404c49a39f214a73d434dbf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:03.729112 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-70993175-223a-4fc6-8cb9-e595b3b8ebaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:03.729759 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-70993175-223a-4fc6-8cb9-e595b3b8ebaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:03.731657 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1007/2019] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:03 2022] DELETE /identity/v3/projects/fd76bcff404c49a39f214a73d434dbf6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:03.736548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6072f2-8967-427f-ae6f-2578d3e11a8b service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:03.750471 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6072f2-8967-427f-ae6f-2578d3e11a8b service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:03.821617 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc87918-3e2c-45dc-9acb-264d6fa939a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:03.822257 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc87918-3e2c-45dc-9acb-264d6fa939a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:03.822535 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc87918-3e2c-45dc-9acb-264d6fa939a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:03.822834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc87918-3e2c-45dc-9acb-264d6fa939a5 admin admin] PATH_INFO: `/v3/users/3a88c6cc33634f96b38f040331a0a9d5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:03.823958 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc87918-3e2c-45dc-9acb-264d6fa939a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a88c6cc33634f96b38f040331a0a9d5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:03.825887 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc87918-3e2c-45dc-9acb-264d6fa939a5 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:03.885664 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:03.895766 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0fc87918-3e2c-45dc-9acb-264d6fa939a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a88c6cc33634f96b38f040331a0a9d5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:03.904365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0fc87918-3e2c-45dc-9acb-264d6fa939a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a88c6cc33634f96b38f040331a0a9d5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:03.927265 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70993175-223a-4fc6-8cb9-e595b3b8ebaf admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:03.929188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-70993175-223a-4fc6-8cb9-e595b3b8ebaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:03.934089 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0fc87918-3e2c-45dc-9acb-264d6fa939a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a88c6cc33634f96b38f040331a0a9d5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:03.934904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0fc87918-3e2c-45dc-9acb-264d6fa939a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a88c6cc33634f96b38f040331a0a9d5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:03.944716 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0fc87918-3e2c-45dc-9acb-264d6fa939a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a88c6cc33634f96b38f040331a0a9d5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:03.952955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1013/2020] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:03 2022] DELETE /identity/v3/users/3a88c6cc33634f96b38f040331a0a9d5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:04.010357 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70993175-223a-4fc6-8cb9-e595b3b8ebaf admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:04.087703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e39ae-d36e-4013-85da-5b65400667fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:04.088331 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e39ae-d36e-4013-85da-5b65400667fc service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:04.088614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e39ae-d36e-4013-85da-5b65400667fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:04.088886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e39ae-d36e-4013-85da-5b65400667fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:04.090768 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fd3e39ae-d36e-4013-85da-5b65400667fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:04.199703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e39ae-d36e-4013-85da-5b65400667fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:04.201249 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e39ae-d36e-4013-85da-5b65400667fc service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:04.225582 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1008/2021] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:04.428212 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc87918-3e2c-45dc-9acb-264d6fa939a5 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:04.429684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0fc87918-3e2c-45dc-9acb-264d6fa939a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:04.508579 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc87918-3e2c-45dc-9acb-264d6fa939a5 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:04.514237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f34e38-88bd-4f56-836a-ec1b58c98925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:04.515086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f34e38-88bd-4f56-836a-ec1b58c98925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:04.515517 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f34e38-88bd-4f56-836a-ec1b58c98925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:04.515909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f34e38-88bd-4f56-836a-ec1b58c98925 admin admin] PATH_INFO: `/v3/projects/13cb5db087314b309464fc2622f70f06` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:04.518035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f34e38-88bd-4f56-836a-ec1b58c98925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13cb5db087314b309464fc2622f70f06)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:04.520412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f34e38-88bd-4f56-836a-ec1b58c98925 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:04.582148 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-74f34e38-88bd-4f56-836a-ec1b58c98925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13cb5db087314b309464fc2622f70f06', 'request_id': 'req-74f34e38-88bd-4f56-836a-ec1b58c98925'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:04.588497 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-74f34e38-88bd-4f56-836a-ec1b58c98925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13cb5db087314b309464fc2622f70f06', 'request_id': 'req-74f34e38-88bd-4f56-836a-ec1b58c98925'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:04.598842 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-74f34e38-88bd-4f56-836a-ec1b58c98925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13cb5db087314b309464fc2622f70f06', 'request_id': 'req-74f34e38-88bd-4f56-836a-ec1b58c98925'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:04.612139 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-74f34e38-88bd-4f56-836a-ec1b58c98925 admin admin] The token cache is being invalidate because project 13cb5db087314b309464fc2622f70f06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:04.612431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-74f34e38-88bd-4f56-836a-ec1b58c98925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:04.613092 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-74f34e38-88bd-4f56-836a-ec1b58c98925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:04.614637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1014/2022] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:04 2022] DELETE /identity/v3/projects/13cb5db087314b309464fc2622f70f06 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:04.621560 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1403e-7fe6-41e4-8ed9-91b5f783fd9d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:04.622045 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1403e-7fe6-41e4-8ed9-91b5f783fd9d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:04.622045 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1403e-7fe6-41e4-8ed9-91b5f783fd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:04.646018 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-6df1403e-7fe6-41e4-8ed9-91b5f783fd9d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:04.647320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6df1403e-7fe6-41e4-8ed9-91b5f783fd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:04.651688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:04.717852 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1009/2023] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:04.727229 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb952fbb-c29f-4c49-8632-5f8e6cd4a8dc None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:04.727713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb952fbb-c29f-4c49-8632-5f8e6cd4a8dc None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:04.728013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb952fbb-c29f-4c49-8632-5f8e6cd4a8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:04.750065 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-eb952fbb-c29f-4c49-8632-5f8e6cd4a8dc None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:04.751341 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-eb952fbb-c29f-4c49-8632-5f8e6cd4a8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:04.759383 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1015/2024] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:04.763826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1403e-7fe6-41e4-8ed9-91b5f783fd9d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:04.775334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1403e-7fe6-41e4-8ed9-91b5f783fd9d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:04.781902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08957a-80ca-4f4f-94db-05818ac43874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:04.782569 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08957a-80ca-4f4f-94db-05818ac43874 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:04.783634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08957a-80ca-4f4f-94db-05818ac43874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:04.785999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08957a-80ca-4f4f-94db-05818ac43874 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:04.786796 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08957a-80ca-4f4f-94db-05818ac43874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:21:04.787117 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08957a-80ca-4f4f-94db-05818ac43874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:04.789051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08957a-80ca-4f4f-94db-05818ac43874 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:04.809001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1010/2025] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:21:04.809854 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb952fbb-c29f-4c49-8632-5f8e6cd4a8dc None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:04.820292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb952fbb-c29f-4c49-8632-5f8e6cd4a8dc None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:04.825666 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604ea72-f926-4780-8711-a2653cb39869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:04.826306 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604ea72-f926-4780-8711-a2653cb39869 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:04.826585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604ea72-f926-4780-8711-a2653cb39869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:04.827185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604ea72-f926-4780-8711-a2653cb39869 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:04.827974 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604ea72-f926-4780-8711-a2653cb39869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:04.830966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604ea72-f926-4780-8711-a2653cb39869 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:04.864819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1016/2026] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:04 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:04.865848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08957a-80ca-4f4f-94db-05818ac43874 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:04.875962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08957a-80ca-4f4f-94db-05818ac43874 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:04.934399 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fe645-172c-4baf-a5f9-a66fab8dc5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:04.935298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fe645-172c-4baf-a5f9-a66fab8dc5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:04.935684 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fe645-172c-4baf-a5f9-a66fab8dc5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:04.935974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fe645-172c-4baf-a5f9-a66fab8dc5d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:04.936660 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6fe645-172c-4baf-a5f9-a66fab8dc5d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:04.938678 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6fe645-172c-4baf-a5f9-a66fab8dc5d3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:04.965017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1011/2027] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:04 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:04.966442 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604ea72-f926-4780-8711-a2653cb39869 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:04.977001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604ea72-f926-4780-8711-a2653cb39869 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:04.982113 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5f021-b01b-478f-9ece-3f5f8cf72233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:04.982814 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5f021-b01b-478f-9ece-3f5f8cf72233 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:04.983168 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5f021-b01b-478f-9ece-3f5f8cf72233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:04.983564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5f021-b01b-478f-9ece-3f5f8cf72233 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:04.984376 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5f021-b01b-478f-9ece-3f5f8cf72233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:04.986003 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5f021-b01b-478f-9ece-3f5f8cf72233 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:04.999182 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1017/2028] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:05.003615 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fe645-172c-4baf-a5f9-a66fab8dc5d3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:05.016098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fe645-172c-4baf-a5f9-a66fab8dc5d3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:05.022471 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d671b-570d-443e-8244-48bc24f4dd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:05.024500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d671b-570d-443e-8244-48bc24f4dd7b admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:05.024500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d671b-570d-443e-8244-48bc24f4dd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:05.024500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d671b-570d-443e-8244-48bc24f4dd7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:05.024500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d671b-570d-443e-8244-48bc24f4dd7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:05.026061 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d671b-570d-443e-8244-48bc24f4dd7b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:05.046774 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1012/2029] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:05.048517 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5f021-b01b-478f-9ece-3f5f8cf72233 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:05.055070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:05.059238 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5f021-b01b-478f-9ece-3f5f8cf72233 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:05.068525 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c65733-a25e-410d-b970-7185a4e12177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:05.069587 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c65733-a25e-410d-b970-7185a4e12177 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:05.070279 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c65733-a25e-410d-b970-7185a4e12177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:05.071001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c65733-a25e-410d-b970-7185a4e12177 admin admin] PATH_INFO: `/v3/projects/4f3ffb5bdde04a3e8aaa306dad1a95de/users/6723f11c90cc488990681f72d0a9f9c6/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:05.096086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c65733-a25e-410d-b970-7185a4e12177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3ffb5bdde04a3e8aaa306dad1a95de, user_id=6723f11c90cc488990681f72d0a9f9c6, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:05.099003 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c65733-a25e-410d-b970-7185a4e12177 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:05.118810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1018/2030] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:05 2022] PUT /identity/v3/projects/4f3ffb5bdde04a3e8aaa306dad1a95de/users/6723f11c90cc488990681f72d0a9f9c6/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:05.131126 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c244f6c-77b8-4ce8-90d3-3accce7f2cf5 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:05.131464 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c244f6c-77b8-4ce8-90d3-3accce7f2cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:05.131758 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c244f6c-77b8-4ce8-90d3-3accce7f2cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:05.168683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5c244f6c-77b8-4ce8-90d3-3accce7f2cf5 None None] MFA Rules not processed for user `6723f11c90cc488990681f72d0a9f9c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:05.171901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5c244f6c-77b8-4ce8-90d3-3accce7f2cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:05.253248 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1013/2031] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:05 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:05.257878 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c65733-a25e-410d-b970-7185a4e12177 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:05.325952 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c65733-a25e-410d-b970-7185a4e12177 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:05.331049 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8660ddf-8e4d-4b1a-aad4-91de75879902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:05.332235 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8660ddf-8e4d-4b1a-aad4-91de75879902 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:05.333224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8660ddf-8e4d-4b1a-aad4-91de75879902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:05.333224 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8660ddf-8e4d-4b1a-aad4-91de75879902 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:05.333702 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8660ddf-8e4d-4b1a-aad4-91de75879902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:05.335809 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8660ddf-8e4d-4b1a-aad4-91de75879902 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:05.381711 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1019/2032] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:05 2022] POST /identity/v3/projects => generated 401 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:05.398255 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c244f6c-77b8-4ce8-90d3-3accce7f2cf5 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:05.408711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:05.418119 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c244f6c-77b8-4ce8-90d3-3accce7f2cf5 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:05.525328 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c20a3-32a6-494a-8a03-1dac7b4d3f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:05.525887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c20a3-32a6-494a-8a03-1dac7b4d3f95 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:05.526174 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c20a3-32a6-494a-8a03-1dac7b4d3f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:05.526453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c20a3-32a6-494a-8a03-1dac7b4d3f95 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:05.527190 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c20a3-32a6-494a-8a03-1dac7b4d3f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:05.529274 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c20a3-32a6-494a-8a03-1dac7b4d3f95 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:05.554516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1014/2033] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:05 2022] POST /identity/v3/users => generated 307 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:05.558370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8660ddf-8e4d-4b1a-aad4-91de75879902 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:05.572302 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8660ddf-8e4d-4b1a-aad4-91de75879902 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:05.579196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32179e-40e7-4f1f-a276-7113680b4ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:05.580245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32179e-40e7-4f1f-a276-7113680b4ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:05.580677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32179e-40e7-4f1f-a276-7113680b4ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:05.580938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32179e-40e7-4f1f-a276-7113680b4ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:05.581759 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32179e-40e7-4f1f-a276-7113680b4ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:05.583645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32179e-40e7-4f1f-a276-7113680b4ac3 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:05.595795 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1020/2034] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:05.600290 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c20a3-32a6-494a-8a03-1dac7b4d3f95 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:05.614543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c20a3-32a6-494a-8a03-1dac7b4d3f95 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:05.619941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e4b46-4be0-41c8-933e-88c45baf9fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:05.620785 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e4b46-4be0-41c8-933e-88c45baf9fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:05.621135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e4b46-4be0-41c8-933e-88c45baf9fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:05.621478 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e4b46-4be0-41c8-933e-88c45baf9fbc admin admin] PATH_INFO: `/v3/projects/73f512dbaa604986bce3690ec6fb4469/users/3889a4ac6542429e9de6f7a11cdf99c3/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:05.639150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e4b46-4be0-41c8-933e-88c45baf9fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f512dbaa604986bce3690ec6fb4469, user_id=3889a4ac6542429e9de6f7a11cdf99c3, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:05.643928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e4b46-4be0-41c8-933e-88c45baf9fbc admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:05.667183 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1015/2035] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:05 2022] PUT /identity/v3/projects/73f512dbaa604986bce3690ec6fb4469/users/3889a4ac6542429e9de6f7a11cdf99c3/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:05.671094 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32179e-40e7-4f1f-a276-7113680b4ac3 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:05.682612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32179e-40e7-4f1f-a276-7113680b4ac3 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:05.780683 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285de77d-e55c-4102-8af2-820220da794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:05.781347 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285de77d-e55c-4102-8af2-820220da794d admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:05.781788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285de77d-e55c-4102-8af2-820220da794d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:05.782283 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285de77d-e55c-4102-8af2-820220da794d admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:05.784293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285de77d-e55c-4102-8af2-820220da794d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:05.786428 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285de77d-e55c-4102-8af2-820220da794d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:05.807987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1021/2036] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:05.812761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e4b46-4be0-41c8-933e-88c45baf9fbc admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:05.824561 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e4b46-4be0-41c8-933e-88c45baf9fbc admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:05.832291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4158c1-cd19-4b39-bfde-ade556c3de0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:05.833113 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4158c1-cd19-4b39-bfde-ade556c3de0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:05.833455 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4158c1-cd19-4b39-bfde-ade556c3de0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:05.833820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4158c1-cd19-4b39-bfde-ade556c3de0b admin admin] PATH_INFO: `/v3/projects/73f512dbaa604986bce3690ec6fb4469/users/3889a4ac6542429e9de6f7a11cdf99c3/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:05.836919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4158c1-cd19-4b39-bfde-ade556c3de0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f512dbaa604986bce3690ec6fb4469, user_id=3889a4ac6542429e9de6f7a11cdf99c3, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:05.840170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4158c1-cd19-4b39-bfde-ade556c3de0b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:05.854950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1016/2037] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:05 2022] PUT /identity/v3/projects/73f512dbaa604986bce3690ec6fb4469/users/3889a4ac6542429e9de6f7a11cdf99c3/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:05.867293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad98fe-27eb-472a-a6d4-8ded1e039f64 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:05.867585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad98fe-27eb-472a-a6d4-8ded1e039f64 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:05.867867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad98fe-27eb-472a-a6d4-8ded1e039f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:05.904589 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-58ad98fe-27eb-472a-a6d4-8ded1e039f64 None None] MFA Rules not processed for user `3889a4ac6542429e9de6f7a11cdf99c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:05.907252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-58ad98fe-27eb-472a-a6d4-8ded1e039f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:05.956395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:05.997197 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1022/2038] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:05 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:06.009115 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4158c1-cd19-4b39-bfde-ade556c3de0b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:06.012593 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3c4158c1-cd19-4b39-bfde-ade556c3de0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:06.077557 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4158c1-cd19-4b39-bfde-ade556c3de0b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:06.081939 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b80a9-9c66-4ddf-9d40-704d07ab8ebd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:06.082550 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b80a9-9c66-4ddf-9d40-704d07ab8ebd service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:06.082876 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b80a9-9c66-4ddf-9d40-704d07ab8ebd service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:06.083203 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b80a9-9c66-4ddf-9d40-704d07ab8ebd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:06.092634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b80a9-9c66-4ddf-9d40-704d07ab8ebd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:06.094197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b80a9-9c66-4ddf-9d40-704d07ab8ebd service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:06.105237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1017/2039] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:06 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:06.180324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad98fe-27eb-472a-a6d4-8ded1e039f64 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:06.193146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad98fe-27eb-472a-a6d4-8ded1e039f64 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:06.196700 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a7dcd-15be-4fdd-adcd-2b07d52b712d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:06.197303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a7dcd-15be-4fdd-adcd-2b07d52b712d service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:06.197580 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a7dcd-15be-4fdd-adcd-2b07d52b712d service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:06.197852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a7dcd-15be-4fdd-adcd-2b07d52b712d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:06.256719 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a7dcd-15be-4fdd-adcd-2b07d52b712d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:06.258266 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a7dcd-15be-4fdd-adcd-2b07d52b712d service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:06.271637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1023/2040] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:06 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:08.730461 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b80a9-9c66-4ddf-9d40-704d07ab8ebd service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:08.733522 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-866b80a9-9c66-4ddf-9d40-704d07ab8ebd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:08.858134 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b80a9-9c66-4ddf-9d40-704d07ab8ebd service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:08.863849 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1decc0-c1aa-46d8-a77a-a442a2a8f600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:08.864518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1decc0-c1aa-46d8-a77a-a442a2a8f600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:08.864807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1decc0-c1aa-46d8-a77a-a442a2a8f600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:08.865084 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1decc0-c1aa-46d8-a77a-a442a2a8f600 admin admin] PATH_INFO: `/v3/users/0ccdb90c674f4b70aec05b7bac7232c5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:08.866350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1decc0-c1aa-46d8-a77a-a442a2a8f600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ccdb90c674f4b70aec05b7bac7232c5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:08.868372 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1decc0-c1aa-46d8-a77a-a442a2a8f600 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:08.871982 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:08.939560 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ae1decc0-c1aa-46d8-a77a-a442a2a8f600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ccdb90c674f4b70aec05b7bac7232c5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:08.946936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ae1decc0-c1aa-46d8-a77a-a442a2a8f600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ccdb90c674f4b70aec05b7bac7232c5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:08.947726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ae1decc0-c1aa-46d8-a77a-a442a2a8f600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ccdb90c674f4b70aec05b7bac7232c5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:08.960846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ae1decc0-c1aa-46d8-a77a-a442a2a8f600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ccdb90c674f4b70aec05b7bac7232c5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:08.968710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ae1decc0-c1aa-46d8-a77a-a442a2a8f600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ccdb90c674f4b70aec05b7bac7232c5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:08.975552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1018/2041] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:08 2022] DELETE /identity/v3/users/0ccdb90c674f4b70aec05b7bac7232c5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:08.980311 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fb583-5b20-4ccc-a970-cafbc67a8481 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:08.980826 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fb583-5b20-4ccc-a970-cafbc67a8481 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:08.981095 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fb583-5b20-4ccc-a970-cafbc67a8481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:09.000382 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5e5fb583-5b20-4ccc-a970-cafbc67a8481 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:09.001695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5e5fb583-5b20-4ccc-a970-cafbc67a8481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:09.062111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1024/2042] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:09.072064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1decc0-c1aa-46d8-a77a-a442a2a8f600 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:09.073539 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ae1decc0-c1aa-46d8-a77a-a442a2a8f600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:09.151874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1decc0-c1aa-46d8-a77a-a442a2a8f600 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:09.155924 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d71d5-1731-4a2f-b55d-69026c94d056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:09.156823 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d71d5-1731-4a2f-b55d-69026c94d056 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:09.157169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d71d5-1731-4a2f-b55d-69026c94d056 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:09.157431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d71d5-1731-4a2f-b55d-69026c94d056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:09.170055 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d71d5-1731-4a2f-b55d-69026c94d056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:09.171675 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d71d5-1731-4a2f-b55d-69026c94d056 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:09.186096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1019/2043] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:09.595689 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fb583-5b20-4ccc-a970-cafbc67a8481 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:09.597225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5e5fb583-5b20-4ccc-a970-cafbc67a8481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:09.621364 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fb583-5b20-4ccc-a970-cafbc67a8481 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:09.627370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573fdb4-f174-4132-8df4-b8fc06dc6597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:09.628303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573fdb4-f174-4132-8df4-b8fc06dc6597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:09.628683 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573fdb4-f174-4132-8df4-b8fc06dc6597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:09.629123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573fdb4-f174-4132-8df4-b8fc06dc6597 admin admin] PATH_INFO: `/v3/projects/b3859ada0c284ad2b568a4ac2ab5d758` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:09.630449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573fdb4-f174-4132-8df4-b8fc06dc6597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3859ada0c284ad2b568a4ac2ab5d758)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:09.632621 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573fdb4-f174-4132-8df4-b8fc06dc6597 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:09.688179 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8573fdb4-f174-4132-8df4-b8fc06dc6597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3859ada0c284ad2b568a4ac2ab5d758', 'request_id': 'req-8573fdb4-f174-4132-8df4-b8fc06dc6597'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:09.696169 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8573fdb4-f174-4132-8df4-b8fc06dc6597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3859ada0c284ad2b568a4ac2ab5d758', 'request_id': 'req-8573fdb4-f174-4132-8df4-b8fc06dc6597'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:09.708247 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8573fdb4-f174-4132-8df4-b8fc06dc6597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3859ada0c284ad2b568a4ac2ab5d758', 'request_id': 'req-8573fdb4-f174-4132-8df4-b8fc06dc6597'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:09.717821 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:09.723762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8573fdb4-f174-4132-8df4-b8fc06dc6597 admin admin] The token cache is being invalidate because project b3859ada0c284ad2b568a4ac2ab5d758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:09.724326 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8573fdb4-f174-4132-8df4-b8fc06dc6597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:09.725490 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8573fdb4-f174-4132-8df4-b8fc06dc6597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:09.728699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1025/2044] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:09 2022] DELETE /identity/v3/projects/b3859ada0c284ad2b568a4ac2ab5d758 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:09.731543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d71d5-1731-4a2f-b55d-69026c94d056 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:09.742935 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d71d5-1731-4a2f-b55d-69026c94d056 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:09.825540 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fbb43-2412-468c-afeb-197713771b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:09.826203 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fbb43-2412-468c-afeb-197713771b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:09.826496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fbb43-2412-468c-afeb-197713771b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:09.826808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fbb43-2412-468c-afeb-197713771b6a admin admin] PATH_INFO: `/v3/users/f1deea2a60fc4c6fa0e498940b6f4084` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:09.828041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fbb43-2412-468c-afeb-197713771b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1deea2a60fc4c6fa0e498940b6f4084)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:09.830763 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fbb43-2412-468c-afeb-197713771b6a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:09.862625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:09.899088 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-981fbb43-2412-468c-afeb-197713771b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1deea2a60fc4c6fa0e498940b6f4084'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:09.912001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-981fbb43-2412-468c-afeb-197713771b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1deea2a60fc4c6fa0e498940b6f4084'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:09.913100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-981fbb43-2412-468c-afeb-197713771b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1deea2a60fc4c6fa0e498940b6f4084'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:09.933988 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-981fbb43-2412-468c-afeb-197713771b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1deea2a60fc4c6fa0e498940b6f4084'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:09.958562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-981fbb43-2412-468c-afeb-197713771b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1deea2a60fc4c6fa0e498940b6f4084'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:09.968567 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1020/2045] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:09 2022] DELETE /identity/v3/users/f1deea2a60fc4c6fa0e498940b6f4084 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:10.334702 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573fdb4-f174-4132-8df4-b8fc06dc6597 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:10.336387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8573fdb4-f174-4132-8df4-b8fc06dc6597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:10.358918 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573fdb4-f174-4132-8df4-b8fc06dc6597 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:10.429944 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8c454-697b-40ab-aeb9-72d748674d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:10.430600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8c454-697b-40ab-aeb9-72d748674d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:10.433328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8c454-697b-40ab-aeb9-72d748674d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:10.433727 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8c454-697b-40ab-aeb9-72d748674d22 admin admin] PATH_INFO: `/v3/projects/f7d96c9808b84f9d9528d90fce6bcc9d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:10.436088 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8c454-697b-40ab-aeb9-72d748674d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d96c9808b84f9d9528d90fce6bcc9d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:10.438037 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8c454-697b-40ab-aeb9-72d748674d22 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:10.503946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4db8c454-697b-40ab-aeb9-72d748674d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d96c9808b84f9d9528d90fce6bcc9d', 'request_id': 'req-4db8c454-697b-40ab-aeb9-72d748674d22'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:10.512309 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4db8c454-697b-40ab-aeb9-72d748674d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d96c9808b84f9d9528d90fce6bcc9d', 'request_id': 'req-4db8c454-697b-40ab-aeb9-72d748674d22'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:10.526904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4db8c454-697b-40ab-aeb9-72d748674d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d96c9808b84f9d9528d90fce6bcc9d', 'request_id': 'req-4db8c454-697b-40ab-aeb9-72d748674d22'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:10.559142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4db8c454-697b-40ab-aeb9-72d748674d22 admin admin] The token cache is being invalidate because project f7d96c9808b84f9d9528d90fce6bcc9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:10.559505 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4db8c454-697b-40ab-aeb9-72d748674d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:10.560386 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4db8c454-697b-40ab-aeb9-72d748674d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:10.562493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1026/2046] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:10 2022] DELETE /identity/v3/projects/f7d96c9808b84f9d9528d90fce6bcc9d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:10.569732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fbb43-2412-468c-afeb-197713771b6a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:10.571978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-981fbb43-2412-468c-afeb-197713771b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:10.592673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fbb43-2412-468c-afeb-197713771b6a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:10.685483 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8c454-697b-40ab-aeb9-72d748674d22 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:10.687016 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4db8c454-697b-40ab-aeb9-72d748674d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:10.705701 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db72a66-7dcf-4392-a5f0-20337513711b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:10.706349 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db72a66-7dcf-4392-a5f0-20337513711b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:10.706708 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db72a66-7dcf-4392-a5f0-20337513711b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:10.706921 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db72a66-7dcf-4392-a5f0-20337513711b admin admin] PATH_INFO: `/v3/users/25408c83833d41d4968dbc072e3876c5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:10.708210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db72a66-7dcf-4392-a5f0-20337513711b admin admin] RBAC: Authorizing `identity:delete_user(user_id=25408c83833d41d4968dbc072e3876c5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:10.711114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db72a66-7dcf-4392-a5f0-20337513711b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:10.773709 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8c454-697b-40ab-aeb9-72d748674d22 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:10.780915 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd4d5f-0bfd-4303-9fd2-c94d7ef0ff5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:10.781852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd4d5f-0bfd-4303-9fd2-c94d7ef0ff5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:10.782209 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd4d5f-0bfd-4303-9fd2-c94d7ef0ff5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:10.782939 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd4d5f-0bfd-4303-9fd2-c94d7ef0ff5b admin admin] PATH_INFO: `/v3/users/6723f11c90cc488990681f72d0a9f9c6` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:10.784596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd4d5f-0bfd-4303-9fd2-c94d7ef0ff5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6723f11c90cc488990681f72d0a9f9c6)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:10.787489 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd4d5f-0bfd-4303-9fd2-c94d7ef0ff5b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:10.791394 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6db72a66-7dcf-4392-a5f0-20337513711b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25408c83833d41d4968dbc072e3876c5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:10.800663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6db72a66-7dcf-4392-a5f0-20337513711b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25408c83833d41d4968dbc072e3876c5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:10.801461 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6db72a66-7dcf-4392-a5f0-20337513711b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25408c83833d41d4968dbc072e3876c5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:10.844447 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:10.848241 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6db72a66-7dcf-4392-a5f0-20337513711b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25408c83833d41d4968dbc072e3876c5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:10.868421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6db72a66-7dcf-4392-a5f0-20337513711b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25408c83833d41d4968dbc072e3876c5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:10.883139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1021/2047] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:10 2022] DELETE /identity/v3/users/25408c83833d41d4968dbc072e3876c5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:10.905270 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-71cd4d5f-0bfd-4303-9fd2-c94d7ef0ff5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6723f11c90cc488990681f72d0a9f9c6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:10.923969 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-71cd4d5f-0bfd-4303-9fd2-c94d7ef0ff5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6723f11c90cc488990681f72d0a9f9c6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:10.963992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-71cd4d5f-0bfd-4303-9fd2-c94d7ef0ff5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6723f11c90cc488990681f72d0a9f9c6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:10.971376 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-71cd4d5f-0bfd-4303-9fd2-c94d7ef0ff5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6723f11c90cc488990681f72d0a9f9c6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:10.987196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-71cd4d5f-0bfd-4303-9fd2-c94d7ef0ff5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6723f11c90cc488990681f72d0a9f9c6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:10.996840 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1027/2048] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:10 2022] DELETE /identity/v3/users/6723f11c90cc488990681f72d0a9f9c6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:11.002246 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62fd87-2213-4e48-8c4b-65c7510b4505 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:11.002913 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62fd87-2213-4e48-8c4b-65c7510b4505 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:11.003213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62fd87-2213-4e48-8c4b-65c7510b4505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:11.045077 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-da62fd87-2213-4e48-8c4b-65c7510b4505 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:11.047311 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-da62fd87-2213-4e48-8c4b-65c7510b4505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:11.079679 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:11.199895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1022/2049] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:11.234659 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd4d5f-0bfd-4303-9fd2-c94d7ef0ff5b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:11.239214 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-71cd4d5f-0bfd-4303-9fd2-c94d7ef0ff5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:11.333609 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd4d5f-0bfd-4303-9fd2-c94d7ef0ff5b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:11.339822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9788cc3-b803-49a1-a0e4-d886f0e66492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:11.341181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9788cc3-b803-49a1-a0e4-d886f0e66492 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:11.341641 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9788cc3-b803-49a1-a0e4-d886f0e66492 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:11.342124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9788cc3-b803-49a1-a0e4-d886f0e66492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:11.362826 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9788cc3-b803-49a1-a0e4-d886f0e66492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:11.365478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9788cc3-b803-49a1-a0e4-d886f0e66492 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:11.390114 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1028/2050] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:11.969677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62fd87-2213-4e48-8c4b-65c7510b4505 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:11.971697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-da62fd87-2213-4e48-8c4b-65c7510b4505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:11.991241 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62fd87-2213-4e48-8c4b-65c7510b4505 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:11.998022 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15be169-17cf-41f8-9cbb-98fe24f99b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:11.999065 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15be169-17cf-41f8-9cbb-98fe24f99b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:11.999535 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15be169-17cf-41f8-9cbb-98fe24f99b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:11.999966 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15be169-17cf-41f8-9cbb-98fe24f99b4f admin admin] PATH_INFO: `/v3/projects/11a030aae9654fa6b2539f28015ca889` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:12.002146 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15be169-17cf-41f8-9cbb-98fe24f99b4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a030aae9654fa6b2539f28015ca889)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:12.004400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15be169-17cf-41f8-9cbb-98fe24f99b4f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:12.073670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f15be169-17cf-41f8-9cbb-98fe24f99b4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a030aae9654fa6b2539f28015ca889', 'request_id': 'req-f15be169-17cf-41f8-9cbb-98fe24f99b4f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:12.081599 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f15be169-17cf-41f8-9cbb-98fe24f99b4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a030aae9654fa6b2539f28015ca889', 'request_id': 'req-f15be169-17cf-41f8-9cbb-98fe24f99b4f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:12.088877 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f15be169-17cf-41f8-9cbb-98fe24f99b4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a030aae9654fa6b2539f28015ca889', 'request_id': 'req-f15be169-17cf-41f8-9cbb-98fe24f99b4f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:12.103725 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f15be169-17cf-41f8-9cbb-98fe24f99b4f admin admin] The token cache is being invalidate because project 11a030aae9654fa6b2539f28015ca889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:12.104006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f15be169-17cf-41f8-9cbb-98fe24f99b4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:12.104664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f15be169-17cf-41f8-9cbb-98fe24f99b4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:12.109592 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1023/2051] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:11 2022] DELETE /identity/v3/projects/11a030aae9654fa6b2539f28015ca889 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:12.111754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8096e3-b897-405d-8b77-4b918be62f36 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:12.112044 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8096e3-b897-405d-8b77-4b918be62f36 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:12.112317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8096e3-b897-405d-8b77-4b918be62f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:12.137649 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0d8096e3-b897-405d-8b77-4b918be62f36 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:12.140223 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0d8096e3-b897-405d-8b77-4b918be62f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:12.235488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1029/2052] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:12.238035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc5321-ff96-4bcc-8efa-b1ce1d9c8254 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:12.238391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc5321-ff96-4bcc-8efa-b1ce1d9c8254 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:12.238755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc5321-ff96-4bcc-8efa-b1ce1d9c8254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:12.269906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e6cc5321-ff96-4bcc-8efa-b1ce1d9c8254 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:12.271171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e6cc5321-ff96-4bcc-8efa-b1ce1d9c8254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:12.281935 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1024/2053] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:12.284993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8096e3-b897-405d-8b77-4b918be62f36 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:12.295590 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8096e3-b897-405d-8b77-4b918be62f36 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:12.308602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7ea61-ead3-4f7b-a1e8-09e8e5028eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:12.309292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7ea61-ead3-4f7b-a1e8-09e8e5028eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:12.309587 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7ea61-ead3-4f7b-a1e8-09e8e5028eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:12.309850 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7ea61-ead3-4f7b-a1e8-09e8e5028eb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:12.310592 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7ea61-ead3-4f7b-a1e8-09e8e5028eb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:21:12.311092 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7ea61-ead3-4f7b-a1e8-09e8e5028eb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:12.312699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7ea61-ead3-4f7b-a1e8-09e8e5028eb2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:12.324228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc5321-ff96-4bcc-8efa-b1ce1d9c8254 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:12.325873 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e6cc5321-ff96-4bcc-8efa-b1ce1d9c8254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:12.352605 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1030/2054] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:21:12.359123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7ea61-ead3-4f7b-a1e8-09e8e5028eb2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:12.359900 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc5321-ff96-4bcc-8efa-b1ce1d9c8254 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:12.385462 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c83ba3-a418-4405-8831-a5db9aa84c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:12.388492 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c83ba3-a418-4405-8831-a5db9aa84c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:12.389672 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7ea61-ead3-4f7b-a1e8-09e8e5028eb2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:12.390139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c83ba3-a418-4405-8831-a5db9aa84c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:12.390603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c83ba3-a418-4405-8831-a5db9aa84c44 admin admin] PATH_INFO: `/v3/projects/4f3ffb5bdde04a3e8aaa306dad1a95de` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:12.400528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c83ba3-a418-4405-8831-a5db9aa84c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f3ffb5bdde04a3e8aaa306dad1a95de)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:12.400528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c83ba3-a418-4405-8831-a5db9aa84c44 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:12.404221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d21cf-e96f-4ea0-b16a-ba14ba222f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:12.405714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d21cf-e96f-4ea0-b16a-ba14ba222f48 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:12.405714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d21cf-e96f-4ea0-b16a-ba14ba222f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:12.405714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d21cf-e96f-4ea0-b16a-ba14ba222f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:12.406144 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d21cf-e96f-4ea0-b16a-ba14ba222f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:12.412593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d21cf-e96f-4ea0-b16a-ba14ba222f48 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:12.481560 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1031/2055] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:12 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:12.488799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d21cf-e96f-4ea0-b16a-ba14ba222f48 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:12.492416 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a8c83ba3-a418-4405-8831-a5db9aa84c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f3ffb5bdde04a3e8aaa306dad1a95de', 'request_id': 'req-a8c83ba3-a418-4405-8831-a5db9aa84c44'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:12.498795 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a8c83ba3-a418-4405-8831-a5db9aa84c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f3ffb5bdde04a3e8aaa306dad1a95de', 'request_id': 'req-a8c83ba3-a418-4405-8831-a5db9aa84c44'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:12.510527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a8c83ba3-a418-4405-8831-a5db9aa84c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f3ffb5bdde04a3e8aaa306dad1a95de', 'request_id': 'req-a8c83ba3-a418-4405-8831-a5db9aa84c44'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:12.528041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a8c83ba3-a418-4405-8831-a5db9aa84c44 admin admin] The token cache is being invalidate because project 4f3ffb5bdde04a3e8aaa306dad1a95de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:12.528750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a8c83ba3-a418-4405-8831-a5db9aa84c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:12.528896 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:12.529839 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a8c83ba3-a418-4405-8831-a5db9aa84c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:12.534390 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1025/2056] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:12 2022] DELETE /identity/v3/projects/4f3ffb5bdde04a3e8aaa306dad1a95de => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:12.538911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c83ba3-a418-4405-8831-a5db9aa84c44 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:12.544452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a8c83ba3-a418-4405-8831-a5db9aa84c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:12.591744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:12.592238 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d21cf-e96f-4ea0-b16a-ba14ba222f48 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:12.601369 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f859a-1de1-4f0b-acd0-b0a8a1d17e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:12.601369 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f859a-1de1-4f0b-acd0-b0a8a1d17e42 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:12.601369 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f859a-1de1-4f0b-acd0-b0a8a1d17e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:12.601369 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f859a-1de1-4f0b-acd0-b0a8a1d17e42 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:12.602223 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f859a-1de1-4f0b-acd0-b0a8a1d17e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:12.605528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f859a-1de1-4f0b-acd0-b0a8a1d17e42 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:12.634846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1032/2057] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:12 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:12.637934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f859a-1de1-4f0b-acd0-b0a8a1d17e42 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:12.641283 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ff8f859a-1de1-4f0b-acd0-b0a8a1d17e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:12.648564 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c83ba3-a418-4405-8831-a5db9aa84c44 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:12.654896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b5784-3805-4af4-8788-cd46e9ed73f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:12.655551 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b5784-3805-4af4-8788-cd46e9ed73f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:12.655840 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b5784-3805-4af4-8788-cd46e9ed73f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:12.656123 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b5784-3805-4af4-8788-cd46e9ed73f3 admin admin] PATH_INFO: `/v3/users/3889a4ac6542429e9de6f7a11cdf99c3` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:12.658216 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b5784-3805-4af4-8788-cd46e9ed73f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3889a4ac6542429e9de6f7a11cdf99c3)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:12.660660 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b5784-3805-4af4-8788-cd46e9ed73f3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:12.662335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f859a-1de1-4f0b-acd0-b0a8a1d17e42 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:12.671669 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbe131-b322-4128-8fdf-5469f580df9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:12.672308 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbe131-b322-4128-8fdf-5469f580df9e admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:12.672870 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbe131-b322-4128-8fdf-5469f580df9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:12.672870 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbe131-b322-4128-8fdf-5469f580df9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:12.674087 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbe131-b322-4128-8fdf-5469f580df9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:12.679761 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbe131-b322-4128-8fdf-5469f580df9e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:12.691035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1033/2058] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:12.693976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbe131-b322-4128-8fdf-5469f580df9e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:12.705976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbe131-b322-4128-8fdf-5469f580df9e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:12.721391 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2d35c-7fba-4f2a-8c2c-9bd9722d737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:12.721391 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2d35c-7fba-4f2a-8c2c-9bd9722d737f admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:12.721391 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2d35c-7fba-4f2a-8c2c-9bd9722d737f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:12.721391 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2d35c-7fba-4f2a-8c2c-9bd9722d737f admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:12.721749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2d35c-7fba-4f2a-8c2c-9bd9722d737f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:12.721749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2d35c-7fba-4f2a-8c2c-9bd9722d737f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:12.735441 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1034/2059] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:12.740221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2d35c-7fba-4f2a-8c2c-9bd9722d737f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:12.742188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-035b5784-3805-4af4-8788-cd46e9ed73f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3889a4ac6542429e9de6f7a11cdf99c3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:12.750409 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-035b5784-3805-4af4-8788-cd46e9ed73f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3889a4ac6542429e9de6f7a11cdf99c3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:12.751493 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-035b5784-3805-4af4-8788-cd46e9ed73f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3889a4ac6542429e9de6f7a11cdf99c3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:12.765349 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2d35c-7fba-4f2a-8c2c-9bd9722d737f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:12.775967 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-035b5784-3805-4af4-8788-cd46e9ed73f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3889a4ac6542429e9de6f7a11cdf99c3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:12.782175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4f498-ebff-4b10-8e14-00d6b23c070b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:12.783616 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4f498-ebff-4b10-8e14-00d6b23c070b admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:12.783895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4f498-ebff-4b10-8e14-00d6b23c070b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:12.784251 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4f498-ebff-4b10-8e14-00d6b23c070b admin admin] PATH_INFO: `/v3/projects/a7ebd77ff8744f84b8783cba9a26c1b7/users/547814df41ac488ca7b0e9064d92fffc/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:12.785736 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-035b5784-3805-4af4-8788-cd46e9ed73f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3889a4ac6542429e9de6f7a11cdf99c3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:12.797515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1026/2060] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:12 2022] DELETE /identity/v3/users/3889a4ac6542429e9de6f7a11cdf99c3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:12.806851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4f498-ebff-4b10-8e14-00d6b23c070b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ebd77ff8744f84b8783cba9a26c1b7, user_id=547814df41ac488ca7b0e9064d92fffc, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:12.809788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4f498-ebff-4b10-8e14-00d6b23c070b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:12.835482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1035/2061] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:12 2022] PUT /identity/v3/projects/a7ebd77ff8744f84b8783cba9a26c1b7/users/547814df41ac488ca7b0e9064d92fffc/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:12.848970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67098d41-6a5c-4d56-8232-ea26dd333b06 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:12.850357 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67098d41-6a5c-4d56-8232-ea26dd333b06 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:12.850935 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67098d41-6a5c-4d56-8232-ea26dd333b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:12.900103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-67098d41-6a5c-4d56-8232-ea26dd333b06 None None] MFA Rules not processed for user `547814df41ac488ca7b0e9064d92fffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:12.901826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-67098d41-6a5c-4d56-8232-ea26dd333b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:13.042224 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1027/2062] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:13.047518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4f498-ebff-4b10-8e14-00d6b23c070b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:13.049694 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-efb4f498-ebff-4b10-8e14-00d6b23c070b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:13.146924 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4f498-ebff-4b10-8e14-00d6b23c070b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:13.152688 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fda80-5688-48a9-bb9e-09ac03bf160f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:13.153738 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fda80-5688-48a9-bb9e-09ac03bf160f admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:13.154178 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fda80-5688-48a9-bb9e-09ac03bf160f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:13.154457 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fda80-5688-48a9-bb9e-09ac03bf160f admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:13.155154 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fda80-5688-48a9-bb9e-09ac03bf160f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:13.158019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fda80-5688-48a9-bb9e-09ac03bf160f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:13.198976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1036/2063] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:13 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:13.203742 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67098d41-6a5c-4d56-8232-ea26dd333b06 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:13.218393 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67098d41-6a5c-4d56-8232-ea26dd333b06 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:13.252166 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:13.261859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fda80-5688-48a9-bb9e-09ac03bf160f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:13.264080 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9c2fda80-5688-48a9-bb9e-09ac03bf160f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:13.304586 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b0c3b-667f-4616-8d21-cd95454a3e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:13.305574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b0c3b-667f-4616-8d21-cd95454a3e93 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:13.305864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b0c3b-667f-4616-8d21-cd95454a3e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:13.306259 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b0c3b-667f-4616-8d21-cd95454a3e93 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:13.307210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b0c3b-667f-4616-8d21-cd95454a3e93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:13.309149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b0c3b-667f-4616-8d21-cd95454a3e93 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:13.327583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:13.340085 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1028/2064] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:13 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:13.346000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b0c3b-667f-4616-8d21-cd95454a3e93 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:13.357978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fda80-5688-48a9-bb9e-09ac03bf160f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:13.358508 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b0c3b-667f-4616-8d21-cd95454a3e93 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:13.363331 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d07555-59e9-4d71-9990-f6cf6be8b412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:13.364147 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d07555-59e9-4d71-9990-f6cf6be8b412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:13.364510 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d07555-59e9-4d71-9990-f6cf6be8b412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:13.364866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d07555-59e9-4d71-9990-f6cf6be8b412 admin admin] PATH_INFO: `/v3/projects/73f512dbaa604986bce3690ec6fb4469` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:13.364990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b57291-8275-493d-bcb2-c7cea9e832e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:13.365603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57291-8275-493d-bcb2-c7cea9e832e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:13.365886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57291-8275-493d-bcb2-c7cea9e832e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:13.366193 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57291-8275-493d-bcb2-c7cea9e832e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:13.366901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b57291-8275-493d-bcb2-c7cea9e832e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:13.367059 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d07555-59e9-4d71-9990-f6cf6be8b412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f512dbaa604986bce3690ec6fb4469)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:13.368497 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b57291-8275-493d-bcb2-c7cea9e832e4 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:13.369124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d07555-59e9-4d71-9990-f6cf6be8b412 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:13.380300 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1029/2065] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:13.383932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b57291-8275-493d-bcb2-c7cea9e832e4 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:13.399307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b57291-8275-493d-bcb2-c7cea9e832e4 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:13.407597 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0693caf-dfe5-4bb4-94e8-8b154b7abb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:13.408902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0693caf-dfe5-4bb4-94e8-8b154b7abb1d admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:13.408902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0693caf-dfe5-4bb4-94e8-8b154b7abb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:13.409307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0693caf-dfe5-4bb4-94e8-8b154b7abb1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:13.410062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0693caf-dfe5-4bb4-94e8-8b154b7abb1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:13.411953 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0693caf-dfe5-4bb4-94e8-8b154b7abb1d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:13.425601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1030/2066] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:13.429428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0693caf-dfe5-4bb4-94e8-8b154b7abb1d admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:13.430662 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-03d07555-59e9-4d71-9990-f6cf6be8b412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f512dbaa604986bce3690ec6fb4469', 'request_id': 'req-03d07555-59e9-4d71-9990-f6cf6be8b412'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:13.438320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-03d07555-59e9-4d71-9990-f6cf6be8b412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f512dbaa604986bce3690ec6fb4469', 'request_id': 'req-03d07555-59e9-4d71-9990-f6cf6be8b412'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:13.439810 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0693caf-dfe5-4bb4-94e8-8b154b7abb1d admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:13.448012 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-03d07555-59e9-4d71-9990-f6cf6be8b412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f512dbaa604986bce3690ec6fb4469', 'request_id': 'req-03d07555-59e9-4d71-9990-f6cf6be8b412'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:13.460335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-03d07555-59e9-4d71-9990-f6cf6be8b412 admin admin] The token cache is being invalidate because project 73f512dbaa604986bce3690ec6fb4469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:13.460618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-03d07555-59e9-4d71-9990-f6cf6be8b412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:13.461295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-03d07555-59e9-4d71-9990-f6cf6be8b412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:13.463732 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1037/2067] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:13 2022] DELETE /identity/v3/projects/73f512dbaa604986bce3690ec6fb4469 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:13.467821 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c01662-db1b-4b21-9003-ae6628a68cdd None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:13.467958 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c01662-db1b-4b21-9003-ae6628a68cdd None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:13.468185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c01662-db1b-4b21-9003-ae6628a68cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:13.488488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b4c01662-db1b-4b21-9003-ae6628a68cdd None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:13.489611 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b4c01662-db1b-4b21-9003-ae6628a68cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:13.519237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e670a-4872-465d-bdb4-458d38fd91dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:13.522765 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e670a-4872-465d-bdb4-458d38fd91dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:13.522765 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e670a-4872-465d-bdb4-458d38fd91dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:13.522765 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e670a-4872-465d-bdb4-458d38fd91dc admin admin] PATH_INFO: `/v3/projects/449720bdc99649329a5e6b59bacb92ea/users/a6e6607e25b940898d6243111baf7302/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:13.539348 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e670a-4872-465d-bdb4-458d38fd91dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=449720bdc99649329a5e6b59bacb92ea, user_id=a6e6607e25b940898d6243111baf7302, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:13.543882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e670a-4872-465d-bdb4-458d38fd91dc admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:13.563576 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1031/2068] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:13 2022] PUT /identity/v3/projects/449720bdc99649329a5e6b59bacb92ea/users/a6e6607e25b940898d6243111baf7302/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:13.575097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb9905-256e-4584-adf2-5f0853002950 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:13.575389 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb9905-256e-4584-adf2-5f0853002950 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:13.575671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb9905-256e-4584-adf2-5f0853002950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:13.577785 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1038/2069] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:13.585781 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f60c89-5491-4a63-b882-24ace4983846 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:13.586308 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f60c89-5491-4a63-b882-24ace4983846 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:13.586793 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f60c89-5491-4a63-b882-24ace4983846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:13.606705 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-bbbb9905-256e-4584-adf2-5f0853002950 None None] MFA Rules not processed for user `a6e6607e25b940898d6243111baf7302`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:13.607502 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c1f60c89-5491-4a63-b882-24ace4983846 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:13.608966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c1f60c89-5491-4a63-b882-24ace4983846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:13.609208 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-bbbb9905-256e-4584-adf2-5f0853002950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:13.685568 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1039/2071] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:13.685773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1032/2071] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:13.690817 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb9905-256e-4584-adf2-5f0853002950 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:13.692280 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f60c89-5491-4a63-b882-24ace4983846 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:13.693190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c1f60c89-5491-4a63-b882-24ace4983846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:13.701951 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb9905-256e-4584-adf2-5f0853002950 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:13.706069 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f60c89-5491-4a63-b882-24ace4983846 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:13.712935 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee9bcd-4ecd-431f-a6c7-27a17054858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:13.713663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee9bcd-4ecd-431f-a6c7-27a17054858c admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:13.714015 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee9bcd-4ecd-431f-a6c7-27a17054858c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:13.714364 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee9bcd-4ecd-431f-a6c7-27a17054858c admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:13.715165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee9bcd-4ecd-431f-a6c7-27a17054858c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:21:13.715545 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee9bcd-4ecd-431f-a6c7-27a17054858c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:13.716294 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c1f12-f34c-4b91-b371-48aa7a650476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:13.716987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c1f12-f34c-4b91-b371-48aa7a650476 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:13.717271 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c1f12-f34c-4b91-b371-48aa7a650476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:13.717537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee9bcd-4ecd-431f-a6c7-27a17054858c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:13.717661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c1f12-f34c-4b91-b371-48aa7a650476 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:13.718184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c1f12-f34c-4b91-b371-48aa7a650476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:13.720176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c1f12-f34c-4b91-b371-48aa7a650476 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:13.720582 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:13.732118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1033/2072] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:21:13.737195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee9bcd-4ecd-431f-a6c7-27a17054858c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:13.739314 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:13.750950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee9bcd-4ecd-431f-a6c7-27a17054858c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:13.759453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1040/2073] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:13 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:13.759599 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36f864-8918-4278-ab1d-1e97a72c54ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:13.759599 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36f864-8918-4278-ab1d-1e97a72c54ed admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:13.759599 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36f864-8918-4278-ab1d-1e97a72c54ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:13.759599 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36f864-8918-4278-ab1d-1e97a72c54ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:13.759893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36f864-8918-4278-ab1d-1e97a72c54ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:13.760445 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c1f12-f34c-4b91-b371-48aa7a650476 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:13.761193 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36f864-8918-4278-ab1d-1e97a72c54ed admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:13.802014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1034/2074] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:13 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:13.803279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36f864-8918-4278-ab1d-1e97a72c54ed admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:13.852792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c1f12-f34c-4b91-b371-48aa7a650476 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:13.894869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36f864-8918-4278-ab1d-1e97a72c54ed admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:13.908045 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338b356-7f35-46ca-a679-325eeadd37a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:13.908822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338b356-7f35-46ca-a679-325eeadd37a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:13.909111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338b356-7f35-46ca-a679-325eeadd37a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:13.909388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338b356-7f35-46ca-a679-325eeadd37a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:13.910039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338b356-7f35-46ca-a679-325eeadd37a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:13.912049 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338b356-7f35-46ca-a679-325eeadd37a8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:13.929509 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6ba84-64e8-4d3e-9520-865a64c863ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:13.930133 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6ba84-64e8-4d3e-9520-865a64c863ae admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:13.930421 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6ba84-64e8-4d3e-9520-865a64c863ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:13.930698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6ba84-64e8-4d3e-9520-865a64c863ae admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:13.931388 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6ba84-64e8-4d3e-9520-865a64c863ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:13.934560 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6ba84-64e8-4d3e-9520-865a64c863ae admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:13.949225 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1035/2075] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:13 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:13.953491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338b356-7f35-46ca-a679-325eeadd37a8 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:13.962543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1041/2076] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:13 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:13.963883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6ba84-64e8-4d3e-9520-865a64c863ae admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:13.968585 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338b356-7f35-46ca-a679-325eeadd37a8 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:13.975291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6ba84-64e8-4d3e-9520-865a64c863ae admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:13.980023 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c56b98-08a2-4e5a-a629-aea1f2661715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:13.980598 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30160b42-80d0-4082-adae-1810533383b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:13.981292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30160b42-80d0-4082-adae-1810533383b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:13.981404 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c56b98-08a2-4e5a-a629-aea1f2661715 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:13.981671 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30160b42-80d0-4082-adae-1810533383b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:13.982436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30160b42-80d0-4082-adae-1810533383b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:13.982871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c56b98-08a2-4e5a-a629-aea1f2661715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:13.983042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30160b42-80d0-4082-adae-1810533383b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:13.983801 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c56b98-08a2-4e5a-a629-aea1f2661715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:13.984654 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c56b98-08a2-4e5a-a629-aea1f2661715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:13.984917 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30160b42-80d0-4082-adae-1810533383b2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:13.987244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c56b98-08a2-4e5a-a629-aea1f2661715 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:13.997932 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1042/2077] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:14.002785 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1036/2078] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:14.004365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30160b42-80d0-4082-adae-1810533383b2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:14.006591 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c56b98-08a2-4e5a-a629-aea1f2661715 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:14.016345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30160b42-80d0-4082-adae-1810533383b2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:14.021488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c56b98-08a2-4e5a-a629-aea1f2661715 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:14.021641 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ba2bb-29d4-416a-8841-2be219393a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:14.022378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ba2bb-29d4-416a-8841-2be219393a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:14.022663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ba2bb-29d4-416a-8841-2be219393a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:14.023065 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ba2bb-29d4-416a-8841-2be219393a27 admin admin] PATH_INFO: `/v3/projects/f6049f64699f42278c4d399b8dafb9db/users/2ae36d2b32324fe68f116e8b048b5eae/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:14.026763 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7e7e2-fc76-4ebe-8a70-b269a07a6ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:14.027972 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7e7e2-fc76-4ebe-8a70-b269a07a6ded admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:14.027972 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7e7e2-fc76-4ebe-8a70-b269a07a6ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:14.027972 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7e7e2-fc76-4ebe-8a70-b269a07a6ded admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:14.028501 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7e7e2-fc76-4ebe-8a70-b269a07a6ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:14.030215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7e7e2-fc76-4ebe-8a70-b269a07a6ded admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:14.050140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ba2bb-29d4-416a-8841-2be219393a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6049f64699f42278c4d399b8dafb9db, user_id=2ae36d2b32324fe68f116e8b048b5eae, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:14.053552 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ba2bb-29d4-416a-8841-2be219393a27 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:14.058658 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1037/2079] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:14.060364 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7e7e2-fc76-4ebe-8a70-b269a07a6ded admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:14.071828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1043/2080] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:14 2022] PUT /identity/v3/projects/f6049f64699f42278c4d399b8dafb9db/users/2ae36d2b32324fe68f116e8b048b5eae/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:14.072630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7e7e2-fc76-4ebe-8a70-b269a07a6ded admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:14.076432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ba2bb-29d4-416a-8841-2be219393a27 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:14.163287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45447703-387b-4608-bacd-134cc6c875a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:14.164720 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45447703-387b-4608-bacd-134cc6c875a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:14.165215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45447703-387b-4608-bacd-134cc6c875a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:14.165689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45447703-387b-4608-bacd-134cc6c875a2 admin admin] PATH_INFO: `/v3/projects/e6d468d29c3b43b284873a3b9c78aaaa/users/dee6e4c4f6e04497bcb22da7f110b52f/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:14.190118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45447703-387b-4608-bacd-134cc6c875a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d468d29c3b43b284873a3b9c78aaaa, user_id=dee6e4c4f6e04497bcb22da7f110b52f, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:14.195034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45447703-387b-4608-bacd-134cc6c875a2 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:14.210225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:14.214324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ba2bb-29d4-416a-8841-2be219393a27 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:14.223130 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebea50-2878-4a4c-ab79-2c283543dec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:14.223976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebea50-2878-4a4c-ab79-2c283543dec3 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:14.225077 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebea50-2878-4a4c-ab79-2c283543dec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:14.225457 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebea50-2878-4a4c-ab79-2c283543dec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:14.226252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebea50-2878-4a4c-ab79-2c283543dec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:14.230015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebea50-2878-4a4c-ab79-2c283543dec3 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:14.248128 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1044/2081] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:14.252059 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebea50-2878-4a4c-ab79-2c283543dec3 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:14.257880 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1038/2082] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:14 2022] PUT /identity/v3/projects/e6d468d29c3b43b284873a3b9c78aaaa/users/dee6e4c4f6e04497bcb22da7f110b52f/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:14.268726 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de34a09-50d0-4d68-bbae-53c0066e72bf None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:14.268953 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de34a09-50d0-4d68-bbae-53c0066e72bf None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:14.271393 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de34a09-50d0-4d68-bbae-53c0066e72bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:14.278669 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebea50-2878-4a4c-ab79-2c283543dec3 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:14.349825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1de34a09-50d0-4d68-bbae-53c0066e72bf None None] MFA Rules not processed for user `dee6e4c4f6e04497bcb22da7f110b52f`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:14.353194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1de34a09-50d0-4d68-bbae-53c0066e72bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:14.373547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:14.437748 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b556b-4b99-4895-8a64-dcfeffc9388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:14.439561 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b556b-4b99-4895-8a64-dcfeffc9388d admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:14.439910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b556b-4b99-4895-8a64-dcfeffc9388d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:14.440954 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b556b-4b99-4895-8a64-dcfeffc9388d admin admin] PATH_INFO: `/v3/projects/f6049f64699f42278c4d399b8dafb9db/users/2ae36d2b32324fe68f116e8b048b5eae/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:14.451226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b556b-4b99-4895-8a64-dcfeffc9388d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6049f64699f42278c4d399b8dafb9db, user_id=2ae36d2b32324fe68f116e8b048b5eae, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:14.455150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b556b-4b99-4895-8a64-dcfeffc9388d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:14.471041 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1045/2083] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:14 2022] PUT /identity/v3/projects/f6049f64699f42278c4d399b8dafb9db/users/2ae36d2b32324fe68f116e8b048b5eae/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:14.482831 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4beb6f-537c-4068-80c9-02759092c528 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:14.483796 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4beb6f-537c-4068-80c9-02759092c528 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:14.485094 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4beb6f-537c-4068-80c9-02759092c528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:14.513773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1039/2084] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:14.528416 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de34a09-50d0-4d68-bbae-53c0066e72bf None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:14.529232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1de34a09-50d0-4d68-bbae-53c0066e72bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:14.549967 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ac4beb6f-537c-4068-80c9-02759092c528 None None] MFA Rules not processed for user `2ae36d2b32324fe68f116e8b048b5eae`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:14.551466 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ac4beb6f-537c-4068-80c9-02759092c528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:14.661237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de34a09-50d0-4d68-bbae-53c0066e72bf None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:14.696023 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1046/2085] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:14.731071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f9b87-80ba-41a7-ae36-da86985b75a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:14.731693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f9b87-80ba-41a7-ae36-da86985b75a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:14.732261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f9b87-80ba-41a7-ae36-da86985b75a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:14.732492 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f9b87-80ba-41a7-ae36-da86985b75a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:14.770515 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4beb6f-537c-4068-80c9-02759092c528 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:14.770515 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ac4beb6f-537c-4068-80c9-02759092c528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:14.780762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4beb6f-537c-4068-80c9-02759092c528 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:14.784752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd528a-9525-416f-9b9a-4e6c8d943271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:14.785609 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd528a-9525-416f-9b9a-4e6c8d943271 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:14.786024 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd528a-9525-416f-9b9a-4e6c8d943271 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:14.786401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd528a-9525-416f-9b9a-4e6c8d943271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:14.788287 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e9bd528a-9525-416f-9b9a-4e6c8d943271 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:14.792082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f9b87-80ba-41a7-ae36-da86985b75a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:14.793518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f9b87-80ba-41a7-ae36-da86985b75a8 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:14.802378 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1040/2086] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:21:14.822114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f9b87-80ba-41a7-ae36-da86985b75a8 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:14.849598 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:14.851247 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd528a-9525-416f-9b9a-4e6c8d943271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:14.852705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd528a-9525-416f-9b9a-4e6c8d943271 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:14.862979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1047/2087] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:21:14.887671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f9b87-80ba-41a7-ae36-da86985b75a8 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:14.892876 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fed12-1acc-4bd4-a050-8bbf7cbe1f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:14.893497 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fed12-1acc-4bd4-a050-8bbf7cbe1f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:14.893776 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fed12-1acc-4bd4-a050-8bbf7cbe1f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:14.894048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fed12-1acc-4bd4-a050-8bbf7cbe1f14 admin admin] PATH_INFO: `/v3/users/dee6e4c4f6e04497bcb22da7f110b52f` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:14.895210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fed12-1acc-4bd4-a050-8bbf7cbe1f14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dee6e4c4f6e04497bcb22da7f110b52f)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:14.897886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fed12-1acc-4bd4-a050-8bbf7cbe1f14 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:14.951047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-990fed12-1acc-4bd4-a050-8bbf7cbe1f14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dee6e4c4f6e04497bcb22da7f110b52f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:14.957990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-990fed12-1acc-4bd4-a050-8bbf7cbe1f14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dee6e4c4f6e04497bcb22da7f110b52f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:14.958697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-990fed12-1acc-4bd4-a050-8bbf7cbe1f14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dee6e4c4f6e04497bcb22da7f110b52f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:14.970646 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-990fed12-1acc-4bd4-a050-8bbf7cbe1f14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dee6e4c4f6e04497bcb22da7f110b52f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:14.978126 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-990fed12-1acc-4bd4-a050-8bbf7cbe1f14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dee6e4c4f6e04497bcb22da7f110b52f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:14.984554 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1041/2088] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:14 2022] DELETE /identity/v3/users/dee6e4c4f6e04497bcb22da7f110b52f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:14.989501 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cc69f-1346-438b-becd-beb637fcd8de None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:14.989869 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cc69f-1346-438b-becd-beb637fcd8de None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:14.990234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cc69f-1346-438b-becd-beb637fcd8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:15.013564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8e2cc69f-1346-438b-becd-beb637fcd8de None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:15.014914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8e2cc69f-1346-438b-becd-beb637fcd8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:15.019341 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:15.086494 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1048/2089] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:15.113717 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fed12-1acc-4bd4-a050-8bbf7cbe1f14 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:15.116419 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-990fed12-1acc-4bd4-a050-8bbf7cbe1f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:15.201397 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fed12-1acc-4bd4-a050-8bbf7cbe1f14 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:15.207518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780480e-c99e-4fb2-a35b-2a5e3a9e00e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:15.208771 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780480e-c99e-4fb2-a35b-2a5e3a9e00e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:15.223532 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780480e-c99e-4fb2-a35b-2a5e3a9e00e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:15.223532 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780480e-c99e-4fb2-a35b-2a5e3a9e00e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:15.235141 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780480e-c99e-4fb2-a35b-2a5e3a9e00e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:15.237213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780480e-c99e-4fb2-a35b-2a5e3a9e00e0 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:15.248371 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1042/2090] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:16.158537 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cc69f-1346-438b-becd-beb637fcd8de None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:16.160597 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8e2cc69f-1346-438b-becd-beb637fcd8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:16.173391 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cc69f-1346-438b-becd-beb637fcd8de None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:16.178733 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fac04-38ff-455b-9899-6b9af00dc310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:16.179428 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fac04-38ff-455b-9899-6b9af00dc310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:16.179733 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fac04-38ff-455b-9899-6b9af00dc310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:16.180049 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fac04-38ff-455b-9899-6b9af00dc310 admin admin] PATH_INFO: `/v3/projects/e6d468d29c3b43b284873a3b9c78aaaa` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:16.181240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fac04-38ff-455b-9899-6b9af00dc310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6d468d29c3b43b284873a3b9c78aaaa)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:16.183315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fac04-38ff-455b-9899-6b9af00dc310 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:16.255112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-786fac04-38ff-455b-9899-6b9af00dc310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6d468d29c3b43b284873a3b9c78aaaa', 'request_id': 'req-786fac04-38ff-455b-9899-6b9af00dc310'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:16.262134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-786fac04-38ff-455b-9899-6b9af00dc310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6d468d29c3b43b284873a3b9c78aaaa', 'request_id': 'req-786fac04-38ff-455b-9899-6b9af00dc310'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:16.272527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-786fac04-38ff-455b-9899-6b9af00dc310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6d468d29c3b43b284873a3b9c78aaaa', 'request_id': 'req-786fac04-38ff-455b-9899-6b9af00dc310'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:16.284140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-786fac04-38ff-455b-9899-6b9af00dc310 admin admin] The token cache is being invalidate because project e6d468d29c3b43b284873a3b9c78aaaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:16.284509 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-786fac04-38ff-455b-9899-6b9af00dc310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:16.285220 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-786fac04-38ff-455b-9899-6b9af00dc310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:16.290200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1049/2091] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:16 2022] DELETE /identity/v3/projects/e6d468d29c3b43b284873a3b9c78aaaa => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:16.291992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a444fa7-891c-4b4d-bebd-5de84a26c730 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:16.292453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a444fa7-891c-4b4d-bebd-5de84a26c730 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:16.292552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a444fa7-891c-4b4d-bebd-5de84a26c730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:16.315007 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-3a444fa7-891c-4b4d-bebd-5de84a26c730 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:16.316380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3a444fa7-891c-4b4d-bebd-5de84a26c730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:16.384530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:16.436557 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1043/2092] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:16.445649 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ec76d-387c-479b-92e3-68053c833a0c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:16.446563 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ec76d-387c-479b-92e3-68053c833a0c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:16.446563 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ec76d-387c-479b-92e3-68053c833a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:16.496087 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-420ec76d-387c-479b-92e3-68053c833a0c None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:16.497794 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-420ec76d-387c-479b-92e3-68053c833a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:16.510751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1050/2093] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:16.513928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a444fa7-891c-4b4d-bebd-5de84a26c730 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:16.526862 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a444fa7-891c-4b4d-bebd-5de84a26c730 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:16.532506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632a4e4-1d24-487a-a00c-59686c3b9988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:16.533375 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632a4e4-1d24-487a-a00c-59686c3b9988 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:16.533741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632a4e4-1d24-487a-a00c-59686c3b9988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:16.534096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632a4e4-1d24-487a-a00c-59686c3b9988 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:16.535060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632a4e4-1d24-487a-a00c-59686c3b9988 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:21:16.535461 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632a4e4-1d24-487a-a00c-59686c3b9988 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:16.537671 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632a4e4-1d24-487a-a00c-59686c3b9988 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:16.567994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1044/2094] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:21:16.572635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ec76d-387c-479b-92e3-68053c833a0c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:16.580495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632a4e4-1d24-487a-a00c-59686c3b9988 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:16.582323 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d632a4e4-1d24-487a-a00c-59686c3b9988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:16.585738 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ec76d-387c-479b-92e3-68053c833a0c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:16.591784 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146b452-c0ed-498c-9544-cac80edc6b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:16.594379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146b452-c0ed-498c-9544-cac80edc6b75 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:16.594772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146b452-c0ed-498c-9544-cac80edc6b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:16.595183 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146b452-c0ed-498c-9544-cac80edc6b75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:16.596636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146b452-c0ed-498c-9544-cac80edc6b75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:16.599842 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146b452-c0ed-498c-9544-cac80edc6b75 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:16.636124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1051/2095] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:16 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:16.640191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146b452-c0ed-498c-9544-cac80edc6b75 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:16.659432 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632a4e4-1d24-487a-a00c-59686c3b9988 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:16.713399 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146b452-c0ed-498c-9544-cac80edc6b75 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:16.719337 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd05025-86be-4c27-8e8b-cea2b3269813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:16.720251 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd05025-86be-4c27-8e8b-cea2b3269813 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:16.720522 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd05025-86be-4c27-8e8b-cea2b3269813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:16.720810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd05025-86be-4c27-8e8b-cea2b3269813 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:16.721595 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd05025-86be-4c27-8e8b-cea2b3269813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:16.722170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6895967-5a6d-42ea-87b9-5e124d7d022c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:16.722909 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6895967-5a6d-42ea-87b9-5e124d7d022c service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:16.723198 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6895967-5a6d-42ea-87b9-5e124d7d022c service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:16.723627 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd05025-86be-4c27-8e8b-cea2b3269813 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:16.724397 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6895967-5a6d-42ea-87b9-5e124d7d022c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:16.726630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a6895967-5a6d-42ea-87b9-5e124d7d022c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:16.734972 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:16.754777 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1052/2096] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:16 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:16.755899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd05025-86be-4c27-8e8b-cea2b3269813 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:16.765917 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd05025-86be-4c27-8e8b-cea2b3269813 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:16.770570 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f34fec-a786-435c-9656-ed09094efe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:16.771191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f34fec-a786-435c-9656-ed09094efe46 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:16.771469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f34fec-a786-435c-9656-ed09094efe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:16.771740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f34fec-a786-435c-9656-ed09094efe46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:16.772374 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f34fec-a786-435c-9656-ed09094efe46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:16.773954 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f34fec-a786-435c-9656-ed09094efe46 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:16.783601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1053/2097] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:16.787344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f34fec-a786-435c-9656-ed09094efe46 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:16.789161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6895967-5a6d-42ea-87b9-5e124d7d022c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:16.790686 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6895967-5a6d-42ea-87b9-5e124d7d022c service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:16.797135 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f34fec-a786-435c-9656-ed09094efe46 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:16.800361 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1045/2098] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:21:16.802268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d858a-7ab9-441e-8429-d8454b67dfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:16.802872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d858a-7ab9-441e-8429-d8454b67dfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:16.803152 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d858a-7ab9-441e-8429-d8454b67dfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:16.803420 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d858a-7ab9-441e-8429-d8454b67dfe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:16.804049 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d858a-7ab9-441e-8429-d8454b67dfe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:16.805602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d858a-7ab9-441e-8429-d8454b67dfe4 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:16.816815 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1054/2099] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:16.820974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6895967-5a6d-42ea-87b9-5e124d7d022c service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:16.837491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6895967-5a6d-42ea-87b9-5e124d7d022c service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:16.843346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60bf36-f44b-4c70-b46a-316ac04e8e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:16.845410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60bf36-f44b-4c70-b46a-316ac04e8e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:16.845867 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60bf36-f44b-4c70-b46a-316ac04e8e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:16.846170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60bf36-f44b-4c70-b46a-316ac04e8e14 admin admin] PATH_INFO: `/v3/projects/c9d8080731d14bae93040f25170364cc/users/f8d95e1ddc2e49f88e893cc9b9f89cb9/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:16.865801 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60bf36-f44b-4c70-b46a-316ac04e8e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d8080731d14bae93040f25170364cc, user_id=f8d95e1ddc2e49f88e893cc9b9f89cb9, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:16.868570 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60bf36-f44b-4c70-b46a-316ac04e8e14 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:16.884630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1046/2100] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:16 2022] PUT /identity/v3/projects/c9d8080731d14bae93040f25170364cc/users/f8d95e1ddc2e49f88e893cc9b9f89cb9/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:16.889995 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef5b50-0462-49e3-aa43-36045beb720c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:16.890286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef5b50-0462-49e3-aa43-36045beb720c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:16.890566 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef5b50-0462-49e3-aa43-36045beb720c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:16.916034 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c0ef5b50-0462-49e3-aa43-36045beb720c None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:16.917968 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c0ef5b50-0462-49e3-aa43-36045beb720c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:16.986757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1055/2101] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:16.996354 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60bf36-f44b-4c70-b46a-316ac04e8e14 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:16.998151 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1b60bf36-f44b-4c70-b46a-316ac04e8e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:17.025411 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:17.078393 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60bf36-f44b-4c70-b46a-316ac04e8e14 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:17.082852 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59343d1-e64f-407d-81fe-ee3e838a26ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:17.083661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59343d1-e64f-407d-81fe-ee3e838a26ca service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:17.084901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59343d1-e64f-407d-81fe-ee3e838a26ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:17.085373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59343d1-e64f-407d-81fe-ee3e838a26ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:17.097073 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59343d1-e64f-407d-81fe-ee3e838a26ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:17.098678 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59343d1-e64f-407d-81fe-ee3e838a26ca service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:17.110477 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1047/2102] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:17.534862 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef5b50-0462-49e3-aa43-36045beb720c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:17.608202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef5b50-0462-49e3-aa43-36045beb720c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:17.612162 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31f808-21e1-48ef-8efe-e707e80f5836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:17.612845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31f808-21e1-48ef-8efe-e707e80f5836 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:17.613196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31f808-21e1-48ef-8efe-e707e80f5836 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:17.613958 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31f808-21e1-48ef-8efe-e707e80f5836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:17.615597 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bb31f808-21e1-48ef-8efe-e707e80f5836 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:17.703696 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31f808-21e1-48ef-8efe-e707e80f5836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:17.706661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31f808-21e1-48ef-8efe-e707e80f5836 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:17.717558 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1056/2103] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:21:17.943923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ceeaa-37c1-4ac3-a276-b32bb40330c4 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:17.944436 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ceeaa-37c1-4ac3-a276-b32bb40330c4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:17.944539 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ceeaa-37c1-4ac3-a276-b32bb40330c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:17.975503 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-fd7ceeaa-37c1-4ac3-a276-b32bb40330c4 None None] MFA Rules not processed for user `f8d95e1ddc2e49f88e893cc9b9f89cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:17.977023 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fd7ceeaa-37c1-4ac3-a276-b32bb40330c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:18.062753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1048/2104] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:18.074903 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31f808-21e1-48ef-8efe-e707e80f5836 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:18.077365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bb31f808-21e1-48ef-8efe-e707e80f5836 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:18.089172 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31f808-21e1-48ef-8efe-e707e80f5836 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:18.093323 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f765a8-513b-43bd-b836-c31767d0841a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:18.094282 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f765a8-513b-43bd-b836-c31767d0841a service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:18.094282 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f765a8-513b-43bd-b836-c31767d0841a service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:18.094500 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f765a8-513b-43bd-b836-c31767d0841a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:18.103245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f765a8-513b-43bd-b836-c31767d0841a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:18.104689 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f765a8-513b-43bd-b836-c31767d0841a service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:18.115572 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1057/2105] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:21:19.481511 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f96ac-c944-4529-9820-2a9e8da5b696 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:19.482284 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f96ac-c944-4529-9820-2a9e8da5b696 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:19.482437 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f96ac-c944-4529-9820-2a9e8da5b696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:19.504604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-0f0f96ac-c944-4529-9820-2a9e8da5b696 None None] MFA Rules not processed for user `f8d95e1ddc2e49f88e893cc9b9f89cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:19.505724 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0f0f96ac-c944-4529-9820-2a9e8da5b696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:19.512514 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1049/2106] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:20.521620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f765a8-513b-43bd-b836-c31767d0841a service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:20.524745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d8f765a8-513b-43bd-b836-c31767d0841a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:20.549654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f765a8-513b-43bd-b836-c31767d0841a service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:20.558001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b33ce8-f781-41ea-82cb-158a23e0df38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:20.558610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b33ce8-f781-41ea-82cb-158a23e0df38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:20.558915 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b33ce8-f781-41ea-82cb-158a23e0df38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:20.559422 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b33ce8-f781-41ea-82cb-158a23e0df38 admin admin] PATH_INFO: `/v3/users/62d93ee7c67c4d958cc883729b31db2f` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:20.567055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b33ce8-f781-41ea-82cb-158a23e0df38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62d93ee7c67c4d958cc883729b31db2f)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:20.570873 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b33ce8-f781-41ea-82cb-158a23e0df38 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:20.574630 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:20.670844 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b7b33ce8-f781-41ea-82cb-158a23e0df38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d93ee7c67c4d958cc883729b31db2f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:20.682242 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b7b33ce8-f781-41ea-82cb-158a23e0df38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d93ee7c67c4d958cc883729b31db2f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:20.702604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b7b33ce8-f781-41ea-82cb-158a23e0df38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d93ee7c67c4d958cc883729b31db2f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:20.703531 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b7b33ce8-f781-41ea-82cb-158a23e0df38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d93ee7c67c4d958cc883729b31db2f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:20.721165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b7b33ce8-f781-41ea-82cb-158a23e0df38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d93ee7c67c4d958cc883729b31db2f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:20.730737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1058/2107] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:20 2022] DELETE /identity/v3/users/62d93ee7c67c4d958cc883729b31db2f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:20.735909 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77cf8c-49e4-4542-bc9b-8341f0a39555 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:20.736392 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77cf8c-49e4-4542-bc9b-8341f0a39555 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:20.736392 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77cf8c-49e4-4542-bc9b-8341f0a39555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:20.786651 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5f77cf8c-49e4-4542-bc9b-8341f0a39555 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:20.788381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5f77cf8c-49e4-4542-bc9b-8341f0a39555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:20.903406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1050/2108] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:20.917159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b33ce8-f781-41ea-82cb-158a23e0df38 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:20.920731 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b7b33ce8-f781-41ea-82cb-158a23e0df38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:21.020051 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b33ce8-f781-41ea-82cb-158a23e0df38 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:21.023930 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18d033-c13b-467a-9c6b-4e500cc7f07a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:21.024548 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18d033-c13b-467a-9c6b-4e500cc7f07a service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:21.024828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18d033-c13b-467a-9c6b-4e500cc7f07a service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:21.025130 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18d033-c13b-467a-9c6b-4e500cc7f07a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:21.036146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18d033-c13b-467a-9c6b-4e500cc7f07a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:21.037557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18d033-c13b-467a-9c6b-4e500cc7f07a service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:21.050532 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1059/2109] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:21.600555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77cf8c-49e4-4542-bc9b-8341f0a39555 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:21.602067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5f77cf8c-49e4-4542-bc9b-8341f0a39555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:21.615127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77cf8c-49e4-4542-bc9b-8341f0a39555 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:21.621339 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d0eba-d333-4eb8-9955-7bfbbe9ce3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:21.622181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d0eba-d333-4eb8-9955-7bfbbe9ce3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:21.622574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d0eba-d333-4eb8-9955-7bfbbe9ce3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:21.624318 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d0eba-d333-4eb8-9955-7bfbbe9ce3c2 admin admin] PATH_INFO: `/v3/projects/cf05c9ad12de4c00acd68b67dec1d59f` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:21.624318 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d0eba-d333-4eb8-9955-7bfbbe9ce3c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf05c9ad12de4c00acd68b67dec1d59f)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:21.626415 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d0eba-d333-4eb8-9955-7bfbbe9ce3c2 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:21.684567 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:21.691316 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3d0d0eba-d333-4eb8-9955-7bfbbe9ce3c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf05c9ad12de4c00acd68b67dec1d59f', 'request_id': 'req-3d0d0eba-d333-4eb8-9955-7bfbbe9ce3c2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:21.698460 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3d0d0eba-d333-4eb8-9955-7bfbbe9ce3c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf05c9ad12de4c00acd68b67dec1d59f', 'request_id': 'req-3d0d0eba-d333-4eb8-9955-7bfbbe9ce3c2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:21.705857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3d0d0eba-d333-4eb8-9955-7bfbbe9ce3c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf05c9ad12de4c00acd68b67dec1d59f', 'request_id': 'req-3d0d0eba-d333-4eb8-9955-7bfbbe9ce3c2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:21.725354 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3d0d0eba-d333-4eb8-9955-7bfbbe9ce3c2 admin admin] The token cache is being invalidate because project cf05c9ad12de4c00acd68b67dec1d59f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:21.726106 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3d0d0eba-d333-4eb8-9955-7bfbbe9ce3c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:21.726976 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3d0d0eba-d333-4eb8-9955-7bfbbe9ce3c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:21.729741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1051/2110] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:21 2022] DELETE /identity/v3/projects/cf05c9ad12de4c00acd68b67dec1d59f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:21.734176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18d033-c13b-467a-9c6b-4e500cc7f07a service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:21.745805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18d033-c13b-467a-9c6b-4e500cc7f07a service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:21.810655 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f052cef-4b91-4946-88dd-938b2803aa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:21.811414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f052cef-4b91-4946-88dd-938b2803aa08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:21.811764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f052cef-4b91-4946-88dd-938b2803aa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:21.812045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f052cef-4b91-4946-88dd-938b2803aa08 admin admin] PATH_INFO: `/v3/users/94ff6448cd914642a1fe67d38ec6a42d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:21.813389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f052cef-4b91-4946-88dd-938b2803aa08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ff6448cd914642a1fe67d38ec6a42d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:21.815491 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f052cef-4b91-4946-88dd-938b2803aa08 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:21.859415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:21.901477 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2f052cef-4b91-4946-88dd-938b2803aa08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ff6448cd914642a1fe67d38ec6a42d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:21.910580 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2f052cef-4b91-4946-88dd-938b2803aa08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ff6448cd914642a1fe67d38ec6a42d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:21.928325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d0eba-d333-4eb8-9955-7bfbbe9ce3c2 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:21.930571 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3d0d0eba-d333-4eb8-9955-7bfbbe9ce3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:21.934683 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2f052cef-4b91-4946-88dd-938b2803aa08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ff6448cd914642a1fe67d38ec6a42d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:21.936025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2f052cef-4b91-4946-88dd-938b2803aa08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ff6448cd914642a1fe67d38ec6a42d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:21.945886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2f052cef-4b91-4946-88dd-938b2803aa08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ff6448cd914642a1fe67d38ec6a42d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:21.949874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d0eba-d333-4eb8-9955-7bfbbe9ce3c2 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:21.953755 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1060/2111] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:21 2022] DELETE /identity/v3/users/94ff6448cd914642a1fe67d38ec6a42d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:21.955898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42fd47-2e7d-4783-bc7c-585c32381be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:21.956656 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42fd47-2e7d-4783-bc7c-585c32381be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:21.957285 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42fd47-2e7d-4783-bc7c-585c32381be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:21.958569 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42fd47-2e7d-4783-bc7c-585c32381be5 admin admin] PATH_INFO: `/v3/users/547814df41ac488ca7b0e9064d92fffc` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:21.960101 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42fd47-2e7d-4783-bc7c-585c32381be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=547814df41ac488ca7b0e9064d92fffc)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:21.962749 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42fd47-2e7d-4783-bc7c-585c32381be5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:22.025090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5a42fd47-2e7d-4783-bc7c-585c32381be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547814df41ac488ca7b0e9064d92fffc'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:22.042620 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5a42fd47-2e7d-4783-bc7c-585c32381be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547814df41ac488ca7b0e9064d92fffc'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:22.044085 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5a42fd47-2e7d-4783-bc7c-585c32381be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547814df41ac488ca7b0e9064d92fffc'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:22.062533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5a42fd47-2e7d-4783-bc7c-585c32381be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547814df41ac488ca7b0e9064d92fffc'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:22.072828 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5a42fd47-2e7d-4783-bc7c-585c32381be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547814df41ac488ca7b0e9064d92fffc'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:22.080924 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1052/2112] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:21 2022] DELETE /identity/v3/users/547814df41ac488ca7b0e9064d92fffc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:22.085470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c388522-7f47-4723-b053-bd64c330ea6b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:22.085757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c388522-7f47-4723-b053-bd64c330ea6b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:22.086035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c388522-7f47-4723-b053-bd64c330ea6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:22.118359 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-9c388522-7f47-4723-b053-bd64c330ea6b None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:22.120822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9c388522-7f47-4723-b053-bd64c330ea6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:22.217042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1061/2113] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:22.229777 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42fd47-2e7d-4783-bc7c-585c32381be5 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:22.231432 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5a42fd47-2e7d-4783-bc7c-585c32381be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:22.305286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c388522-7f47-4723-b053-bd64c330ea6b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:22.307205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9c388522-7f47-4723-b053-bd64c330ea6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:22.323001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42fd47-2e7d-4783-bc7c-585c32381be5 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:22.328660 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dc36f-4b11-4ddf-b6db-b45c7532e946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:22.329828 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dc36f-4b11-4ddf-b6db-b45c7532e946 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:22.329828 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dc36f-4b11-4ddf-b6db-b45c7532e946 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:22.329978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dc36f-4b11-4ddf-b6db-b45c7532e946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:22.348805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c388522-7f47-4723-b053-bd64c330ea6b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:22.358784 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145dc36f-4b11-4ddf-b6db-b45c7532e946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:22.361884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145dc36f-4b11-4ddf-b6db-b45c7532e946 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:22.363751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf525f-2694-40dd-82d7-cb28f5f3cc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:22.364334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf525f-2694-40dd-82d7-cb28f5f3cc4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:22.364621 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf525f-2694-40dd-82d7-cb28f5f3cc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:22.364899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf525f-2694-40dd-82d7-cb28f5f3cc4c admin admin] PATH_INFO: `/v3/projects/1e6976f6ba8949faad18bc54da20887b` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:22.366913 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf525f-2694-40dd-82d7-cb28f5f3cc4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e6976f6ba8949faad18bc54da20887b)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:22.369370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf525f-2694-40dd-82d7-cb28f5f3cc4c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:22.388103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1053/2114] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:22.497949 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f0bf525f-2694-40dd-82d7-cb28f5f3cc4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e6976f6ba8949faad18bc54da20887b', 'request_id': 'req-f0bf525f-2694-40dd-82d7-cb28f5f3cc4c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:22.505835 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f0bf525f-2694-40dd-82d7-cb28f5f3cc4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e6976f6ba8949faad18bc54da20887b', 'request_id': 'req-f0bf525f-2694-40dd-82d7-cb28f5f3cc4c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:22.515220 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f0bf525f-2694-40dd-82d7-cb28f5f3cc4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e6976f6ba8949faad18bc54da20887b', 'request_id': 'req-f0bf525f-2694-40dd-82d7-cb28f5f3cc4c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:22.535219 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f0bf525f-2694-40dd-82d7-cb28f5f3cc4c admin admin] The token cache is being invalidate because project 1e6976f6ba8949faad18bc54da20887b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:22.535219 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f0bf525f-2694-40dd-82d7-cb28f5f3cc4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:22.535695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f0bf525f-2694-40dd-82d7-cb28f5f3cc4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:22.543482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1062/2115] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:22 2022] DELETE /identity/v3/projects/1e6976f6ba8949faad18bc54da20887b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:22.545218 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11816424-194f-49db-8140-f933ca4b5808 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:22.545506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11816424-194f-49db-8140-f933ca4b5808 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:22.545784 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11816424-194f-49db-8140-f933ca4b5808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:22.570896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-11816424-194f-49db-8140-f933ca4b5808 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:22.572403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-11816424-194f-49db-8140-f933ca4b5808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:22.632708 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:22.698498 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1054/2116] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:22.720739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd60369-b17e-4196-b16b-95aa95b54f70 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:22.721050 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd60369-b17e-4196-b16b-95aa95b54f70 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:22.721412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd60369-b17e-4196-b16b-95aa95b54f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:22.763283 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-2dd60369-b17e-4196-b16b-95aa95b54f70 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:22.764518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2dd60369-b17e-4196-b16b-95aa95b54f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:22.785375 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1063/2117] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:22.791227 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11816424-194f-49db-8140-f933ca4b5808 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:22.802491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11816424-194f-49db-8140-f933ca4b5808 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:22.807836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675a030-8235-4835-8e70-88827aec0f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:22.808537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675a030-8235-4835-8e70-88827aec0f24 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:22.808825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675a030-8235-4835-8e70-88827aec0f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:22.809102 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675a030-8235-4835-8e70-88827aec0f24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:22.809788 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675a030-8235-4835-8e70-88827aec0f24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:21:22.810142 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675a030-8235-4835-8e70-88827aec0f24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:22.812025 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675a030-8235-4835-8e70-88827aec0f24 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:22.826535 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd60369-b17e-4196-b16b-95aa95b54f70 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:22.828170 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2dd60369-b17e-4196-b16b-95aa95b54f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:22.842280 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd60369-b17e-4196-b16b-95aa95b54f70 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:22.845477 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1055/2118] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:21:22.850600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235da70-9234-4947-8a63-78b485fcdb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:22.851110 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675a030-8235-4835-8e70-88827aec0f24 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:22.851320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235da70-9234-4947-8a63-78b485fcdb6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:22.851757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235da70-9234-4947-8a63-78b485fcdb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:22.852033 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235da70-9234-4947-8a63-78b485fcdb6a admin admin] PATH_INFO: `/v3/projects/a7ebd77ff8744f84b8783cba9a26c1b7` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:22.853479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235da70-9234-4947-8a63-78b485fcdb6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ebd77ff8744f84b8783cba9a26c1b7)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:22.856367 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235da70-9234-4947-8a63-78b485fcdb6a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:22.873199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675a030-8235-4835-8e70-88827aec0f24 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:22.881105 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:22.886102 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66128b4f-6267-4f89-8baf-50418e8836b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:22.886962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66128b4f-6267-4f89-8baf-50418e8836b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:22.887098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66128b4f-6267-4f89-8baf-50418e8836b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:22.887374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66128b4f-6267-4f89-8baf-50418e8836b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:22.888053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66128b4f-6267-4f89-8baf-50418e8836b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:22.890067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66128b4f-6267-4f89-8baf-50418e8836b7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:22.941885 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1056/2119] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:22 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:22.946585 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66128b4f-6267-4f89-8baf-50418e8836b7 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:22.951404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6235da70-9234-4947-8a63-78b485fcdb6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ebd77ff8744f84b8783cba9a26c1b7', 'request_id': 'req-6235da70-9234-4947-8a63-78b485fcdb6a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:22.963455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6235da70-9234-4947-8a63-78b485fcdb6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ebd77ff8744f84b8783cba9a26c1b7', 'request_id': 'req-6235da70-9234-4947-8a63-78b485fcdb6a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:22.976488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6235da70-9234-4947-8a63-78b485fcdb6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ebd77ff8744f84b8783cba9a26c1b7', 'request_id': 'req-6235da70-9234-4947-8a63-78b485fcdb6a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:22.996848 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6235da70-9234-4947-8a63-78b485fcdb6a admin admin] The token cache is being invalidate because project a7ebd77ff8744f84b8783cba9a26c1b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:22.997155 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6235da70-9234-4947-8a63-78b485fcdb6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:22.998040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6235da70-9234-4947-8a63-78b485fcdb6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:23.000273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1064/2120] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:22 2022] DELETE /identity/v3/projects/a7ebd77ff8744f84b8783cba9a26c1b7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:23.005498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235da70-9234-4947-8a63-78b485fcdb6a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:23.007206 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6235da70-9234-4947-8a63-78b485fcdb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:23.047745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66128b4f-6267-4f89-8baf-50418e8836b7 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:23.053906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff317c5f-eecd-46e0-aca1-85e2af5f5d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:23.054899 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff317c5f-eecd-46e0-aca1-85e2af5f5d0d admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:23.055370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff317c5f-eecd-46e0-aca1-85e2af5f5d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:23.055829 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff317c5f-eecd-46e0-aca1-85e2af5f5d0d admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:23.056723 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff317c5f-eecd-46e0-aca1-85e2af5f5d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:23.058892 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff317c5f-eecd-46e0-aca1-85e2af5f5d0d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:23.085299 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1057/2121] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:22 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:23.086817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235da70-9234-4947-8a63-78b485fcdb6a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:23.089359 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff317c5f-eecd-46e0-aca1-85e2af5f5d0d admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:23.091688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ff317c5f-eecd-46e0-aca1-85e2af5f5d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:23.094590 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61cc43-2d76-42cb-a8a6-29e86c29ae2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:23.096800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61cc43-2d76-42cb-a8a6-29e86c29ae2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:23.096800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61cc43-2d76-42cb-a8a6-29e86c29ae2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:23.096800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61cc43-2d76-42cb-a8a6-29e86c29ae2c admin admin] PATH_INFO: `/v3/users/a6e6607e25b940898d6243111baf7302` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:23.097776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61cc43-2d76-42cb-a8a6-29e86c29ae2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e6607e25b940898d6243111baf7302)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:23.099863 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61cc43-2d76-42cb-a8a6-29e86c29ae2c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:23.108513 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff317c5f-eecd-46e0-aca1-85e2af5f5d0d admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:23.115843 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a424c85-8359-4fd0-9edb-397fdd1789be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:23.116389 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a424c85-8359-4fd0-9edb-397fdd1789be admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:23.116750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a424c85-8359-4fd0-9edb-397fdd1789be admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:23.117098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a424c85-8359-4fd0-9edb-397fdd1789be admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:23.118027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a424c85-8359-4fd0-9edb-397fdd1789be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:23.121478 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a424c85-8359-4fd0-9edb-397fdd1789be admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:23.137444 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1058/2122] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:23.141437 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a424c85-8359-4fd0-9edb-397fdd1789be admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:23.152765 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a424c85-8359-4fd0-9edb-397fdd1789be admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:23.160254 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899f2cc-ae91-43bf-a94d-84b5f9c95cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:23.161552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899f2cc-ae91-43bf-a94d-84b5f9c95cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:23.162467 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899f2cc-ae91-43bf-a94d-84b5f9c95cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:23.162884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899f2cc-ae91-43bf-a94d-84b5f9c95cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:23.164192 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899f2cc-ae91-43bf-a94d-84b5f9c95cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:23.165422 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ce61cc43-2d76-42cb-a8a6-29e86c29ae2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e6607e25b940898d6243111baf7302'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:23.165848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899f2cc-ae91-43bf-a94d-84b5f9c95cd9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:23.178957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1059/2123] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:23.179336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ce61cc43-2d76-42cb-a8a6-29e86c29ae2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e6607e25b940898d6243111baf7302'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:23.183638 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899f2cc-ae91-43bf-a94d-84b5f9c95cd9 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:23.195347 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899f2cc-ae91-43bf-a94d-84b5f9c95cd9 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:23.197982 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ce61cc43-2d76-42cb-a8a6-29e86c29ae2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e6607e25b940898d6243111baf7302'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:23.199105 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ce61cc43-2d76-42cb-a8a6-29e86c29ae2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e6607e25b940898d6243111baf7302'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:23.200487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62593bd2-cd86-4cf3-8f34-6d1d424c145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:23.201208 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62593bd2-cd86-4cf3-8f34-6d1d424c145b admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:23.201565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62593bd2-cd86-4cf3-8f34-6d1d424c145b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:23.202012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62593bd2-cd86-4cf3-8f34-6d1d424c145b admin admin] PATH_INFO: `/v3/projects/3a04934e28454091bea6b1933eb01d5e/users/12d1cff1fb214cf88b352c3be3153afa/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:23.209783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ce61cc43-2d76-42cb-a8a6-29e86c29ae2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e6607e25b940898d6243111baf7302'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:23.219305 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1065/2124] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:23 2022] DELETE /identity/v3/users/a6e6607e25b940898d6243111baf7302 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:23.223003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62593bd2-cd86-4cf3-8f34-6d1d424c145b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a04934e28454091bea6b1933eb01d5e, user_id=12d1cff1fb214cf88b352c3be3153afa, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:23.224084 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62593bd2-cd86-4cf3-8f34-6d1d424c145b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:23.240457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1060/2125] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:23 2022] PUT /identity/v3/projects/3a04934e28454091bea6b1933eb01d5e/users/12d1cff1fb214cf88b352c3be3153afa/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:23.260429 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095bdf4-cc97-40d4-b4d9-930887a48766 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:23.260806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095bdf4-cc97-40d4-b4d9-930887a48766 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:23.261345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095bdf4-cc97-40d4-b4d9-930887a48766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:23.297911 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e095bdf4-cc97-40d4-b4d9-930887a48766 None None] MFA Rules not processed for user `12d1cff1fb214cf88b352c3be3153afa`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:23.299526 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e095bdf4-cc97-40d4-b4d9-930887a48766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:23.312194 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:23.396163 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1066/2126] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:23.412270 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62593bd2-cd86-4cf3-8f34-6d1d424c145b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:23.416834 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-62593bd2-cd86-4cf3-8f34-6d1d424c145b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:23.485783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:23.504357 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62593bd2-cd86-4cf3-8f34-6d1d424c145b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:23.511032 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677d9ab-4e91-4158-9531-28a4162cadeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:23.512037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677d9ab-4e91-4158-9531-28a4162cadeb admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:23.512788 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677d9ab-4e91-4158-9531-28a4162cadeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:23.513221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677d9ab-4e91-4158-9531-28a4162cadeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:23.514296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677d9ab-4e91-4158-9531-28a4162cadeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:23.519021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677d9ab-4e91-4158-9531-28a4162cadeb admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:23.564519 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1061/2127] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:23 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:23.568925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095bdf4-cc97-40d4-b4d9-930887a48766 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:23.584026 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095bdf4-cc97-40d4-b4d9-930887a48766 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:23.714664 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beeb7b-bfe3-444b-8819-8f78d39958a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:23.715330 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beeb7b-bfe3-444b-8819-8f78d39958a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:23.715617 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beeb7b-bfe3-444b-8819-8f78d39958a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:23.715902 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beeb7b-bfe3-444b-8819-8f78d39958a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:23.717192 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3beeb7b-bfe3-444b-8819-8f78d39958a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:23.720440 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3beeb7b-bfe3-444b-8819-8f78d39958a3 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:23.749628 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677d9ab-4e91-4158-9531-28a4162cadeb admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:23.752402 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c677d9ab-4e91-4158-9531-28a4162cadeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:23.765762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1067/2128] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:23 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:23.769900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beeb7b-bfe3-444b-8819-8f78d39958a3 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:23.779603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677d9ab-4e91-4158-9531-28a4162cadeb admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:23.794878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b7b86-61a8-42a1-886c-7feb93dbe521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:23.795640 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beeb7b-bfe3-444b-8819-8f78d39958a3 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:23.795780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b7b86-61a8-42a1-886c-7feb93dbe521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:23.795944 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b7b86-61a8-42a1-886c-7feb93dbe521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:23.796553 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b7b86-61a8-42a1-886c-7feb93dbe521 admin admin] PATH_INFO: `/v3/projects/449720bdc99649329a5e6b59bacb92ea` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:23.800160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b7b86-61a8-42a1-886c-7feb93dbe521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=449720bdc99649329a5e6b59bacb92ea)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:23.803689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b7b86-61a8-42a1-886c-7feb93dbe521 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:23.811698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed233ab5-9add-46f6-8b77-dd2abc4db7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:23.812323 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed233ab5-9add-46f6-8b77-dd2abc4db7bf admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:23.812631 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed233ab5-9add-46f6-8b77-dd2abc4db7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:23.812911 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed233ab5-9add-46f6-8b77-dd2abc4db7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:23.813615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed233ab5-9add-46f6-8b77-dd2abc4db7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:23.815253 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed233ab5-9add-46f6-8b77-dd2abc4db7bf admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:23.826094 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1068/2129] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:23.831666 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed233ab5-9add-46f6-8b77-dd2abc4db7bf admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:23.854259 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed233ab5-9add-46f6-8b77-dd2abc4db7bf admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:23.863939 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39248004-0f73-4ccf-9829-36c29c2b5f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:23.864979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39248004-0f73-4ccf-9829-36c29c2b5f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:23.865101 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39248004-0f73-4ccf-9829-36c29c2b5f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:23.865473 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39248004-0f73-4ccf-9829-36c29c2b5f93 admin admin] PATH_INFO: `/v3/projects/7e766c6d23c34d0b956e7cbe96ee65b0/users/7d039ef9bf0443178262056aa4b33230/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:23.895389 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d04b7b86-61a8-42a1-886c-7feb93dbe521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '449720bdc99649329a5e6b59bacb92ea', 'request_id': 'req-d04b7b86-61a8-42a1-886c-7feb93dbe521'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:23.896141 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39248004-0f73-4ccf-9829-36c29c2b5f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e766c6d23c34d0b956e7cbe96ee65b0, user_id=7d039ef9bf0443178262056aa4b33230, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:23.901069 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39248004-0f73-4ccf-9829-36c29c2b5f93 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:23.902783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d04b7b86-61a8-42a1-886c-7feb93dbe521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '449720bdc99649329a5e6b59bacb92ea', 'request_id': 'req-d04b7b86-61a8-42a1-886c-7feb93dbe521'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:23.911786 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d04b7b86-61a8-42a1-886c-7feb93dbe521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '449720bdc99649329a5e6b59bacb92ea', 'request_id': 'req-d04b7b86-61a8-42a1-886c-7feb93dbe521'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:23.935576 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d04b7b86-61a8-42a1-886c-7feb93dbe521 admin admin] The token cache is being invalidate because project 449720bdc99649329a5e6b59bacb92ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:23.936001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d04b7b86-61a8-42a1-886c-7feb93dbe521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:23.936666 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d04b7b86-61a8-42a1-886c-7feb93dbe521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:23.936873 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1069/2130] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:23 2022] PUT /identity/v3/projects/7e766c6d23c34d0b956e7cbe96ee65b0/users/7d039ef9bf0443178262056aa4b33230/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:23.942555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39248004-0f73-4ccf-9829-36c29c2b5f93 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:23.944500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1062/2131] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:23 2022] DELETE /identity/v3/projects/449720bdc99649329a5e6b59bacb92ea => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:23.948221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b7b86-61a8-42a1-886c-7feb93dbe521 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:23.949113 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-39248004-0f73-4ccf-9829-36c29c2b5f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:23.952837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d04b7b86-61a8-42a1-886c-7feb93dbe521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:24.045206 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b7b86-61a8-42a1-886c-7feb93dbe521 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:24.061676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39248004-0f73-4ccf-9829-36c29c2b5f93 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:24.066967 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e6262-9cfa-4209-9cf1-4dc1ad87d845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:24.067576 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e6262-9cfa-4209-9cf1-4dc1ad87d845 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:24.067858 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e6262-9cfa-4209-9cf1-4dc1ad87d845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:24.068131 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e6262-9cfa-4209-9cf1-4dc1ad87d845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:24.068790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e6262-9cfa-4209-9cf1-4dc1ad87d845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:24.070512 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e6262-9cfa-4209-9cf1-4dc1ad87d845 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:24.086941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1070/2132] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:24.088059 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e6262-9cfa-4209-9cf1-4dc1ad87d845 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:24.096190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:24.102329 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e6262-9cfa-4209-9cf1-4dc1ad87d845 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:24.109457 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b341b-0416-4e17-90ee-d11d6c85d76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:24.110745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b341b-0416-4e17-90ee-d11d6c85d76d admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:24.111241 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b341b-0416-4e17-90ee-d11d6c85d76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:24.111958 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b341b-0416-4e17-90ee-d11d6c85d76d admin admin] PATH_INFO: `/v3/projects/7e766c6d23c34d0b956e7cbe96ee65b0/users/7d039ef9bf0443178262056aa4b33230/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:24.114265 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b341b-0416-4e17-90ee-d11d6c85d76d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e766c6d23c34d0b956e7cbe96ee65b0, user_id=7d039ef9bf0443178262056aa4b33230, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:24.117034 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b341b-0416-4e17-90ee-d11d6c85d76d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:24.128494 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1071/2133] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:24 2022] PUT /identity/v3/projects/7e766c6d23c34d0b956e7cbe96ee65b0/users/7d039ef9bf0443178262056aa4b33230/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:24.139529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e45724-47dc-45f9-82dc-8141d7f5dd72 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:24.139830 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e45724-47dc-45f9-82dc-8141d7f5dd72 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:24.140093 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e45724-47dc-45f9-82dc-8141d7f5dd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:24.144379 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099be8e-17fb-4e86-806f-db91151f70df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:24.145252 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099be8e-17fb-4e86-806f-db91151f70df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:24.146377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099be8e-17fb-4e86-806f-db91151f70df admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:24.146753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099be8e-17fb-4e86-806f-db91151f70df admin admin] PATH_INFO: `/v3/users/2ae36d2b32324fe68f116e8b048b5eae` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:24.148249 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099be8e-17fb-4e86-806f-db91151f70df admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae36d2b32324fe68f116e8b048b5eae)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:24.151419 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099be8e-17fb-4e86-806f-db91151f70df admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:24.166047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:24.171817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-85e45724-47dc-45f9-82dc-8141d7f5dd72 None None] MFA Rules not processed for user `7d039ef9bf0443178262056aa4b33230`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:24.173865 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-85e45724-47dc-45f9-82dc-8141d7f5dd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:24.236938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5099be8e-17fb-4e86-806f-db91151f70df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae36d2b32324fe68f116e8b048b5eae'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:24.247731 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5099be8e-17fb-4e86-806f-db91151f70df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae36d2b32324fe68f116e8b048b5eae'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:24.248773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5099be8e-17fb-4e86-806f-db91151f70df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae36d2b32324fe68f116e8b048b5eae'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:24.262605 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5099be8e-17fb-4e86-806f-db91151f70df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae36d2b32324fe68f116e8b048b5eae'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:24.272530 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1072/2134] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:24.276587 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5099be8e-17fb-4e86-806f-db91151f70df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae36d2b32324fe68f116e8b048b5eae'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:24.284688 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e45724-47dc-45f9-82dc-8141d7f5dd72 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:24.286130 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-85e45724-47dc-45f9-82dc-8141d7f5dd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:24.296563 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1063/2135] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:23 2022] DELETE /identity/v3/users/2ae36d2b32324fe68f116e8b048b5eae => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:24.358519 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e45724-47dc-45f9-82dc-8141d7f5dd72 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:24.417905 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f894ea0-9b38-4a44-af71-28c02d6c586b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:24.418845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f894ea0-9b38-4a44-af71-28c02d6c586b service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:24.419273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f894ea0-9b38-4a44-af71-28c02d6c586b service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:24.419685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f894ea0-9b38-4a44-af71-28c02d6c586b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:24.422160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6f894ea0-9b38-4a44-af71-28c02d6c586b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:24.477492 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:24.495197 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f894ea0-9b38-4a44-af71-28c02d6c586b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:24.497231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f894ea0-9b38-4a44-af71-28c02d6c586b service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:24.508254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1073/2136] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:25.384970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099be8e-17fb-4e86-806f-db91151f70df admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:25.386847 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5099be8e-17fb-4e86-806f-db91151f70df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:25.594504 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099be8e-17fb-4e86-806f-db91151f70df admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:25.601045 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ea82f-194f-4ead-ad34-0b97e80952e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:25.601829 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ea82f-194f-4ead-ad34-0b97e80952e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:25.602132 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ea82f-194f-4ead-ad34-0b97e80952e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:25.602399 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ea82f-194f-4ead-ad34-0b97e80952e9 admin admin] PATH_INFO: `/v3/projects/f6049f64699f42278c4d399b8dafb9db` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:25.603769 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ea82f-194f-4ead-ad34-0b97e80952e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6049f64699f42278c4d399b8dafb9db)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:25.606335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ea82f-194f-4ead-ad34-0b97e80952e9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:25.688256 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-191ea82f-194f-4ead-ad34-0b97e80952e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6049f64699f42278c4d399b8dafb9db', 'request_id': 'req-191ea82f-194f-4ead-ad34-0b97e80952e9'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:25.707049 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-191ea82f-194f-4ead-ad34-0b97e80952e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6049f64699f42278c4d399b8dafb9db', 'request_id': 'req-191ea82f-194f-4ead-ad34-0b97e80952e9'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:25.714511 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-191ea82f-194f-4ead-ad34-0b97e80952e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6049f64699f42278c4d399b8dafb9db', 'request_id': 'req-191ea82f-194f-4ead-ad34-0b97e80952e9'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:25.731092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-191ea82f-194f-4ead-ad34-0b97e80952e9 admin admin] The token cache is being invalidate because project f6049f64699f42278c4d399b8dafb9db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:25.732202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-191ea82f-194f-4ead-ad34-0b97e80952e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:25.732932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-191ea82f-194f-4ead-ad34-0b97e80952e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:25.734751 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1064/2137] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:25 2022] DELETE /identity/v3/projects/f6049f64699f42278c4d399b8dafb9db => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:25.739684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6338a-5bc1-449a-9d2e-35591e8cdff5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:25.740154 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6338a-5bc1-449a-9d2e-35591e8cdff5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:25.740233 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6338a-5bc1-449a-9d2e-35591e8cdff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:25.769614 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c9e6338a-5bc1-449a-9d2e-35591e8cdff5 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:25.771132 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c9e6338a-5bc1-449a-9d2e-35591e8cdff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:25.838750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1074/2138] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:25.847864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2322b9e-5004-4442-9cd2-3ae2768c4025 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:25.848410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2322b9e-5004-4442-9cd2-3ae2768c4025 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:25.849765 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2322b9e-5004-4442-9cd2-3ae2768c4025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:25.877664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d2322b9e-5004-4442-9cd2-3ae2768c4025 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:25.878967 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d2322b9e-5004-4442-9cd2-3ae2768c4025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:25.901046 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1065/2139] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:25.905382 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6338a-5bc1-449a-9d2e-35591e8cdff5 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:25.915482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6338a-5bc1-449a-9d2e-35591e8cdff5 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:25.920203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e079bb3-3601-4271-acb4-4a85d520a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:25.920824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e079bb3-3601-4271-acb4-4a85d520a154 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:25.921102 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e079bb3-3601-4271-acb4-4a85d520a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:25.921372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e079bb3-3601-4271-acb4-4a85d520a154 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:25.922042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e079bb3-3601-4271-acb4-4a85d520a154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:21:25.922334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e079bb3-3601-4271-acb4-4a85d520a154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:25.924017 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e079bb3-3601-4271-acb4-4a85d520a154 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:25.936958 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1075/2140] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:21:25.943916 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2322b9e-5004-4442-9cd2-3ae2768c4025 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:25.953361 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2322b9e-5004-4442-9cd2-3ae2768c4025 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:25.959880 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eb964-4a9b-47cb-b8d2-6bc0db2e416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:25.960635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eb964-4a9b-47cb-b8d2-6bc0db2e416a admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:25.961064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eb964-4a9b-47cb-b8d2-6bc0db2e416a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:25.961442 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eb964-4a9b-47cb-b8d2-6bc0db2e416a admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:25.963144 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58eb964-4a9b-47cb-b8d2-6bc0db2e416a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:25.965237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58eb964-4a9b-47cb-b8d2-6bc0db2e416a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:25.985135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:26.021105 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1066/2141] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:25 2022] POST /identity/v3/projects => generated 391 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:26.022756 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e079bb3-3601-4271-acb4-4a85d520a154 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:26.035051 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e079bb3-3601-4271-acb4-4a85d520a154 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:26.125068 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffe602-4c6d-4b9f-9762-50d63fe9722c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:26.126632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffe602-4c6d-4b9f-9762-50d63fe9722c admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:26.127014 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffe602-4c6d-4b9f-9762-50d63fe9722c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:26.127293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffe602-4c6d-4b9f-9762-50d63fe9722c admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:26.128036 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffe602-4c6d-4b9f-9762-50d63fe9722c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:26.130285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffe602-4c6d-4b9f-9762-50d63fe9722c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:26.167334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1076/2142] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:26 2022] POST /identity/v3/users => generated 296 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:26.168034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eb964-4a9b-47cb-b8d2-6bc0db2e416a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:26.183280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eb964-4a9b-47cb-b8d2-6bc0db2e416a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:26.208801 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11ed1b-c5ae-4a2c-87ba-9906ba7d4363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:26.209426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11ed1b-c5ae-4a2c-87ba-9906ba7d4363 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:26.209705 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11ed1b-c5ae-4a2c-87ba-9906ba7d4363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:26.209973 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11ed1b-c5ae-4a2c-87ba-9906ba7d4363 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:26.210634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11ed1b-c5ae-4a2c-87ba-9906ba7d4363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:26.212261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11ed1b-c5ae-4a2c-87ba-9906ba7d4363 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:26.245734 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1067/2143] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:26.245839 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffe602-4c6d-4b9f-9762-50d63fe9722c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:26.254477 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffe602-4c6d-4b9f-9762-50d63fe9722c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:26.262994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3369e4c-22a6-4243-939d-8ed6748c8352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:26.264116 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3369e4c-22a6-4243-939d-8ed6748c8352 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:26.264508 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3369e4c-22a6-4243-939d-8ed6748c8352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:26.264924 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3369e4c-22a6-4243-939d-8ed6748c8352 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:26.265732 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3369e4c-22a6-4243-939d-8ed6748c8352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:26.267737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3369e4c-22a6-4243-939d-8ed6748c8352 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:26.283917 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1077/2144] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:26.285484 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11ed1b-c5ae-4a2c-87ba-9906ba7d4363 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:26.304864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11ed1b-c5ae-4a2c-87ba-9906ba7d4363 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:26.310638 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f8f56-56e6-4e99-aad1-130be3d8b973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:26.311466 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f8f56-56e6-4e99-aad1-130be3d8b973 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:26.311822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f8f56-56e6-4e99-aad1-130be3d8b973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:26.312177 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f8f56-56e6-4e99-aad1-130be3d8b973 admin admin] PATH_INFO: `/v3/projects/18382fe4fad742dbadaf4044162ae4ce/users/1554bf91db02408d9bab53a5e82e4b7c/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:26.333323 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f8f56-56e6-4e99-aad1-130be3d8b973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18382fe4fad742dbadaf4044162ae4ce, user_id=1554bf91db02408d9bab53a5e82e4b7c, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:26.336322 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f8f56-56e6-4e99-aad1-130be3d8b973 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:26.354793 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1068/2145] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:26 2022] PUT /identity/v3/projects/18382fe4fad742dbadaf4044162ae4ce/users/1554bf91db02408d9bab53a5e82e4b7c/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:26.364888 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b001b59-f510-4f9a-9204-a5a92364ce59 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:26.365444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b001b59-f510-4f9a-9204-a5a92364ce59 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:26.365989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b001b59-f510-4f9a-9204-a5a92364ce59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:26.407193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-2b001b59-f510-4f9a-9204-a5a92364ce59 None None] MFA Rules not processed for user `1554bf91db02408d9bab53a5e82e4b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:26.408544 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2b001b59-f510-4f9a-9204-a5a92364ce59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:26.453496 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:26.478934 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1078/2146] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:26.491371 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f8f56-56e6-4e99-aad1-130be3d8b973 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:26.493049 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-593f8f56-56e6-4e99-aad1-130be3d8b973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:26.563264 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f8f56-56e6-4e99-aad1-130be3d8b973 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:26.578462 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e431c1a-6122-42a4-8c76-dc6444bcae82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:26.579194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e431c1a-6122-42a4-8c76-dc6444bcae82 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:26.579481 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e431c1a-6122-42a4-8c76-dc6444bcae82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:26.579763 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e431c1a-6122-42a4-8c76-dc6444bcae82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:26.616844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e431c1a-6122-42a4-8c76-dc6444bcae82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:26.618299 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e431c1a-6122-42a4-8c76-dc6444bcae82 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:26.631102 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1069/2147] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:26 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:27.020553 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b001b59-f510-4f9a-9204-a5a92364ce59 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:27.022887 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2b001b59-f510-4f9a-9204-a5a92364ce59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:27.135805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b001b59-f510-4f9a-9204-a5a92364ce59 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:27.140485 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564f91c-4112-462c-ab04-650ea07f90b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:27.141123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564f91c-4112-462c-ab04-650ea07f90b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:27.141401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564f91c-4112-462c-ab04-650ea07f90b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:27.142262 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564f91c-4112-462c-ab04-650ea07f90b9 admin admin] PATH_INFO: `/v3/users/5335de6ca87344628a553923c5fca11a` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:27.143623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564f91c-4112-462c-ab04-650ea07f90b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5335de6ca87344628a553923c5fca11a)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:27.145632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564f91c-4112-462c-ab04-650ea07f90b9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:27.196187 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a564f91c-4112-462c-ab04-650ea07f90b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5335de6ca87344628a553923c5fca11a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:27.203105 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a564f91c-4112-462c-ab04-650ea07f90b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5335de6ca87344628a553923c5fca11a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:27.215378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a564f91c-4112-462c-ab04-650ea07f90b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5335de6ca87344628a553923c5fca11a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:27.215992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a564f91c-4112-462c-ab04-650ea07f90b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5335de6ca87344628a553923c5fca11a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:27.224035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a564f91c-4112-462c-ab04-650ea07f90b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5335de6ca87344628a553923c5fca11a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:27.229999 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1079/2148] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:27 2022] DELETE /identity/v3/users/5335de6ca87344628a553923c5fca11a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:27.284330 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e431c1a-6122-42a4-8c76-dc6444bcae82 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:27.285768 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9e431c1a-6122-42a4-8c76-dc6444bcae82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:27.297353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e431c1a-6122-42a4-8c76-dc6444bcae82 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:27.349919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405aff6c-b4d5-4fc2-8597-b739d4d64346 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:27.350532 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405aff6c-b4d5-4fc2-8597-b739d4d64346 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:27.350852 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405aff6c-b4d5-4fc2-8597-b739d4d64346 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:27.351159 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405aff6c-b4d5-4fc2-8597-b739d4d64346 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:27.352922 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-405aff6c-b4d5-4fc2-8597-b739d4d64346 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:27.414670 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564f91c-4112-462c-ab04-650ea07f90b9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:27.416432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a564f91c-4112-462c-ab04-650ea07f90b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:27.435591 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405aff6c-b4d5-4fc2-8597-b739d4d64346 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:27.437067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405aff6c-b4d5-4fc2-8597-b739d4d64346 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:27.449809 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1070/2149] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:27.485169 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564f91c-4112-462c-ab04-650ea07f90b9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:27.489704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5479b19-5bff-440e-b6c6-acd4cecb03fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:27.490329 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5479b19-5bff-440e-b6c6-acd4cecb03fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:27.490606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5479b19-5bff-440e-b6c6-acd4cecb03fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:27.490908 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5479b19-5bff-440e-b6c6-acd4cecb03fb admin admin] PATH_INFO: `/v3/projects/174bd0f5a3744575a5889156f31149e6` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:27.492035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5479b19-5bff-440e-b6c6-acd4cecb03fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=174bd0f5a3744575a5889156f31149e6)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:27.493916 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5479b19-5bff-440e-b6c6-acd4cecb03fb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:27.495462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:27.544910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b5479b19-5bff-440e-b6c6-acd4cecb03fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '174bd0f5a3744575a5889156f31149e6', 'request_id': 'req-b5479b19-5bff-440e-b6c6-acd4cecb03fb'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:27.551395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b5479b19-5bff-440e-b6c6-acd4cecb03fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '174bd0f5a3744575a5889156f31149e6', 'request_id': 'req-b5479b19-5bff-440e-b6c6-acd4cecb03fb'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:27.559096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b5479b19-5bff-440e-b6c6-acd4cecb03fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '174bd0f5a3744575a5889156f31149e6', 'request_id': 'req-b5479b19-5bff-440e-b6c6-acd4cecb03fb'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:27.570194 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b5479b19-5bff-440e-b6c6-acd4cecb03fb admin admin] The token cache is being invalidate because project 174bd0f5a3744575a5889156f31149e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:27.570494 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b5479b19-5bff-440e-b6c6-acd4cecb03fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:27.571324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b5479b19-5bff-440e-b6c6-acd4cecb03fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:27.572844 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1080/2150] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:27 2022] DELETE /identity/v3/projects/174bd0f5a3744575a5889156f31149e6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:27.577753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94905440-615a-4d4f-93cc-b08f24f63bde None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:27.578215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94905440-615a-4d4f-93cc-b08f24f63bde None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:27.578475 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94905440-615a-4d4f-93cc-b08f24f63bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:27.594688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:27.604894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-94905440-615a-4d4f-93cc-b08f24f63bde None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:27.606293 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-94905440-615a-4d4f-93cc-b08f24f63bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:27.678339 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1071/2151] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:27.686103 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b44a8-40d3-4d91-95b5-ba0904f8ff45 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:27.686415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b44a8-40d3-4d91-95b5-ba0904f8ff45 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:27.686675 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b44a8-40d3-4d91-95b5-ba0904f8ff45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:27.711012 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-291b44a8-40d3-4d91-95b5-ba0904f8ff45 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:27.712280 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-291b44a8-40d3-4d91-95b5-ba0904f8ff45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:27.723317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1081/2152] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:27.728245 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94905440-615a-4d4f-93cc-b08f24f63bde None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:27.741585 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94905440-615a-4d4f-93cc-b08f24f63bde None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:27.746900 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554f6d-8594-4060-bb6e-79f8104d3382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:27.747520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554f6d-8594-4060-bb6e-79f8104d3382 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:27.747978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554f6d-8594-4060-bb6e-79f8104d3382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:27.748165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554f6d-8594-4060-bb6e-79f8104d3382 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:27.748800 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d554f6d-8594-4060-bb6e-79f8104d3382 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:21:27.749185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d554f6d-8594-4060-bb6e-79f8104d3382 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:27.750809 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d554f6d-8594-4060-bb6e-79f8104d3382 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:27.770390 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1072/2153] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:21:27.771678 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b44a8-40d3-4d91-95b5-ba0904f8ff45 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:27.781743 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b44a8-40d3-4d91-95b5-ba0904f8ff45 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:27.787516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7fbcb-5b72-4cab-9bd0-57a8ee08514e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:27.788385 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7fbcb-5b72-4cab-9bd0-57a8ee08514e admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:27.788503 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7fbcb-5b72-4cab-9bd0-57a8ee08514e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:27.788833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7fbcb-5b72-4cab-9bd0-57a8ee08514e admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:27.789608 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7fbcb-5b72-4cab-9bd0-57a8ee08514e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:27.791700 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7fbcb-5b72-4cab-9bd0-57a8ee08514e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:27.824318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1082/2154] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:27 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:27.825373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554f6d-8594-4060-bb6e-79f8104d3382 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:27.836338 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554f6d-8594-4060-bb6e-79f8104d3382 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:27.901856 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90fed9-37c6-401c-9269-b8d89386a668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:27.902582 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90fed9-37c6-401c-9269-b8d89386a668 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:27.902982 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90fed9-37c6-401c-9269-b8d89386a668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:27.903229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90fed9-37c6-401c-9269-b8d89386a668 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:27.903909 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90fed9-37c6-401c-9269-b8d89386a668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:27.906233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90fed9-37c6-401c-9269-b8d89386a668 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:27.929377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1073/2155] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:27 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:27.933593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7fbcb-5b72-4cab-9bd0-57a8ee08514e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:27.945136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7fbcb-5b72-4cab-9bd0-57a8ee08514e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:27.949954 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b338d53-37cd-4ea5-8661-52c903e7121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:27.950566 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b338d53-37cd-4ea5-8661-52c903e7121b admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:27.950880 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b338d53-37cd-4ea5-8661-52c903e7121b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:27.951179 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b338d53-37cd-4ea5-8661-52c903e7121b admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:27.951829 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b338d53-37cd-4ea5-8661-52c903e7121b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:27.953444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b338d53-37cd-4ea5-8661-52c903e7121b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:27.963631 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1083/2156] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:27.967930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90fed9-37c6-401c-9269-b8d89386a668 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:27.978520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90fed9-37c6-401c-9269-b8d89386a668 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:27.992020 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275c240-6c1d-478a-b9f2-ebf8e4c5b39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:27.992711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275c240-6c1d-478a-b9f2-ebf8e4c5b39a admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:27.993069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275c240-6c1d-478a-b9f2-ebf8e4c5b39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:27.993414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275c240-6c1d-478a-b9f2-ebf8e4c5b39a admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:27.994137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275c240-6c1d-478a-b9f2-ebf8e4c5b39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:27.995833 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275c240-6c1d-478a-b9f2-ebf8e4c5b39a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:28.007875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1074/2157] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:28.012185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b338d53-37cd-4ea5-8661-52c903e7121b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:28.022658 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b338d53-37cd-4ea5-8661-52c903e7121b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:28.028549 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa85b4-8d32-4b66-a5c6-6d5536ca2619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:28.029265 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa85b4-8d32-4b66-a5c6-6d5536ca2619 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:28.029618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa85b4-8d32-4b66-a5c6-6d5536ca2619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:28.030005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa85b4-8d32-4b66-a5c6-6d5536ca2619 admin admin] PATH_INFO: `/v3/projects/dc9346539acc4681a7407a3fd5fe2e75/users/36b13c29946346ab99c5a2af69899c26/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:28.053434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa85b4-8d32-4b66-a5c6-6d5536ca2619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc9346539acc4681a7407a3fd5fe2e75, user_id=36b13c29946346ab99c5a2af69899c26, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:28.056742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa85b4-8d32-4b66-a5c6-6d5536ca2619 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:28.071547 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1084/2158] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:28 2022] PUT /identity/v3/projects/dc9346539acc4681a7407a3fd5fe2e75/users/36b13c29946346ab99c5a2af69899c26/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:28.081941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553795b-a8c2-402c-82a0-f19238d83bc4 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:28.082249 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553795b-a8c2-402c-82a0-f19238d83bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:28.082551 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553795b-a8c2-402c-82a0-f19238d83bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:28.111590 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b553795b-a8c2-402c-82a0-f19238d83bc4 None None] MFA Rules not processed for user `36b13c29946346ab99c5a2af69899c26`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:28.112808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b553795b-a8c2-402c-82a0-f19238d83bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:28.194783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1075/2159] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:28.208142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa85b4-8d32-4b66-a5c6-6d5536ca2619 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:28.210388 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-26aa85b4-8d32-4b66-a5c6-6d5536ca2619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:28.299123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa85b4-8d32-4b66-a5c6-6d5536ca2619 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:28.304760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426b2aa-6369-41ce-b785-3ab30b948137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:28.305367 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426b2aa-6369-41ce-b785-3ab30b948137 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:28.305658 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426b2aa-6369-41ce-b785-3ab30b948137 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:28.305924 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426b2aa-6369-41ce-b785-3ab30b948137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:28.314345 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426b2aa-6369-41ce-b785-3ab30b948137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:28.316027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426b2aa-6369-41ce-b785-3ab30b948137 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:28.326344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1085/2160] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:32.685643 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553795b-a8c2-402c-82a0-f19238d83bc4 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:32.688577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b553795b-a8c2-402c-82a0-f19238d83bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:32.699868 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:32.782576 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553795b-a8c2-402c-82a0-f19238d83bc4 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:32.789476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be39340-7d1b-4aec-8019-402a2542074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:32.790180 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be39340-7d1b-4aec-8019-402a2542074a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:32.790470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be39340-7d1b-4aec-8019-402a2542074a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:32.790777 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be39340-7d1b-4aec-8019-402a2542074a admin admin] PATH_INFO: `/v3/users/0071a2745cf34f5d870b10c8cf4785c2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:32.793057 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be39340-7d1b-4aec-8019-402a2542074a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0071a2745cf34f5d870b10c8cf4785c2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:32.795686 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be39340-7d1b-4aec-8019-402a2542074a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:32.859528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8be39340-7d1b-4aec-8019-402a2542074a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0071a2745cf34f5d870b10c8cf4785c2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:32.869279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8be39340-7d1b-4aec-8019-402a2542074a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0071a2745cf34f5d870b10c8cf4785c2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:32.870139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8be39340-7d1b-4aec-8019-402a2542074a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0071a2745cf34f5d870b10c8cf4785c2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:32.886075 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8be39340-7d1b-4aec-8019-402a2542074a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0071a2745cf34f5d870b10c8cf4785c2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:32.895725 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8be39340-7d1b-4aec-8019-402a2542074a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0071a2745cf34f5d870b10c8cf4785c2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:32.902272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1076/2161] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:32 2022] DELETE /identity/v3/users/0071a2745cf34f5d870b10c8cf4785c2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:32.907749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122967c0-6bed-4074-a6d5-ecc19e9ae0eb None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:32.908203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122967c0-6bed-4074-a6d5-ecc19e9ae0eb None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:32.908357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122967c0-6bed-4074-a6d5-ecc19e9ae0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:32.929108 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-122967c0-6bed-4074-a6d5-ecc19e9ae0eb None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:32.930286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-122967c0-6bed-4074-a6d5-ecc19e9ae0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:32.935339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:32.994382 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1086/2162] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:33.001043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be39340-7d1b-4aec-8019-402a2542074a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:33.002486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8be39340-7d1b-4aec-8019-402a2542074a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:33.058773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be39340-7d1b-4aec-8019-402a2542074a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:33.062374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129f771-a858-4479-8c19-0ea7c57330ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:33.063014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129f771-a858-4479-8c19-0ea7c57330ce service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:33.063306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129f771-a858-4479-8c19-0ea7c57330ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:33.063584 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129f771-a858-4479-8c19-0ea7c57330ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:33.072449 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129f771-a858-4479-8c19-0ea7c57330ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:33.073905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129f771-a858-4479-8c19-0ea7c57330ce service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:33.083998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1077/2163] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:33.347160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122967c0-6bed-4074-a6d5-ecc19e9ae0eb None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:33.348738 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-122967c0-6bed-4074-a6d5-ecc19e9ae0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:33.361186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122967c0-6bed-4074-a6d5-ecc19e9ae0eb None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:33.365887 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269fcd2-20db-4cd8-bacd-45ad6c865314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:33.366518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269fcd2-20db-4cd8-bacd-45ad6c865314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:33.366999 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269fcd2-20db-4cd8-bacd-45ad6c865314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:33.367278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269fcd2-20db-4cd8-bacd-45ad6c865314 admin admin] PATH_INFO: `/v3/projects/475dda6239144fa38cb03b60b0b2f0a2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:33.368481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269fcd2-20db-4cd8-bacd-45ad6c865314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=475dda6239144fa38cb03b60b0b2f0a2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:33.370427 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269fcd2-20db-4cd8-bacd-45ad6c865314 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:33.421733 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3269fcd2-20db-4cd8-bacd-45ad6c865314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475dda6239144fa38cb03b60b0b2f0a2', 'request_id': 'req-3269fcd2-20db-4cd8-bacd-45ad6c865314'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:33.428421 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3269fcd2-20db-4cd8-bacd-45ad6c865314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475dda6239144fa38cb03b60b0b2f0a2', 'request_id': 'req-3269fcd2-20db-4cd8-bacd-45ad6c865314'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:33.436683 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3269fcd2-20db-4cd8-bacd-45ad6c865314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475dda6239144fa38cb03b60b0b2f0a2', 'request_id': 'req-3269fcd2-20db-4cd8-bacd-45ad6c865314'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:33.448404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3269fcd2-20db-4cd8-bacd-45ad6c865314 admin admin] The token cache is being invalidate because project 475dda6239144fa38cb03b60b0b2f0a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:33.448695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3269fcd2-20db-4cd8-bacd-45ad6c865314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:33.449341 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3269fcd2-20db-4cd8-bacd-45ad6c865314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:33.450836 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1087/2164] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:33 2022] DELETE /identity/v3/projects/475dda6239144fa38cb03b60b0b2f0a2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:33.456643 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a9e11-9994-4524-845a-71951798cfc7 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:33.456984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a9e11-9994-4524-845a-71951798cfc7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:33.457263 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a9e11-9994-4524-845a-71951798cfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:33.477296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-061a9e11-9994-4524-845a-71951798cfc7 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:33.478503 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-061a9e11-9994-4524-845a-71951798cfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:33.499796 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:33.549991 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1078/2165] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:33.557813 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c0f50-506c-4db9-8df3-6d6d8105e169 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:33.558100 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c0f50-506c-4db9-8df3-6d6d8105e169 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:33.558374 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c0f50-506c-4db9-8df3-6d6d8105e169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:33.578810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-dc3c0f50-506c-4db9-8df3-6d6d8105e169 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:33.580516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-dc3c0f50-506c-4db9-8df3-6d6d8105e169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:33.600093 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1088/2166] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:33.604311 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a9e11-9994-4524-845a-71951798cfc7 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:33.620749 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a9e11-9994-4524-845a-71951798cfc7 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:33.622981 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c0f50-506c-4db9-8df3-6d6d8105e169 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:33.626260 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76429e-45a7-4032-b43f-6c3ec15004c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:33.626465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-dc3c0f50-506c-4db9-8df3-6d6d8105e169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:33.627028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76429e-45a7-4032-b43f-6c3ec15004c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:33.627373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76429e-45a7-4032-b43f-6c3ec15004c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:33.627712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76429e-45a7-4032-b43f-6c3ec15004c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:33.628934 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76429e-45a7-4032-b43f-6c3ec15004c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:21:33.629308 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76429e-45a7-4032-b43f-6c3ec15004c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:33.631073 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76429e-45a7-4032-b43f-6c3ec15004c4 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:33.641387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c0f50-506c-4db9-8df3-6d6d8105e169 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:33.644380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1079/2167] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:21:33.648546 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76429e-45a7-4032-b43f-6c3ec15004c4 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:33.651151 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5af5e-0505-4841-9e43-5b1af358ba48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:33.651859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5af5e-0505-4841-9e43-5b1af358ba48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:33.652084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5af5e-0505-4841-9e43-5b1af358ba48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:33.652359 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5af5e-0505-4841-9e43-5b1af358ba48 admin admin] PATH_INFO: `/v3/users/36b13c29946346ab99c5a2af69899c26` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:33.655821 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5af5e-0505-4841-9e43-5b1af358ba48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b13c29946346ab99c5a2af69899c26)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:33.655821 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5af5e-0505-4841-9e43-5b1af358ba48 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:33.661408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76429e-45a7-4032-b43f-6c3ec15004c4 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:33.666288 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db235631-1dff-44b6-8449-c96fc1bbb6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:33.667008 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db235631-1dff-44b6-8449-c96fc1bbb6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:33.667367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db235631-1dff-44b6-8449-c96fc1bbb6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:33.667715 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db235631-1dff-44b6-8449-c96fc1bbb6b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:33.668428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db235631-1dff-44b6-8449-c96fc1bbb6b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:33.670423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db235631-1dff-44b6-8449-c96fc1bbb6b1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:33.702652 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1080/2168] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:33 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:33.703921 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db235631-1dff-44b6-8449-c96fc1bbb6b1 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:33.733286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fee5af5e-0505-4841-9e43-5b1af358ba48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b13c29946346ab99c5a2af69899c26'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:33.742895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fee5af5e-0505-4841-9e43-5b1af358ba48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b13c29946346ab99c5a2af69899c26'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:33.757033 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fee5af5e-0505-4841-9e43-5b1af358ba48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b13c29946346ab99c5a2af69899c26'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:33.757793 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fee5af5e-0505-4841-9e43-5b1af358ba48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b13c29946346ab99c5a2af69899c26'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:33.779015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fee5af5e-0505-4841-9e43-5b1af358ba48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b13c29946346ab99c5a2af69899c26'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:33.779015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:33.779015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1089/2169] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:33 2022] DELETE /identity/v3/users/36b13c29946346ab99c5a2af69899c26 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:33.782785 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1d9ad-b9d2-47ce-8e6d-a4f10677af51 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:33.782785 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1d9ad-b9d2-47ce-8e6d-a4f10677af51 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:33.783422 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1d9ad-b9d2-47ce-8e6d-a4f10677af51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:33.800259 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db235631-1dff-44b6-8449-c96fc1bbb6b1 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:33.805988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-75f1d9ad-b9d2-47ce-8e6d-a4f10677af51 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:33.807229 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-75f1d9ad-b9d2-47ce-8e6d-a4f10677af51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:33.872773 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909cbf9-dae4-42aa-8272-7a87da436d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:33.873391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909cbf9-dae4-42aa-8272-7a87da436d1c admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:33.873682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909cbf9-dae4-42aa-8272-7a87da436d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:33.873930 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1090/2170] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:33.874804 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909cbf9-dae4-42aa-8272-7a87da436d1c admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:33.875457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909cbf9-dae4-42aa-8272-7a87da436d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:33.878295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909cbf9-dae4-42aa-8272-7a87da436d1c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:33.884281 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1d9ad-b9d2-47ce-8e6d-a4f10677af51 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:33.885716 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-75f1d9ad-b9d2-47ce-8e6d-a4f10677af51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:33.902951 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1081/2171] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:33 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:33.906679 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909cbf9-dae4-42aa-8272-7a87da436d1c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:33.908427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0909cbf9-dae4-42aa-8272-7a87da436d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:33.923970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909cbf9-dae4-42aa-8272-7a87da436d1c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:33.929352 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c7989-fe45-4286-8198-e656d4e86d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:33.930750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c7989-fe45-4286-8198-e656d4e86d69 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:33.931287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c7989-fe45-4286-8198-e656d4e86d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:33.931639 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c7989-fe45-4286-8198-e656d4e86d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:33.932277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c7989-fe45-4286-8198-e656d4e86d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:33.934135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c7989-fe45-4286-8198-e656d4e86d69 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:33.949842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1082/2172] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:33.954068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c7989-fe45-4286-8198-e656d4e86d69 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:33.969120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c7989-fe45-4286-8198-e656d4e86d69 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:33.974635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d948bd-3ad0-4d36-808f-06ad1b0d2d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:33.975438 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d948bd-3ad0-4d36-808f-06ad1b0d2d22 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:33.975873 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d948bd-3ad0-4d36-808f-06ad1b0d2d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:33.976442 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d948bd-3ad0-4d36-808f-06ad1b0d2d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:33.976968 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d948bd-3ad0-4d36-808f-06ad1b0d2d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:33.978575 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d948bd-3ad0-4d36-808f-06ad1b0d2d22 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:33.981387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1d9ad-b9d2-47ce-8e6d-a4f10677af51 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:33.988750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4eef7f-05a2-493d-88d0-b7f325cc71ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:33.989960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4eef7f-05a2-493d-88d0-b7f325cc71ff service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:33.990414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4eef7f-05a2-493d-88d0-b7f325cc71ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:33.990862 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4eef7f-05a2-493d-88d0-b7f325cc71ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:33.996719 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1083/2173] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:33.998404 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d948bd-3ad0-4d36-808f-06ad1b0d2d22 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:34.012470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:34.015146 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d948bd-3ad0-4d36-808f-06ad1b0d2d22 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:34.016642 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4eef7f-05a2-493d-88d0-b7f325cc71ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:34.020392 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4eef7f-05a2-493d-88d0-b7f325cc71ff service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:34.021932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c31d5-b6b2-4d8f-829a-26ff0d222f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:34.022601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c31d5-b6b2-4d8f-829a-26ff0d222f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:34.022912 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c31d5-b6b2-4d8f-829a-26ff0d222f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:34.024020 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c31d5-b6b2-4d8f-829a-26ff0d222f21 admin admin] PATH_INFO: `/v3/projects/486df15b12c841f89334e8d6efabb8c2/users/5bdd515409104684b9fa87337c444cbd/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:34.036185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1091/2174] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:21:34.048780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c31d5-b6b2-4d8f-829a-26ff0d222f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=486df15b12c841f89334e8d6efabb8c2, user_id=5bdd515409104684b9fa87337c444cbd, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:34.052741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c31d5-b6b2-4d8f-829a-26ff0d222f21 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:34.075291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1084/2175] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:33 2022] PUT /identity/v3/projects/486df15b12c841f89334e8d6efabb8c2/users/5bdd515409104684b9fa87337c444cbd/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:34.086422 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a14fc-e56e-4295-b8ee-f90230d02618 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:34.086708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a14fc-e56e-4295-b8ee-f90230d02618 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:34.087109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a14fc-e56e-4295-b8ee-f90230d02618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:34.133564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ee6a14fc-e56e-4295-b8ee-f90230d02618 None None] MFA Rules not processed for user `5bdd515409104684b9fa87337c444cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:34.135390 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ee6a14fc-e56e-4295-b8ee-f90230d02618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:34.218460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1092/2176] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:34.230914 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c31d5-b6b2-4d8f-829a-26ff0d222f21 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:34.237368 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-479c31d5-b6b2-4d8f-829a-26ff0d222f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:34.323147 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c31d5-b6b2-4d8f-829a-26ff0d222f21 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:34.337091 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e964d4-60e5-4133-ad72-66591e2dfe97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:34.337820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e964d4-60e5-4133-ad72-66591e2dfe97 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:34.338097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e964d4-60e5-4133-ad72-66591e2dfe97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:34.338367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e964d4-60e5-4133-ad72-66591e2dfe97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:34.349583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e964d4-60e5-4133-ad72-66591e2dfe97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:34.350856 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e964d4-60e5-4133-ad72-66591e2dfe97 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:34.361882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1085/2177] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:34.375570 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a14fc-e56e-4295-b8ee-f90230d02618 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:34.376479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ee6a14fc-e56e-4295-b8ee-f90230d02618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:34.428000 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:34.470400 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a14fc-e56e-4295-b8ee-f90230d02618 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:34.475174 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91336c81-b514-4afd-9403-9dbd0359c700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:34.475804 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91336c81-b514-4afd-9403-9dbd0359c700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:34.476081 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91336c81-b514-4afd-9403-9dbd0359c700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:34.476570 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91336c81-b514-4afd-9403-9dbd0359c700 admin admin] PATH_INFO: `/v3/projects/dc9346539acc4681a7407a3fd5fe2e75` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:34.477510 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91336c81-b514-4afd-9403-9dbd0359c700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc9346539acc4681a7407a3fd5fe2e75)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:34.479749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91336c81-b514-4afd-9403-9dbd0359c700 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:34.539260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-91336c81-b514-4afd-9403-9dbd0359c700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc9346539acc4681a7407a3fd5fe2e75', 'request_id': 'req-91336c81-b514-4afd-9403-9dbd0359c700'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:34.545658 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-91336c81-b514-4afd-9403-9dbd0359c700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc9346539acc4681a7407a3fd5fe2e75', 'request_id': 'req-91336c81-b514-4afd-9403-9dbd0359c700'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:34.553636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-91336c81-b514-4afd-9403-9dbd0359c700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc9346539acc4681a7407a3fd5fe2e75', 'request_id': 'req-91336c81-b514-4afd-9403-9dbd0359c700'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:34.565542 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-91336c81-b514-4afd-9403-9dbd0359c700 admin admin] The token cache is being invalidate because project dc9346539acc4681a7407a3fd5fe2e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:34.565847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-91336c81-b514-4afd-9403-9dbd0359c700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:34.566491 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-91336c81-b514-4afd-9403-9dbd0359c700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:34.567986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1093/2178] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:34 2022] DELETE /identity/v3/projects/dc9346539acc4681a7407a3fd5fe2e75 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:34.572826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64bc8e-b550-4ee3-82f8-5a109659d523 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:34.573182 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64bc8e-b550-4ee3-82f8-5a109659d523 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:34.573527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64bc8e-b550-4ee3-82f8-5a109659d523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:34.595597 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-fb64bc8e-b550-4ee3-82f8-5a109659d523 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:34.597322 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fb64bc8e-b550-4ee3-82f8-5a109659d523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:34.662750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1086/2179] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:34.671693 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54c98c-1741-4ff4-961a-b13abfe22c0e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:34.671988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54c98c-1741-4ff4-961a-b13abfe22c0e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:34.672280 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54c98c-1741-4ff4-961a-b13abfe22c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:34.692439 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8f54c98c-1741-4ff4-961a-b13abfe22c0e None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:34.693761 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8f54c98c-1741-4ff4-961a-b13abfe22c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:34.702177 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1094/2180] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:34.707636 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64bc8e-b550-4ee3-82f8-5a109659d523 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:34.720962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64bc8e-b550-4ee3-82f8-5a109659d523 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:34.732525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ca66d-3c93-400d-bc34-3ee74c8c85ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:34.733232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ca66d-3c93-400d-bc34-3ee74c8c85ed admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:34.733651 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ca66d-3c93-400d-bc34-3ee74c8c85ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:34.733851 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ca66d-3c93-400d-bc34-3ee74c8c85ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:34.734611 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ca66d-3c93-400d-bc34-3ee74c8c85ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:21:34.735054 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ca66d-3c93-400d-bc34-3ee74c8c85ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:34.736973 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ca66d-3c93-400d-bc34-3ee74c8c85ed admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:34.755411 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1087/2181] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:21:34.756139 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54c98c-1741-4ff4-961a-b13abfe22c0e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:34.766174 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54c98c-1741-4ff4-961a-b13abfe22c0e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:34.775040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f0ba4-5a08-4daa-9b93-8bb6494b42ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:34.776037 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f0ba4-5a08-4daa-9b93-8bb6494b42ee admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:34.776498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f0ba4-5a08-4daa-9b93-8bb6494b42ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:34.777261 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f0ba4-5a08-4daa-9b93-8bb6494b42ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:34.778140 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f0ba4-5a08-4daa-9b93-8bb6494b42ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:34.780420 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f0ba4-5a08-4daa-9b93-8bb6494b42ee admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:34.819796 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1095/2182] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:34 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:34.821311 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ca66d-3c93-400d-bc34-3ee74c8c85ed admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:34.832715 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ca66d-3c93-400d-bc34-3ee74c8c85ed admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:34.898394 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd4fb7-f699-4e56-a1c2-fd9e3ddcfa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:34.899453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd4fb7-f699-4e56-a1c2-fd9e3ddcfa68 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:34.899895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd4fb7-f699-4e56-a1c2-fd9e3ddcfa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:34.900317 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd4fb7-f699-4e56-a1c2-fd9e3ddcfa68 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:34.901274 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd4fb7-f699-4e56-a1c2-fd9e3ddcfa68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:34.903258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd4fb7-f699-4e56-a1c2-fd9e3ddcfa68 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:34.923606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:34.938656 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1088/2183] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:34 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:34.942918 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f0ba4-5a08-4daa-9b93-8bb6494b42ee admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:34.956027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f0ba4-5a08-4daa-9b93-8bb6494b42ee admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:34.961109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b3e7e-f816-4dcd-abba-7700701b8876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:34.961997 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b3e7e-f816-4dcd-abba-7700701b8876 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:34.962228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b3e7e-f816-4dcd-abba-7700701b8876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:34.962512 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b3e7e-f816-4dcd-abba-7700701b8876 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:34.963223 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b3e7e-f816-4dcd-abba-7700701b8876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:34.965055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b3e7e-f816-4dcd-abba-7700701b8876 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:34.978238 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1096/2184] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:34.979471 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd4fb7-f699-4e56-a1c2-fd9e3ddcfa68 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:34.990018 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd4fb7-f699-4e56-a1c2-fd9e3ddcfa68 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:34.994704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bd54d-9035-4f0b-82f4-1a0722da6fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:34.995331 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bd54d-9035-4f0b-82f4-1a0722da6fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:34.995616 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bd54d-9035-4f0b-82f4-1a0722da6fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:34.995894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bd54d-9035-4f0b-82f4-1a0722da6fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:34.996549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bd54d-9035-4f0b-82f4-1a0722da6fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:34.998157 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bd54d-9035-4f0b-82f4-1a0722da6fc2 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:35.009261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1089/2185] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:35.013477 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b3e7e-f816-4dcd-abba-7700701b8876 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:35.024134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b3e7e-f816-4dcd-abba-7700701b8876 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:35.028696 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e7e46-362f-41c3-a639-f61c266546b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:35.029364 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e7e46-362f-41c3-a639-f61c266546b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:35.029623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e7e46-362f-41c3-a639-f61c266546b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:35.029904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e7e46-362f-41c3-a639-f61c266546b7 admin admin] PATH_INFO: `/v3/projects/4be442674dac4b70a7693c5a76ea3694/users/08690c0c920a4a71904d19acaae0141e/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:35.043901 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e7e46-362f-41c3-a639-f61c266546b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be442674dac4b70a7693c5a76ea3694, user_id=08690c0c920a4a71904d19acaae0141e, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:35.046553 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e7e46-362f-41c3-a639-f61c266546b7 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:35.060170 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1097/2186] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:35 2022] PUT /identity/v3/projects/4be442674dac4b70a7693c5a76ea3694/users/08690c0c920a4a71904d19acaae0141e/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:35.070947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a24080-d63c-4c6b-969b-3873a35471d5 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:35.071242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a24080-d63c-4c6b-969b-3873a35471d5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:35.071523 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a24080-d63c-4c6b-969b-3873a35471d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:35.099901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-43a24080-d63c-4c6b-969b-3873a35471d5 None None] MFA Rules not processed for user `08690c0c920a4a71904d19acaae0141e`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:35.101110 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-43a24080-d63c-4c6b-969b-3873a35471d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:35.170597 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1090/2187] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:35.175387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e7e46-362f-41c3-a639-f61c266546b7 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:35.258347 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e7e46-362f-41c3-a639-f61c266546b7 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:35.264058 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69422cdc-e9e1-4c44-9ef9-2c49cd92a61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:35.264704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69422cdc-e9e1-4c44-9ef9-2c49cd92a61a admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:35.264988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69422cdc-e9e1-4c44-9ef9-2c49cd92a61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:35.265267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69422cdc-e9e1-4c44-9ef9-2c49cd92a61a admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:35.265958 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69422cdc-e9e1-4c44-9ef9-2c49cd92a61a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:35.268181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69422cdc-e9e1-4c44-9ef9-2c49cd92a61a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:35.272957 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:35.305868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1098/2188] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:35 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:35.309782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a24080-d63c-4c6b-969b-3873a35471d5 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:35.321404 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a24080-d63c-4c6b-969b-3873a35471d5 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:35.388722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5e1c8-26f5-486c-8976-afc6edceafc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:35.389435 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5e1c8-26f5-486c-8976-afc6edceafc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:35.389732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5e1c8-26f5-486c-8976-afc6edceafc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:35.390014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5e1c8-26f5-486c-8976-afc6edceafc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:35.390698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5e1c8-26f5-486c-8976-afc6edceafc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:35.392681 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5e1c8-26f5-486c-8976-afc6edceafc9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:35.427906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1091/2189] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:35 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:35.432817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69422cdc-e9e1-4c44-9ef9-2c49cd92a61a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:35.451433 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69422cdc-e9e1-4c44-9ef9-2c49cd92a61a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:35.460569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c21010-0e09-46f9-b0d6-f921c144ee34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:35.460569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c21010-0e09-46f9-b0d6-f921c144ee34 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:35.460569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c21010-0e09-46f9-b0d6-f921c144ee34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:35.460569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c21010-0e09-46f9-b0d6-f921c144ee34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:35.461150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c21010-0e09-46f9-b0d6-f921c144ee34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:35.462876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c21010-0e09-46f9-b0d6-f921c144ee34 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:35.473522 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1099/2190] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:35.477684 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5e1c8-26f5-486c-8976-afc6edceafc9 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:35.488643 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5e1c8-26f5-486c-8976-afc6edceafc9 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:35.494525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a03be-1037-4e98-b43f-5bd34c007379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:35.495229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a03be-1037-4e98-b43f-5bd34c007379 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:35.495518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a03be-1037-4e98-b43f-5bd34c007379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:35.495869 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a03be-1037-4e98-b43f-5bd34c007379 admin admin] PATH_INFO: `/v3/projects/23b621a3559844fab3e5befc5e4c47ad/users/0505e87ba51747588741731b44418e2c/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:35.511584 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a03be-1037-4e98-b43f-5bd34c007379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b621a3559844fab3e5befc5e4c47ad, user_id=0505e87ba51747588741731b44418e2c, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:35.514281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a03be-1037-4e98-b43f-5bd34c007379 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:35.527337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1092/2191] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:35 2022] PUT /identity/v3/projects/23b621a3559844fab3e5befc5e4c47ad/users/0505e87ba51747588741731b44418e2c/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:35.531373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c21010-0e09-46f9-b0d6-f921c144ee34 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:35.541504 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c21010-0e09-46f9-b0d6-f921c144ee34 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:35.599319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c15de5-a4ce-4de1-9abc-f97b49b5596a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:35.599929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c15de5-a4ce-4de1-9abc-f97b49b5596a admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:35.600228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c15de5-a4ce-4de1-9abc-f97b49b5596a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:35.600508 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c15de5-a4ce-4de1-9abc-f97b49b5596a admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:35.601167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c15de5-a4ce-4de1-9abc-f97b49b5596a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:35.602812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c15de5-a4ce-4de1-9abc-f97b49b5596a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:35.613478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1100/2192] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:35.617921 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a03be-1037-4e98-b43f-5bd34c007379 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:35.628213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a03be-1037-4e98-b43f-5bd34c007379 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:35.632917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efcc66-2594-4c0b-9ec1-0f30ce939f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:35.633556 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efcc66-2594-4c0b-9ec1-0f30ce939f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:35.633836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efcc66-2594-4c0b-9ec1-0f30ce939f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:35.634112 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efcc66-2594-4c0b-9ec1-0f30ce939f69 admin admin] PATH_INFO: `/v3/projects/23b621a3559844fab3e5befc5e4c47ad/users/0505e87ba51747588741731b44418e2c/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:35.636138 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efcc66-2594-4c0b-9ec1-0f30ce939f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b621a3559844fab3e5befc5e4c47ad, user_id=0505e87ba51747588741731b44418e2c, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:35.638784 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efcc66-2594-4c0b-9ec1-0f30ce939f69 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:35.648673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1093/2193] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:35 2022] PUT /identity/v3/projects/23b621a3559844fab3e5befc5e4c47ad/users/0505e87ba51747588741731b44418e2c/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:35.659331 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c58e4-efdb-4d36-abff-0c3f701c20e1 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:35.659622 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c58e4-efdb-4d36-abff-0c3f701c20e1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:35.659896 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c58e4-efdb-4d36-abff-0c3f701c20e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:35.687427 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-813c58e4-efdb-4d36-abff-0c3f701c20e1 None None] MFA Rules not processed for user `0505e87ba51747588741731b44418e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:35.688808 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-813c58e4-efdb-4d36-abff-0c3f701c20e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:35.755127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1101/2194] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:35.766680 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efcc66-2594-4c0b-9ec1-0f30ce939f69 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:35.768534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-97efcc66-2594-4c0b-9ec1-0f30ce939f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:35.804148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:35.829875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efcc66-2594-4c0b-9ec1-0f30ce939f69 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:35.833745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fc0d2-4234-4aeb-a348-7427f84370ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:35.834350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fc0d2-4234-4aeb-a348-7427f84370ce service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:35.834631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fc0d2-4234-4aeb-a348-7427f84370ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:35.834933 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fc0d2-4234-4aeb-a348-7427f84370ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:35.844886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fc0d2-4234-4aeb-a348-7427f84370ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:35.846409 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fc0d2-4234-4aeb-a348-7427f84370ce service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:35.856049 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1094/2195] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:35.903602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c58e4-efdb-4d36-abff-0c3f701c20e1 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:35.913689 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c58e4-efdb-4d36-abff-0c3f701c20e1 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:35.917453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cc386-acd1-4455-a34d-0d9d011443d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:35.918223 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cc386-acd1-4455-a34d-0d9d011443d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:35.918573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cc386-acd1-4455-a34d-0d9d011443d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:35.918909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cc386-acd1-4455-a34d-0d9d011443d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:35.977533 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:35.982537 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cc386-acd1-4455-a34d-0d9d011443d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:35.984671 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cc386-acd1-4455-a34d-0d9d011443d4 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:35.997032 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1102/2196] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:37.700630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fc0d2-4234-4aeb-a348-7427f84370ce service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:37.703028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-326fc0d2-4234-4aeb-a348-7427f84370ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:37.846525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fc0d2-4234-4aeb-a348-7427f84370ce service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:37.854753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9fe04-82c4-4ca6-ac2e-6099ac92c83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:37.855828 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9fe04-82c4-4ca6-ac2e-6099ac92c83b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:37.856055 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9fe04-82c4-4ca6-ac2e-6099ac92c83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:37.856592 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9fe04-82c4-4ca6-ac2e-6099ac92c83b admin admin] PATH_INFO: `/v3/users/1554bf91db02408d9bab53a5e82e4b7c` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:37.858361 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9fe04-82c4-4ca6-ac2e-6099ac92c83b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1554bf91db02408d9bab53a5e82e4b7c)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:37.868264 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9fe04-82c4-4ca6-ac2e-6099ac92c83b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:37.940469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9be9fe04-82c4-4ca6-ac2e-6099ac92c83b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1554bf91db02408d9bab53a5e82e4b7c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:37.948369 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9be9fe04-82c4-4ca6-ac2e-6099ac92c83b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1554bf91db02408d9bab53a5e82e4b7c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:37.950082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9be9fe04-82c4-4ca6-ac2e-6099ac92c83b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1554bf91db02408d9bab53a5e82e4b7c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:37.966909 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9be9fe04-82c4-4ca6-ac2e-6099ac92c83b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1554bf91db02408d9bab53a5e82e4b7c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:37.984026 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9be9fe04-82c4-4ca6-ac2e-6099ac92c83b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1554bf91db02408d9bab53a5e82e4b7c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:38.008308 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1095/2197] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:37 2022] DELETE /identity/v3/users/1554bf91db02408d9bab53a5e82e4b7c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:38.012691 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed0e16-f839-44d0-ae7a-36a54e05a5e1 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:38.013159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed0e16-f839-44d0-ae7a-36a54e05a5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:38.013276 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed0e16-f839-44d0-ae7a-36a54e05a5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:38.034141 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-01ed0e16-f839-44d0-ae7a-36a54e05a5e1 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:38.035376 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-01ed0e16-f839-44d0-ae7a-36a54e05a5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:38.106504 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1103/2198] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:38.117431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9fe04-82c4-4ca6-ac2e-6099ac92c83b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:38.118975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9be9fe04-82c4-4ca6-ac2e-6099ac92c83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:38.216206 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9fe04-82c4-4ca6-ac2e-6099ac92c83b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:38.221831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5aeda8-b363-49d4-a77b-c5e473d384fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:38.222586 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5aeda8-b363-49d4-a77b-c5e473d384fd service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:38.222963 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5aeda8-b363-49d4-a77b-c5e473d384fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:38.223454 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5aeda8-b363-49d4-a77b-c5e473d384fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:38.232830 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:38.244784 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5aeda8-b363-49d4-a77b-c5e473d384fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:38.247146 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5aeda8-b363-49d4-a77b-c5e473d384fd service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:38.261064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1096/2199] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:38.598884 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed0e16-f839-44d0-ae7a-36a54e05a5e1 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:38.600329 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-01ed0e16-f839-44d0-ae7a-36a54e05a5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:38.615169 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed0e16-f839-44d0-ae7a-36a54e05a5e1 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:38.624495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2239080-633e-4002-bda8-d4ca46b6f376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:38.625213 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2239080-633e-4002-bda8-d4ca46b6f376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:38.626035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2239080-633e-4002-bda8-d4ca46b6f376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:38.626177 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2239080-633e-4002-bda8-d4ca46b6f376 admin admin] PATH_INFO: `/v3/projects/18382fe4fad742dbadaf4044162ae4ce` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:38.627346 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2239080-633e-4002-bda8-d4ca46b6f376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18382fe4fad742dbadaf4044162ae4ce)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:38.629268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2239080-633e-4002-bda8-d4ca46b6f376 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:38.676816 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d2239080-633e-4002-bda8-d4ca46b6f376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18382fe4fad742dbadaf4044162ae4ce', 'request_id': 'req-d2239080-633e-4002-bda8-d4ca46b6f376'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:38.683445 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d2239080-633e-4002-bda8-d4ca46b6f376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18382fe4fad742dbadaf4044162ae4ce', 'request_id': 'req-d2239080-633e-4002-bda8-d4ca46b6f376'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:38.691391 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d2239080-633e-4002-bda8-d4ca46b6f376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18382fe4fad742dbadaf4044162ae4ce', 'request_id': 'req-d2239080-633e-4002-bda8-d4ca46b6f376'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:38.702212 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d2239080-633e-4002-bda8-d4ca46b6f376 admin admin] The token cache is being invalidate because project 18382fe4fad742dbadaf4044162ae4ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:38.702499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d2239080-633e-4002-bda8-d4ca46b6f376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:38.703142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d2239080-633e-4002-bda8-d4ca46b6f376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:38.705521 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1104/2200] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:38 2022] DELETE /identity/v3/projects/18382fe4fad742dbadaf4044162ae4ce => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:40.092251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5aeda8-b363-49d4-a77b-c5e473d384fd service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:40.094108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3a5aeda8-b363-49d4-a77b-c5e473d384fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:40.114343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5aeda8-b363-49d4-a77b-c5e473d384fd service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:40.179535 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5afc37-0eb6-4134-94dc-31f724264b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:40.180407 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5afc37-0eb6-4134-94dc-31f724264b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:40.180955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5afc37-0eb6-4134-94dc-31f724264b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:40.182010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5afc37-0eb6-4134-94dc-31f724264b55 admin admin] PATH_INFO: `/v3/users/08690c0c920a4a71904d19acaae0141e` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:40.183927 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5afc37-0eb6-4134-94dc-31f724264b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08690c0c920a4a71904d19acaae0141e)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:40.187737 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5afc37-0eb6-4134-94dc-31f724264b55 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:40.255104 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6b5afc37-0eb6-4134-94dc-31f724264b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08690c0c920a4a71904d19acaae0141e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:40.257807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6b5afc37-0eb6-4134-94dc-31f724264b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08690c0c920a4a71904d19acaae0141e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:40.259128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6b5afc37-0eb6-4134-94dc-31f724264b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08690c0c920a4a71904d19acaae0141e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:40.272037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6b5afc37-0eb6-4134-94dc-31f724264b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08690c0c920a4a71904d19acaae0141e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:40.279397 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6b5afc37-0eb6-4134-94dc-31f724264b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08690c0c920a4a71904d19acaae0141e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:40.285827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1097/2201] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:40 2022] DELETE /identity/v3/users/08690c0c920a4a71904d19acaae0141e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:40.290335 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f346c13-09cf-45bc-bf11-e9693988114e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:40.290851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f346c13-09cf-45bc-bf11-e9693988114e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:40.290956 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f346c13-09cf-45bc-bf11-e9693988114e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:40.311198 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8f346c13-09cf-45bc-bf11-e9693988114e None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:40.312506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8f346c13-09cf-45bc-bf11-e9693988114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:40.374886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1105/2202] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:40.384997 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5afc37-0eb6-4134-94dc-31f724264b55 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:40.386405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6b5afc37-0eb6-4134-94dc-31f724264b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:40.452028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5afc37-0eb6-4134-94dc-31f724264b55 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:40.456396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bf063-7753-442e-96de-58d3d46315f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:40.457350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bf063-7753-442e-96de-58d3d46315f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:40.457350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bf063-7753-442e-96de-58d3d46315f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:40.457618 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bf063-7753-442e-96de-58d3d46315f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:40.467103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bf063-7753-442e-96de-58d3d46315f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:40.468509 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bf063-7753-442e-96de-58d3d46315f1 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:40.478788 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1098/2203] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:40.634815 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f346c13-09cf-45bc-bf11-e9693988114e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:40.636516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8f346c13-09cf-45bc-bf11-e9693988114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:40.650913 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f346c13-09cf-45bc-bf11-e9693988114e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:40.657087 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc56c3-ac19-480e-aa03-4afec8f5d6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:40.658096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc56c3-ac19-480e-aa03-4afec8f5d6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:40.658480 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc56c3-ac19-480e-aa03-4afec8f5d6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:40.659700 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc56c3-ac19-480e-aa03-4afec8f5d6bf admin admin] PATH_INFO: `/v3/users/12d1cff1fb214cf88b352c3be3153afa` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:40.660977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc56c3-ac19-480e-aa03-4afec8f5d6bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d1cff1fb214cf88b352c3be3153afa)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:40.663460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc56c3-ac19-480e-aa03-4afec8f5d6bf admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:40.680650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:40.728892 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-80fc56c3-ac19-480e-aa03-4afec8f5d6bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d1cff1fb214cf88b352c3be3153afa'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:40.737834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-80fc56c3-ac19-480e-aa03-4afec8f5d6bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d1cff1fb214cf88b352c3be3153afa'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:40.752037 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-80fc56c3-ac19-480e-aa03-4afec8f5d6bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d1cff1fb214cf88b352c3be3153afa'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:40.752765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-80fc56c3-ac19-480e-aa03-4afec8f5d6bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d1cff1fb214cf88b352c3be3153afa'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:40.764762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-80fc56c3-ac19-480e-aa03-4afec8f5d6bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d1cff1fb214cf88b352c3be3153afa'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:40.777061 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1106/2204] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:40 2022] DELETE /identity/v3/users/12d1cff1fb214cf88b352c3be3153afa => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:40.778658 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c8122-2350-4158-b269-ff354b3979be None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:40.778989 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c8122-2350-4158-b269-ff354b3979be None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:40.779308 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c8122-2350-4158-b269-ff354b3979be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:40.785933 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc56c3-ac19-480e-aa03-4afec8f5d6bf admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:40.787911 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-80fc56c3-ac19-480e-aa03-4afec8f5d6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:40.801015 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c49c8122-2350-4158-b269-ff354b3979be None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:40.802310 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c49c8122-2350-4158-b269-ff354b3979be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:40.816932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:40.888735 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1099/2205] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:40.891821 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc56c3-ac19-480e-aa03-4afec8f5d6bf admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:40.895729 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c8122-2350-4158-b269-ff354b3979be None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:40.897477 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c49c8122-2350-4158-b269-ff354b3979be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:40.898329 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d8dc5-abc6-4e96-8be8-40adf8dcfd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:40.899115 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d8dc5-abc6-4e96-8be8-40adf8dcfd0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:40.899465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d8dc5-abc6-4e96-8be8-40adf8dcfd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:40.899809 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d8dc5-abc6-4e96-8be8-40adf8dcfd0f admin admin] PATH_INFO: `/v3/projects/4be442674dac4b70a7693c5a76ea3694` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:40.900990 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d8dc5-abc6-4e96-8be8-40adf8dcfd0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be442674dac4b70a7693c5a76ea3694)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:40.903339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d8dc5-abc6-4e96-8be8-40adf8dcfd0f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:40.967428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c8122-2350-4158-b269-ff354b3979be None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:40.968232 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-774d8dc5-abc6-4e96-8be8-40adf8dcfd0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be442674dac4b70a7693c5a76ea3694', 'request_id': 'req-774d8dc5-abc6-4e96-8be8-40adf8dcfd0f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:40.975134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-774d8dc5-abc6-4e96-8be8-40adf8dcfd0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be442674dac4b70a7693c5a76ea3694', 'request_id': 'req-774d8dc5-abc6-4e96-8be8-40adf8dcfd0f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:40.984593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-774d8dc5-abc6-4e96-8be8-40adf8dcfd0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be442674dac4b70a7693c5a76ea3694', 'request_id': 'req-774d8dc5-abc6-4e96-8be8-40adf8dcfd0f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:40.999230 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-774d8dc5-abc6-4e96-8be8-40adf8dcfd0f admin admin] The token cache is being invalidate because project 4be442674dac4b70a7693c5a76ea3694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:40.999801 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-774d8dc5-abc6-4e96-8be8-40adf8dcfd0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.000319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-774d8dc5-abc6-4e96-8be8-40adf8dcfd0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.002776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1107/2206] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:40 2022] DELETE /identity/v3/projects/4be442674dac4b70a7693c5a76ea3694 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:41.007662 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d8dc5-abc6-4e96-8be8-40adf8dcfd0f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:41.009393 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-774d8dc5-abc6-4e96-8be8-40adf8dcfd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:41.041162 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:41.042902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced09727-ed7a-4f95-aad6-af2558895a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:41.043837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced09727-ed7a-4f95-aad6-af2558895a53 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:41.044177 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced09727-ed7a-4f95-aad6-af2558895a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:41.044545 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced09727-ed7a-4f95-aad6-af2558895a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:41.046518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ced09727-ed7a-4f95-aad6-af2558895a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:41.124871 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d8dc5-abc6-4e96-8be8-40adf8dcfd0f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:41.129761 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc17894-98fd-4a64-8946-9b73ca9ab758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:41.130397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc17894-98fd-4a64-8946-9b73ca9ab758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:41.130680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc17894-98fd-4a64-8946-9b73ca9ab758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:41.130988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc17894-98fd-4a64-8946-9b73ca9ab758 admin admin] PATH_INFO: `/v3/users/0505e87ba51747588741731b44418e2c` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:41.132167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc17894-98fd-4a64-8946-9b73ca9ab758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0505e87ba51747588741731b44418e2c)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:41.134131 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc17894-98fd-4a64-8946-9b73ca9ab758 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:41.136069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced09727-ed7a-4f95-aad6-af2558895a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:41.137597 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced09727-ed7a-4f95-aad6-af2558895a53 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:41.147404 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1100/2207] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:41.211389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8dc17894-98fd-4a64-8946-9b73ca9ab758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0505e87ba51747588741731b44418e2c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.220945 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8dc17894-98fd-4a64-8946-9b73ca9ab758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0505e87ba51747588741731b44418e2c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.261332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8dc17894-98fd-4a64-8946-9b73ca9ab758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0505e87ba51747588741731b44418e2c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.262270 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8dc17894-98fd-4a64-8946-9b73ca9ab758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0505e87ba51747588741731b44418e2c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.274550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8dc17894-98fd-4a64-8946-9b73ca9ab758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0505e87ba51747588741731b44418e2c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.287603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1108/2208] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:41 2022] DELETE /identity/v3/users/0505e87ba51747588741731b44418e2c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:41.576230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced09727-ed7a-4f95-aad6-af2558895a53 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:41.577919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ced09727-ed7a-4f95-aad6-af2558895a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:41.591872 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced09727-ed7a-4f95-aad6-af2558895a53 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:41.616934 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:41.665095 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc17894-98fd-4a64-8946-9b73ca9ab758 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:41.666942 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8dc17894-98fd-4a64-8946-9b73ca9ab758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:41.674223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76d2af-12f7-42f0-a041-c14ef4bd4b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:41.675516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76d2af-12f7-42f0-a041-c14ef4bd4b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:41.675811 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76d2af-12f7-42f0-a041-c14ef4bd4b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:41.676104 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76d2af-12f7-42f0-a041-c14ef4bd4b3a admin admin] PATH_INFO: `/v3/projects/3a04934e28454091bea6b1933eb01d5e` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:41.677675 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76d2af-12f7-42f0-a041-c14ef4bd4b3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a04934e28454091bea6b1933eb01d5e)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:41.682317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc17894-98fd-4a64-8946-9b73ca9ab758 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:41.683520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76d2af-12f7-42f0-a041-c14ef4bd4b3a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:41.688042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560e91e-ce6a-4a24-a985-6236a3bbba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:41.689279 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560e91e-ce6a-4a24-a985-6236a3bbba4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:41.689567 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560e91e-ce6a-4a24-a985-6236a3bbba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:41.689901 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560e91e-ce6a-4a24-a985-6236a3bbba4a admin admin] PATH_INFO: `/v3/projects/23b621a3559844fab3e5befc5e4c47ad` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:41.691592 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560e91e-ce6a-4a24-a985-6236a3bbba4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b621a3559844fab3e5befc5e4c47ad)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:41.694100 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560e91e-ce6a-4a24-a985-6236a3bbba4a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:41.737491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0b76d2af-12f7-42f0-a041-c14ef4bd4b3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a04934e28454091bea6b1933eb01d5e', 'request_id': 'req-0b76d2af-12f7-42f0-a041-c14ef4bd4b3a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.744221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0b76d2af-12f7-42f0-a041-c14ef4bd4b3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a04934e28454091bea6b1933eb01d5e', 'request_id': 'req-0b76d2af-12f7-42f0-a041-c14ef4bd4b3a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.748964 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6560e91e-ce6a-4a24-a985-6236a3bbba4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b621a3559844fab3e5befc5e4c47ad', 'request_id': 'req-6560e91e-ce6a-4a24-a985-6236a3bbba4a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.753036 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0b76d2af-12f7-42f0-a041-c14ef4bd4b3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a04934e28454091bea6b1933eb01d5e', 'request_id': 'req-0b76d2af-12f7-42f0-a041-c14ef4bd4b3a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.758562 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6560e91e-ce6a-4a24-a985-6236a3bbba4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b621a3559844fab3e5befc5e4c47ad', 'request_id': 'req-6560e91e-ce6a-4a24-a985-6236a3bbba4a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.767631 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6560e91e-ce6a-4a24-a985-6236a3bbba4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b621a3559844fab3e5befc5e4c47ad', 'request_id': 'req-6560e91e-ce6a-4a24-a985-6236a3bbba4a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.768190 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0b76d2af-12f7-42f0-a041-c14ef4bd4b3a admin admin] The token cache is being invalidate because project 3a04934e28454091bea6b1933eb01d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:41.768483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0b76d2af-12f7-42f0-a041-c14ef4bd4b3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.769108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0b76d2af-12f7-42f0-a041-c14ef4bd4b3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.770588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1101/2209] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:41 2022] DELETE /identity/v3/projects/3a04934e28454091bea6b1933eb01d5e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:41.774558 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76d2af-12f7-42f0-a041-c14ef4bd4b3a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:41.776196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0b76d2af-12f7-42f0-a041-c14ef4bd4b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:41.778674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6560e91e-ce6a-4a24-a985-6236a3bbba4a admin admin] The token cache is being invalidate because project 23b621a3559844fab3e5befc5e4c47ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:41.779000 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6560e91e-ce6a-4a24-a985-6236a3bbba4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.779621 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6560e91e-ce6a-4a24-a985-6236a3bbba4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.781075 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1109/2210] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:41 2022] DELETE /identity/v3/projects/23b621a3559844fab3e5befc5e4c47ad => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:41.785579 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ebffc-55ab-47a8-861c-045539c03537 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:41.785859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ebffc-55ab-47a8-861c-045539c03537 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:41.786259 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ebffc-55ab-47a8-861c-045539c03537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:41.805017 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f72ebffc-55ab-47a8-861c-045539c03537 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:41.806400 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f72ebffc-55ab-47a8-861c-045539c03537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:41.835543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:41.842080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76d2af-12f7-42f0-a041-c14ef4bd4b3a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:41.878378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1110/2211] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:41.886471 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f3c86-04e2-4ed3-a2ac-d194e7741909 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:41.886786 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f3c86-04e2-4ed3-a2ac-d194e7741909 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:41.887142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f3c86-04e2-4ed3-a2ac-d194e7741909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:41.905438 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7e7c4-6dd4-4371-aeed-15731220b75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:41.906225 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7e7c4-6dd4-4371-aeed-15731220b75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:41.906509 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7e7c4-6dd4-4371-aeed-15731220b75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:41.906820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7e7c4-6dd4-4371-aeed-15731220b75c admin admin] PATH_INFO: `/v3/users/7d039ef9bf0443178262056aa4b33230` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:41.907184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-105f3c86-04e2-4ed3-a2ac-d194e7741909 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:41.908003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7e7c4-6dd4-4371-aeed-15731220b75c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d039ef9bf0443178262056aa4b33230)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:41.908406 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-105f3c86-04e2-4ed3-a2ac-d194e7741909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:41.909931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7e7c4-6dd4-4371-aeed-15731220b75c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:41.912373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:41.916838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1111/2212] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:41.921363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f3c86-04e2-4ed3-a2ac-d194e7741909 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:41.931342 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f3c86-04e2-4ed3-a2ac-d194e7741909 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:41.937110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4619f-bfe7-4c2b-a095-d32110fb7a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:41.937884 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4619f-bfe7-4c2b-a095-d32110fb7a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:41.938283 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4619f-bfe7-4c2b-a095-d32110fb7a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:41.938562 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4619f-bfe7-4c2b-a095-d32110fb7a7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:41.939902 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4619f-bfe7-4c2b-a095-d32110fb7a7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:21:41.940151 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4619f-bfe7-4c2b-a095-d32110fb7a7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:41.941831 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4619f-bfe7-4c2b-a095-d32110fb7a7b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:41.954708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1112/2213] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:21:41.958973 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4619f-bfe7-4c2b-a095-d32110fb7a7b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:41.964186 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e5d7e7c4-6dd4-4371-aeed-15731220b75c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d039ef9bf0443178262056aa4b33230'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.968449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4619f-bfe7-4c2b-a095-d32110fb7a7b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:41.972500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e5d7e7c4-6dd4-4371-aeed-15731220b75c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d039ef9bf0443178262056aa4b33230'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.973174 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e5d7e7c4-6dd4-4371-aeed-15731220b75c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d039ef9bf0443178262056aa4b33230'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.973458 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84d8b4-b02f-4321-9771-5255e6778c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:41.974036 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84d8b4-b02f-4321-9771-5255e6778c44 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:41.974320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84d8b4-b02f-4321-9771-5255e6778c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:41.974595 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84d8b4-b02f-4321-9771-5255e6778c44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:41.975250 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84d8b4-b02f-4321-9771-5255e6778c44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:41.977126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84d8b4-b02f-4321-9771-5255e6778c44 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:41.985334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e5d7e7c4-6dd4-4371-aeed-15731220b75c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d039ef9bf0443178262056aa4b33230'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:41.996159 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e5d7e7c4-6dd4-4371-aeed-15731220b75c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d039ef9bf0443178262056aa4b33230'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:42.004110 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1102/2214] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:41 2022] DELETE /identity/v3/users/7d039ef9bf0443178262056aa4b33230 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:42.007245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1113/2215] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:41 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:42.010761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7e7c4-6dd4-4371-aeed-15731220b75c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:42.012308 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e5d7e7c4-6dd4-4371-aeed-15731220b75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:42.086543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7e7c4-6dd4-4371-aeed-15731220b75c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:42.169018 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff98ac5-23c0-4a24-a5bf-6e9cabc97161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:42.169692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff98ac5-23c0-4a24-a5bf-6e9cabc97161 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:42.169900 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff98ac5-23c0-4a24-a5bf-6e9cabc97161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:42.170248 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff98ac5-23c0-4a24-a5bf-6e9cabc97161 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:42.170848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff98ac5-23c0-4a24-a5bf-6e9cabc97161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:42.172787 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff98ac5-23c0-4a24-a5bf-6e9cabc97161 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:42.198828 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1103/2216] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:42 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:42.202009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84d8b4-b02f-4321-9771-5255e6778c44 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:42.212511 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84d8b4-b02f-4321-9771-5255e6778c44 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:42.217310 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b25eaa-7b6a-46f2-9c3d-102c8e6f074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:42.217925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b25eaa-7b6a-46f2-9c3d-102c8e6f074a admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:42.218190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b25eaa-7b6a-46f2-9c3d-102c8e6f074a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:42.218465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b25eaa-7b6a-46f2-9c3d-102c8e6f074a admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:42.219150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b25eaa-7b6a-46f2-9c3d-102c8e6f074a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:42.220784 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b25eaa-7b6a-46f2-9c3d-102c8e6f074a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:42.231772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1114/2217] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:42.236322 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff98ac5-23c0-4a24-a5bf-6e9cabc97161 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:42.246268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff98ac5-23c0-4a24-a5bf-6e9cabc97161 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:42.251102 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbee641-63bf-4d06-a8b2-1fdd7d4dd083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:42.252990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbee641-63bf-4d06-a8b2-1fdd7d4dd083 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:42.253275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbee641-63bf-4d06-a8b2-1fdd7d4dd083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:42.253547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbee641-63bf-4d06-a8b2-1fdd7d4dd083 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:42.254197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbee641-63bf-4d06-a8b2-1fdd7d4dd083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:42.255857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbee641-63bf-4d06-a8b2-1fdd7d4dd083 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:42.265754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1104/2218] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:42.269808 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b25eaa-7b6a-46f2-9c3d-102c8e6f074a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:42.279636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b25eaa-7b6a-46f2-9c3d-102c8e6f074a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:42.284917 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698ffaa-c3be-4ef4-84d5-612b3dd58354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:42.285645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698ffaa-c3be-4ef4-84d5-612b3dd58354 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:42.285923 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698ffaa-c3be-4ef4-84d5-612b3dd58354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:42.286197 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698ffaa-c3be-4ef4-84d5-612b3dd58354 admin admin] PATH_INFO: `/v3/projects/638973de0ba248ea867a2f5d9339f0d6/users/8c3d988f8b57434ab4b12c44735b1628/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:42.307941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698ffaa-c3be-4ef4-84d5-612b3dd58354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638973de0ba248ea867a2f5d9339f0d6, user_id=8c3d988f8b57434ab4b12c44735b1628, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:42.310652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698ffaa-c3be-4ef4-84d5-612b3dd58354 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:42.313548 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbee641-63bf-4d06-a8b2-1fdd7d4dd083 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:42.315471 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1fbee641-63bf-4d06-a8b2-1fdd7d4dd083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:42.329826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbee641-63bf-4d06-a8b2-1fdd7d4dd083 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:42.334171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:42.335415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1115/2219] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:42 2022] PUT /identity/v3/projects/638973de0ba248ea867a2f5d9339f0d6/users/8c3d988f8b57434ab4b12c44735b1628/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:42.337389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c76aa-7295-413e-9d2c-07ebeeaa7725 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:42.337389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c76aa-7295-413e-9d2c-07ebeeaa7725 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:42.337389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c76aa-7295-413e-9d2c-07ebeeaa7725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:42.370151 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c22c76aa-7295-413e-9d2c-07ebeeaa7725 None None] MFA Rules not processed for user `8c3d988f8b57434ab4b12c44735b1628`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:42.371405 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c22c76aa-7295-413e-9d2c-07ebeeaa7725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:42.406878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc13af-f45b-403e-816c-2199baa43295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:42.408118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc13af-f45b-403e-816c-2199baa43295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:42.408406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc13af-f45b-403e-816c-2199baa43295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:42.408684 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc13af-f45b-403e-816c-2199baa43295 admin admin] PATH_INFO: `/v3/projects/7e766c6d23c34d0b956e7cbe96ee65b0` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:42.409870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc13af-f45b-403e-816c-2199baa43295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e766c6d23c34d0b956e7cbe96ee65b0)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:42.412866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc13af-f45b-403e-816c-2199baa43295 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:42.453867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1116/2220] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:42.458359 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c76aa-7295-413e-9d2c-07ebeeaa7725 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:42.468801 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-53dc13af-f45b-403e-816c-2199baa43295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e766c6d23c34d0b956e7cbe96ee65b0', 'request_id': 'req-53dc13af-f45b-403e-816c-2199baa43295'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:42.468998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c76aa-7295-413e-9d2c-07ebeeaa7725 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:42.475267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-53dc13af-f45b-403e-816c-2199baa43295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e766c6d23c34d0b956e7cbe96ee65b0', 'request_id': 'req-53dc13af-f45b-403e-816c-2199baa43295'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:42.481969 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-53dc13af-f45b-403e-816c-2199baa43295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e766c6d23c34d0b956e7cbe96ee65b0', 'request_id': 'req-53dc13af-f45b-403e-816c-2199baa43295'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:42.496377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-53dc13af-f45b-403e-816c-2199baa43295 admin admin] The token cache is being invalidate because project 7e766c6d23c34d0b956e7cbe96ee65b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:42.496667 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-53dc13af-f45b-403e-816c-2199baa43295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:42.497460 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-53dc13af-f45b-403e-816c-2199baa43295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:42.499187 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1105/2221] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:42 2022] DELETE /identity/v3/projects/7e766c6d23c34d0b956e7cbe96ee65b0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:42.502283 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:42.504251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e463af-801d-4d20-89f9-6e931457aabc None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:42.504601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e463af-801d-4d20-89f9-6e931457aabc None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:42.504949 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e463af-801d-4d20-89f9-6e931457aabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:42.525252 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-50e463af-801d-4d20-89f9-6e931457aabc None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:42.526511 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-50e463af-801d-4d20-89f9-6e931457aabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:42.529641 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aaa49b-d798-4e85-9d03-2ed6e3cdc4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:42.530251 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aaa49b-d798-4e85-9d03-2ed6e3cdc4ae admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:42.530529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aaa49b-d798-4e85-9d03-2ed6e3cdc4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:42.530829 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aaa49b-d798-4e85-9d03-2ed6e3cdc4ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:42.531499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aaa49b-d798-4e85-9d03-2ed6e3cdc4ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:42.533950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aaa49b-d798-4e85-9d03-2ed6e3cdc4ae admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:42.536379 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1106/2222] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:42.544119 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d55f2-f948-45d2-82b0-4909154497f2 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:42.544119 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d55f2-f948-45d2-82b0-4909154497f2 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:42.544386 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d55f2-f948-45d2-82b0-4909154497f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:42.568607 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-744d55f2-f948-45d2-82b0-4909154497f2 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:42.569245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1117/2223] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:42 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:42.572596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aaa49b-d798-4e85-9d03-2ed6e3cdc4ae admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:42.573005 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-744d55f2-f948-45d2-82b0-4909154497f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:42.574526 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e7aaa49b-d798-4e85-9d03-2ed6e3cdc4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:42.670580 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aaa49b-d798-4e85-9d03-2ed6e3cdc4ae admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:42.682235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1107/2224] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:42.683418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc96e1-73d9-4f12-a2d2-050faf60d19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:42.684285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc96e1-73d9-4f12-a2d2-050faf60d19e admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:42.684475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc96e1-73d9-4f12-a2d2-050faf60d19e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:42.684745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc96e1-73d9-4f12-a2d2-050faf60d19e admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:42.685387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc96e1-73d9-4f12-a2d2-050faf60d19e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:42.687364 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc96e1-73d9-4f12-a2d2-050faf60d19e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:42.688563 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d55f2-f948-45d2-82b0-4909154497f2 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:42.704025 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d55f2-f948-45d2-82b0-4909154497f2 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:42.709906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3f8b4-876c-47be-b053-68cb3c4cfe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:42.710594 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3f8b4-876c-47be-b053-68cb3c4cfe4b admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:42.710985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3f8b4-876c-47be-b053-68cb3c4cfe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:42.711337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3f8b4-876c-47be-b053-68cb3c4cfe4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:42.712104 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3f8b4-876c-47be-b053-68cb3c4cfe4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:21:42.712406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3f8b4-876c-47be-b053-68cb3c4cfe4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:42.714032 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3f8b4-876c-47be-b053-68cb3c4cfe4b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:42.731925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1118/2225] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:42 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:42.733172 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc96e1-73d9-4f12-a2d2-050faf60d19e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:42.734770 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1108/2226] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:21:42.739559 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3f8b4-876c-47be-b053-68cb3c4cfe4b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:42.744758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc96e1-73d9-4f12-a2d2-050faf60d19e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:42.752149 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170a10d-d6dc-4dee-9386-83f1146f6eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:42.753012 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170a10d-d6dc-4dee-9386-83f1146f6eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:42.753324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170a10d-d6dc-4dee-9386-83f1146f6eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:42.753568 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170a10d-d6dc-4dee-9386-83f1146f6eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:42.754223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3f8b4-876c-47be-b053-68cb3c4cfe4b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:42.754328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170a10d-d6dc-4dee-9386-83f1146f6eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:42.755953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170a10d-d6dc-4dee-9386-83f1146f6eb4 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:42.762539 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b6e1e-8a13-4501-843e-7db6f5dea761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:42.763231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b6e1e-8a13-4501-843e-7db6f5dea761 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:42.763521 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b6e1e-8a13-4501-843e-7db6f5dea761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:42.763803 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b6e1e-8a13-4501-843e-7db6f5dea761 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:42.764510 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b6e1e-8a13-4501-843e-7db6f5dea761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:42.766469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b6e1e-8a13-4501-843e-7db6f5dea761 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:42.778898 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1119/2227] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:42.784120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170a10d-d6dc-4dee-9386-83f1146f6eb4 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:42.784698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:42.795908 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170a10d-d6dc-4dee-9386-83f1146f6eb4 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:42.801099 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1109/2228] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:42 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:42.801945 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b414ce1-fa76-43df-a3fe-abe1a0a0fb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:42.802630 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b414ce1-fa76-43df-a3fe-abe1a0a0fb78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:42.802946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b414ce1-fa76-43df-a3fe-abe1a0a0fb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:42.803327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b414ce1-fa76-43df-a3fe-abe1a0a0fb78 admin admin] PATH_INFO: `/v3/projects/1a23a099c5324108a44630b47f2e516d/users/ede8b4b361a94a4586eb733e11fee3e2/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:42.804891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b6e1e-8a13-4501-843e-7db6f5dea761 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:42.819355 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b414ce1-fa76-43df-a3fe-abe1a0a0fb78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a23a099c5324108a44630b47f2e516d, user_id=ede8b4b361a94a4586eb733e11fee3e2, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:42.822090 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b414ce1-fa76-43df-a3fe-abe1a0a0fb78 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:42.835888 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1120/2229] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:42 2022] PUT /identity/v3/projects/1a23a099c5324108a44630b47f2e516d/users/ede8b4b361a94a4586eb733e11fee3e2/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:42.839962 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b414ce1-fa76-43df-a3fe-abe1a0a0fb78 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:42.873888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b6e1e-8a13-4501-843e-7db6f5dea761 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:42.906804 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b414ce1-fa76-43df-a3fe-abe1a0a0fb78 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:42.912720 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaaec1-4016-47df-9e5a-a6b06654bdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:42.913372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaaec1-4016-47df-9e5a-a6b06654bdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:42.913672 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaaec1-4016-47df-9e5a-a6b06654bdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:42.913947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaaec1-4016-47df-9e5a-a6b06654bdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:42.914596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbaaec1-4016-47df-9e5a-a6b06654bdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:42.916225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbaaec1-4016-47df-9e5a-a6b06654bdd9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:42.926175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1121/2230] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:42.930306 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaaec1-4016-47df-9e5a-a6b06654bdd9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:42.939932 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaaec1-4016-47df-9e5a-a6b06654bdd9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:42.940522 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052576b-4296-427c-a21f-73fce3680d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:42.941143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052576b-4296-427c-a21f-73fce3680d42 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:42.941430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052576b-4296-427c-a21f-73fce3680d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:42.941710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052576b-4296-427c-a21f-73fce3680d42 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:42.942352 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052576b-4296-427c-a21f-73fce3680d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:42.944333 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052576b-4296-427c-a21f-73fce3680d42 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:42.945625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8be1e4-af69-4f7f-997b-b94442532034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:42.946275 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8be1e4-af69-4f7f-997b-b94442532034 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:42.946558 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8be1e4-af69-4f7f-997b-b94442532034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:42.946868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8be1e4-af69-4f7f-997b-b94442532034 admin admin] PATH_INFO: `/v3/projects/1a23a099c5324108a44630b47f2e516d/users/ede8b4b361a94a4586eb733e11fee3e2/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:42.948783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8be1e4-af69-4f7f-997b-b94442532034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a23a099c5324108a44630b47f2e516d, user_id=ede8b4b361a94a4586eb733e11fee3e2, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:42.951479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8be1e4-af69-4f7f-997b-b94442532034 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:42.958966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:42.975139 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1122/2231] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:42 2022] PUT /identity/v3/projects/1a23a099c5324108a44630b47f2e516d/users/ede8b4b361a94a4586eb733e11fee3e2/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:42.975356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1110/2232] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:42 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:42.977262 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052576b-4296-427c-a21f-73fce3680d42 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:42.977779 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33d103-7aed-490d-bdb2-0f013c0bf856 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:42.978094 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33d103-7aed-490d-bdb2-0f013c0bf856 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:42.978372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33d103-7aed-490d-bdb2-0f013c0bf856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:42.987276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052576b-4296-427c-a21f-73fce3680d42 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:43.010121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ed33d103-7aed-490d-bdb2-0f013c0bf856 None None] MFA Rules not processed for user `ede8b4b361a94a4586eb733e11fee3e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:43.011371 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ed33d103-7aed-490d-bdb2-0f013c0bf856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:43.045919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c58d99-15f9-4633-b730-23e80369c1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:43.046550 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c58d99-15f9-4633-b730-23e80369c1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:43.046845 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c58d99-15f9-4633-b730-23e80369c1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:43.047123 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c58d99-15f9-4633-b730-23e80369c1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:43.047774 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c58d99-15f9-4633-b730-23e80369c1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:43.049403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c58d99-15f9-4633-b730-23e80369c1f9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:43.059314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1111/2233] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:43.062995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c58d99-15f9-4633-b730-23e80369c1f9 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:43.072890 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c58d99-15f9-4633-b730-23e80369c1f9 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:43.077609 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c0e0c-5d9f-4b8f-b58d-5ac37d1f29a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:43.078176 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c0e0c-5d9f-4b8f-b58d-5ac37d1f29a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:43.078487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c0e0c-5d9f-4b8f-b58d-5ac37d1f29a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:43.078804 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c0e0c-5d9f-4b8f-b58d-5ac37d1f29a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:43.079992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c0e0c-5d9f-4b8f-b58d-5ac37d1f29a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:43.081779 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c0e0c-5d9f-4b8f-b58d-5ac37d1f29a0 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:43.090527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1123/2234] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:43.097465 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1112/2235] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:43.098449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33d103-7aed-490d-bdb2-0f013c0bf856 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:43.104998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c0e0c-5d9f-4b8f-b58d-5ac37d1f29a0 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:43.106802 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-335c0e0c-5d9f-4b8f-b58d-5ac37d1f29a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:43.109201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33d103-7aed-490d-bdb2-0f013c0bf856 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:43.114022 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09092e-f0f5-40ca-be39-47e36ede998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:43.114670 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09092e-f0f5-40ca-be39-47e36ede998d admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:43.115012 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09092e-f0f5-40ca-be39-47e36ede998d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:43.115290 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09092e-f0f5-40ca-be39-47e36ede998d admin admin] PATH_INFO: `/v3/projects/fc03d0abf4b84f3f81b7b48b08486327/users/9d9ffa1d55ea4337938d00780f559120/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:43.127284 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:43.131163 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09092e-f0f5-40ca-be39-47e36ede998d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc03d0abf4b84f3f81b7b48b08486327, user_id=9d9ffa1d55ea4337938d00780f559120, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:43.134014 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09092e-f0f5-40ca-be39-47e36ede998d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:43.149852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1124/2236] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:43 2022] PUT /identity/v3/projects/fc03d0abf4b84f3f81b7b48b08486327/users/9d9ffa1d55ea4337938d00780f559120/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:43.161544 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e45ee-66f0-4d31-af65-9db47d4724bd None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:43.161825 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e45ee-66f0-4d31-af65-9db47d4724bd None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:43.162098 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e45ee-66f0-4d31-af65-9db47d4724bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:43.170269 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c0e0c-5d9f-4b8f-b58d-5ac37d1f29a0 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:43.191830 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-288e45ee-66f0-4d31-af65-9db47d4724bd None None] MFA Rules not processed for user `9d9ffa1d55ea4337938d00780f559120`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:43.193047 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-288e45ee-66f0-4d31-af65-9db47d4724bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:43.240009 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0161a-ca2e-4cf8-ae22-4d97f87af3cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:43.240618 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0161a-ca2e-4cf8-ae22-4d97f87af3cc service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:43.240898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0161a-ca2e-4cf8-ae22-4d97f87af3cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:43.241178 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0161a-ca2e-4cf8-ae22-4d97f87af3cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:43.259226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1125/2237] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:43.263616 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e45ee-66f0-4d31-af65-9db47d4724bd None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:43.303238 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0161a-ca2e-4cf8-ae22-4d97f87af3cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:43.304686 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0161a-ca2e-4cf8-ae22-4d97f87af3cc service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:43.312181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:43.317993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1113/2238] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:21:43.328536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e45ee-66f0-4d31-af65-9db47d4724bd None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:43.333715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b872639-b066-4be8-a5df-1385aea71171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:43.334323 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b872639-b066-4be8-a5df-1385aea71171 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:43.334605 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b872639-b066-4be8-a5df-1385aea71171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:43.334908 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b872639-b066-4be8-a5df-1385aea71171 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:43.335547 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b872639-b066-4be8-a5df-1385aea71171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:43.337462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b872639-b066-4be8-a5df-1385aea71171 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:43.368536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1126/2239] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:43 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:43.372509 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0161a-ca2e-4cf8-ae22-4d97f87af3cc service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:43.383393 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0161a-ca2e-4cf8-ae22-4d97f87af3cc service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:43.429831 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b872639-b066-4be8-a5df-1385aea71171 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:43.472960 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a81c3a-878d-408c-9d38-0b4d4f604cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:43.473568 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a81c3a-878d-408c-9d38-0b4d4f604cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:43.473849 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a81c3a-878d-408c-9d38-0b4d4f604cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:43.474125 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a81c3a-878d-408c-9d38-0b4d4f604cc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:43.474797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a81c3a-878d-408c-9d38-0b4d4f604cc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:43.476887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a81c3a-878d-408c-9d38-0b4d4f604cc3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:43.486134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b872639-b066-4be8-a5df-1385aea71171 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:43.490591 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0520e5d-9b25-4e93-9711-921d85419b05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:43.491631 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0520e5d-9b25-4e93-9711-921d85419b05 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:43.492010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0520e5d-9b25-4e93-9711-921d85419b05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:43.492361 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0520e5d-9b25-4e93-9711-921d85419b05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:43.494352 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f0520e5d-9b25-4e93-9711-921d85419b05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:43.502430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1114/2240] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:43 2022] POST /identity/v3/users => generated 300 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:43.503552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a81c3a-878d-408c-9d38-0b4d4f604cc3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:43.513882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a81c3a-878d-408c-9d38-0b4d4f604cc3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:43.519503 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e936495-4bc5-493f-aced-b5c4b51f2985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:43.520101 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e936495-4bc5-493f-aced-b5c4b51f2985 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:43.520387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e936495-4bc5-493f-aced-b5c4b51f2985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:43.520662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e936495-4bc5-493f-aced-b5c4b51f2985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:43.521315 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e936495-4bc5-493f-aced-b5c4b51f2985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:43.522941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e936495-4bc5-493f-aced-b5c4b51f2985 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:43.533683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1115/2241] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:43.537942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e936495-4bc5-493f-aced-b5c4b51f2985 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:43.542941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:43.553927 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e936495-4bc5-493f-aced-b5c4b51f2985 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:43.558856 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9867a-8c86-460e-a36c-558b39caca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:43.559525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9867a-8c86-460e-a36c-558b39caca35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:43.559809 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9867a-8c86-460e-a36c-558b39caca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:43.560087 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9867a-8c86-460e-a36c-558b39caca35 admin admin] PATH_INFO: `/v3/projects/2378386a3d6844309e7e3c92a24fe776/users/320ea3b7460649db980ab38dd45d802f/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:43.567595 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0520e5d-9b25-4e93-9711-921d85419b05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:43.569087 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0520e5d-9b25-4e93-9711-921d85419b05 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:43.575050 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9867a-8c86-460e-a36c-558b39caca35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2378386a3d6844309e7e3c92a24fe776, user_id=320ea3b7460649db980ab38dd45d802f, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:43.577718 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9867a-8c86-460e-a36c-558b39caca35 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:43.578435 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1127/2242] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:43.594460 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1116/2243] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:43 2022] PUT /identity/v3/projects/2378386a3d6844309e7e3c92a24fe776/users/320ea3b7460649db980ab38dd45d802f/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:43.599205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0520e5d-9b25-4e93-9711-921d85419b05 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:43.610295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0520e5d-9b25-4e93-9711-921d85419b05 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:43.668381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eedfdc-37ea-4613-bb00-5f1494095150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:43.668993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eedfdc-37ea-4613-bb00-5f1494095150 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:43.669267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eedfdc-37ea-4613-bb00-5f1494095150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:43.669533 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eedfdc-37ea-4613-bb00-5f1494095150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:43.670178 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eedfdc-37ea-4613-bb00-5f1494095150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:43.671828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eedfdc-37ea-4613-bb00-5f1494095150 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:43.682031 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1128/2244] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:43.686354 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9867a-8c86-460e-a36c-558b39caca35 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:43.696742 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9867a-8c86-460e-a36c-558b39caca35 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:43.701524 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508a918-ed9c-4b08-90e0-6024332e25bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:43.702179 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508a918-ed9c-4b08-90e0-6024332e25bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:43.702466 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508a918-ed9c-4b08-90e0-6024332e25bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:43.702776 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508a918-ed9c-4b08-90e0-6024332e25bb admin admin] PATH_INFO: `/v3/projects/2378386a3d6844309e7e3c92a24fe776/users/320ea3b7460649db980ab38dd45d802f/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:43.705240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508a918-ed9c-4b08-90e0-6024332e25bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2378386a3d6844309e7e3c92a24fe776, user_id=320ea3b7460649db980ab38dd45d802f, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:43.708086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508a918-ed9c-4b08-90e0-6024332e25bb admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:43.726901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1117/2245] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:43 2022] PUT /identity/v3/projects/2378386a3d6844309e7e3c92a24fe776/users/320ea3b7460649db980ab38dd45d802f/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:43.738706 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2190c-12c1-4b86-80f8-3f375d402af9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:43.739035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2190c-12c1-4b86-80f8-3f375d402af9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:43.739309 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2190c-12c1-4b86-80f8-3f375d402af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:43.774654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-34b2190c-12c1-4b86-80f8-3f375d402af9 None None] MFA Rules not processed for user `320ea3b7460649db980ab38dd45d802f`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:43.776013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-34b2190c-12c1-4b86-80f8-3f375d402af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:43.797523 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:43.923763 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1129/2246] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:43.941202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508a918-ed9c-4b08-90e0-6024332e25bb admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:43.944350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6508a918-ed9c-4b08-90e0-6024332e25bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:44.022982 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508a918-ed9c-4b08-90e0-6024332e25bb admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:44.026814 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9ecfd-8e00-4978-a397-c887a3214d33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:44.027496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9ecfd-8e00-4978-a397-c887a3214d33 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:44.027894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9ecfd-8e00-4978-a397-c887a3214d33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:44.028232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9ecfd-8e00-4978-a397-c887a3214d33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:44.037757 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9ecfd-8e00-4978-a397-c887a3214d33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:44.039327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9ecfd-8e00-4978-a397-c887a3214d33 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:44.048814 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1118/2247] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:44.077400 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2190c-12c1-4b86-80f8-3f375d402af9 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:44.139939 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2190c-12c1-4b86-80f8-3f375d402af9 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:44.145511 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f3d58-4917-45b3-85d5-cf5a4df9cc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:44.146132 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f3d58-4917-45b3-85d5-cf5a4df9cc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:44.146411 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f3d58-4917-45b3-85d5-cf5a4df9cc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:44.146685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f3d58-4917-45b3-85d5-cf5a4df9cc9e admin admin] PATH_INFO: `/v3/users/9d9ffa1d55ea4337938d00780f559120` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:44.147860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f3d58-4917-45b3-85d5-cf5a4df9cc9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d9ffa1d55ea4337938d00780f559120)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:44.149795 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f3d58-4917-45b3-85d5-cf5a4df9cc9e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:44.199205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ea9f3d58-4917-45b3-85d5-cf5a4df9cc9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d9ffa1d55ea4337938d00780f559120'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:44.206559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ea9f3d58-4917-45b3-85d5-cf5a4df9cc9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d9ffa1d55ea4337938d00780f559120'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:44.220212 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ea9f3d58-4917-45b3-85d5-cf5a4df9cc9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d9ffa1d55ea4337938d00780f559120'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:44.220972 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ea9f3d58-4917-45b3-85d5-cf5a4df9cc9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d9ffa1d55ea4337938d00780f559120'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:44.227570 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ea9f3d58-4917-45b3-85d5-cf5a4df9cc9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d9ffa1d55ea4337938d00780f559120'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:44.233855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1130/2248] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:44 2022] DELETE /identity/v3/users/9d9ffa1d55ea4337938d00780f559120 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:44.238676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc13a1c-8d1e-4e12-83c4-c798fabfc8c3 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:44.239186 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc13a1c-8d1e-4e12-83c4-c798fabfc8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:44.239277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc13a1c-8d1e-4e12-83c4-c798fabfc8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:44.258502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-4bc13a1c-8d1e-4e12-83c4-c798fabfc8c3 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:44.259716 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4bc13a1c-8d1e-4e12-83c4-c798fabfc8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:44.323694 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1119/2249] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:44.333558 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f3d58-4917-45b3-85d5-cf5a4df9cc9e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:44.335042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ea9f3d58-4917-45b3-85d5-cf5a4df9cc9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:44.367403 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:44.394374 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f3d58-4917-45b3-85d5-cf5a4df9cc9e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:44.398280 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca3b66-5883-4584-9898-96b40f18d8e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:44.398915 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca3b66-5883-4584-9898-96b40f18d8e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:44.399200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca3b66-5883-4584-9898-96b40f18d8e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:44.399479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca3b66-5883-4584-9898-96b40f18d8e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:44.408789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca3b66-5883-4584-9898-96b40f18d8e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:44.410352 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca3b66-5883-4584-9898-96b40f18d8e4 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:44.420242 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1131/2250] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:44.687139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc13a1c-8d1e-4e12-83c4-c798fabfc8c3 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:44.689350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4bc13a1c-8d1e-4e12-83c4-c798fabfc8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:44.705647 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc13a1c-8d1e-4e12-83c4-c798fabfc8c3 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:44.711131 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f6404-1b7f-4689-bde2-573511cd098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:44.711808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f6404-1b7f-4689-bde2-573511cd098c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:44.712038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f6404-1b7f-4689-bde2-573511cd098c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:44.712315 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f6404-1b7f-4689-bde2-573511cd098c admin admin] PATH_INFO: `/v3/projects/fc03d0abf4b84f3f81b7b48b08486327` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:44.713560 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f6404-1b7f-4689-bde2-573511cd098c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc03d0abf4b84f3f81b7b48b08486327)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:44.715743 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f6404-1b7f-4689-bde2-573511cd098c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:44.766531 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4e8f6404-1b7f-4689-bde2-573511cd098c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc03d0abf4b84f3f81b7b48b08486327', 'request_id': 'req-4e8f6404-1b7f-4689-bde2-573511cd098c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:44.771865 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4e8f6404-1b7f-4689-bde2-573511cd098c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc03d0abf4b84f3f81b7b48b08486327', 'request_id': 'req-4e8f6404-1b7f-4689-bde2-573511cd098c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:44.777753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4e8f6404-1b7f-4689-bde2-573511cd098c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc03d0abf4b84f3f81b7b48b08486327', 'request_id': 'req-4e8f6404-1b7f-4689-bde2-573511cd098c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:44.779421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:44.792677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4e8f6404-1b7f-4689-bde2-573511cd098c admin admin] The token cache is being invalidate because project fc03d0abf4b84f3f81b7b48b08486327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:44.792963 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4e8f6404-1b7f-4689-bde2-573511cd098c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:44.793598 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4e8f6404-1b7f-4689-bde2-573511cd098c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:44.795149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1120/2251] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:44 2022] DELETE /identity/v3/projects/fc03d0abf4b84f3f81b7b48b08486327 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:44.799766 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca3b66-5883-4584-9898-96b40f18d8e4 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:44.809586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca3b66-5883-4584-9898-96b40f18d8e4 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:44.867585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c58b61-0ede-493f-9128-4f2d12969677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:44.868218 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c58b61-0ede-493f-9128-4f2d12969677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:44.868502 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c58b61-0ede-493f-9128-4f2d12969677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:44.868778 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c58b61-0ede-493f-9128-4f2d12969677 admin admin] PATH_INFO: `/v3/users/320ea3b7460649db980ab38dd45d802f` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:44.869905 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c58b61-0ede-493f-9128-4f2d12969677 admin admin] RBAC: Authorizing `identity:delete_user(user_id=320ea3b7460649db980ab38dd45d802f)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:44.871886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c58b61-0ede-493f-9128-4f2d12969677 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:44.920463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f6404-1b7f-4689-bde2-573511cd098c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:44.922001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4e8f6404-1b7f-4689-bde2-573511cd098c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:44.922127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c3c58b61-0ede-493f-9128-4f2d12969677 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '320ea3b7460649db980ab38dd45d802f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:44.929886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c3c58b61-0ede-493f-9128-4f2d12969677 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '320ea3b7460649db980ab38dd45d802f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:44.935376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f6404-1b7f-4689-bde2-573511cd098c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:44.940202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfc00b-ef43-4624-ab2f-ac77113b8618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:44.940947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfc00b-ef43-4624-ab2f-ac77113b8618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:44.941346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfc00b-ef43-4624-ab2f-ac77113b8618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:44.941631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfc00b-ef43-4624-ab2f-ac77113b8618 admin admin] PATH_INFO: `/v3/users/5bdd515409104684b9fa87337c444cbd` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:44.942825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfc00b-ef43-4624-ab2f-ac77113b8618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bdd515409104684b9fa87337c444cbd)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:44.942940 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c3c58b61-0ede-493f-9128-4f2d12969677 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '320ea3b7460649db980ab38dd45d802f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:44.943620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c3c58b61-0ede-493f-9128-4f2d12969677 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '320ea3b7460649db980ab38dd45d802f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:44.944811 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfc00b-ef43-4624-ab2f-ac77113b8618 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:44.951555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c3c58b61-0ede-493f-9128-4f2d12969677 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '320ea3b7460649db980ab38dd45d802f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:44.962018 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1132/2252] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:44 2022] DELETE /identity/v3/users/320ea3b7460649db980ab38dd45d802f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:45.001321 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-93dfc00b-ef43-4624-ab2f-ac77113b8618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bdd515409104684b9fa87337c444cbd'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:45.009027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-93dfc00b-ef43-4624-ab2f-ac77113b8618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bdd515409104684b9fa87337c444cbd'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:45.009791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-93dfc00b-ef43-4624-ab2f-ac77113b8618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bdd515409104684b9fa87337c444cbd'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:45.050080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-93dfc00b-ef43-4624-ab2f-ac77113b8618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bdd515409104684b9fa87337c444cbd'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:45.060012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-93dfc00b-ef43-4624-ab2f-ac77113b8618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bdd515409104684b9fa87337c444cbd'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:45.069490 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1121/2253] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:44 2022] DELETE /identity/v3/users/5bdd515409104684b9fa87337c444cbd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:45.074640 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab664357-718c-4b60-b252-2631252f80c4 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:45.074843 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab664357-718c-4b60-b252-2631252f80c4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:45.075047 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab664357-718c-4b60-b252-2631252f80c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:45.109268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ab664357-718c-4b60-b252-2631252f80c4 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:45.111712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ab664357-718c-4b60-b252-2631252f80c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:45.195846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:45.224706 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1133/2254] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:45.240361 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfc00b-ef43-4624-ab2f-ac77113b8618 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:45.242413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-93dfc00b-ef43-4624-ab2f-ac77113b8618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:45.326148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfc00b-ef43-4624-ab2f-ac77113b8618 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:45.333513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab664357-718c-4b60-b252-2631252f80c4 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:45.336019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ab664357-718c-4b60-b252-2631252f80c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:45.336539 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce46420-bb29-434d-86eb-96f62716edb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:45.337599 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce46420-bb29-434d-86eb-96f62716edb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:45.338847 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce46420-bb29-434d-86eb-96f62716edb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:45.339916 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce46420-bb29-434d-86eb-96f62716edb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:45.364312 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce46420-bb29-434d-86eb-96f62716edb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:45.364685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab664357-718c-4b60-b252-2631252f80c4 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:45.365777 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce46420-bb29-434d-86eb-96f62716edb7 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:45.369541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb2f6f-8d58-49ce-91af-4e3783a8aa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:45.370176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb2f6f-8d58-49ce-91af-4e3783a8aa86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:45.370477 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb2f6f-8d58-49ce-91af-4e3783a8aa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:45.370763 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb2f6f-8d58-49ce-91af-4e3783a8aa86 admin admin] PATH_INFO: `/v3/projects/2378386a3d6844309e7e3c92a24fe776` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:45.372056 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb2f6f-8d58-49ce-91af-4e3783a8aa86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2378386a3d6844309e7e3c92a24fe776)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:45.373982 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb2f6f-8d58-49ce-91af-4e3783a8aa86 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:45.377208 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1122/2255] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:45.445518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0ecb2f6f-8d58-49ce-91af-4e3783a8aa86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2378386a3d6844309e7e3c92a24fe776', 'request_id': 'req-0ecb2f6f-8d58-49ce-91af-4e3783a8aa86'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:45.452446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0ecb2f6f-8d58-49ce-91af-4e3783a8aa86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2378386a3d6844309e7e3c92a24fe776', 'request_id': 'req-0ecb2f6f-8d58-49ce-91af-4e3783a8aa86'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:45.461244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0ecb2f6f-8d58-49ce-91af-4e3783a8aa86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2378386a3d6844309e7e3c92a24fe776', 'request_id': 'req-0ecb2f6f-8d58-49ce-91af-4e3783a8aa86'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:45.475112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0ecb2f6f-8d58-49ce-91af-4e3783a8aa86 admin admin] The token cache is being invalidate because project 2378386a3d6844309e7e3c92a24fe776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:45.475408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0ecb2f6f-8d58-49ce-91af-4e3783a8aa86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:45.476115 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0ecb2f6f-8d58-49ce-91af-4e3783a8aa86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:45.478666 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1134/2256] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:45 2022] DELETE /identity/v3/projects/2378386a3d6844309e7e3c92a24fe776 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:45.484152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d399c-82be-41ae-8681-45ddd711d1f6 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:45.484680 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d399c-82be-41ae-8681-45ddd711d1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:45.485144 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d399c-82be-41ae-8681-45ddd711d1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:45.507580 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-867d399c-82be-41ae-8681-45ddd711d1f6 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:45.508809 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-867d399c-82be-41ae-8681-45ddd711d1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:45.577212 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1123/2257] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:45.585447 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819c102-f4ca-4b18-ac5a-66a82495f1a5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:45.585737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819c102-f4ca-4b18-ac5a-66a82495f1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:45.586010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819c102-f4ca-4b18-ac5a-66a82495f1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:45.609765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-2819c102-f4ca-4b18-ac5a-66a82495f1a5 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:45.611080 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2819c102-f4ca-4b18-ac5a-66a82495f1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:45.619392 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1135/2258] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:45.624070 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d399c-82be-41ae-8681-45ddd711d1f6 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:45.634367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d399c-82be-41ae-8681-45ddd711d1f6 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:45.639892 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82187a2e-f9ca-45cb-82c5-738ed5cf3c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:45.640809 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82187a2e-f9ca-45cb-82c5-738ed5cf3c9a admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:45.641162 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82187a2e-f9ca-45cb-82c5-738ed5cf3c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:45.641494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82187a2e-f9ca-45cb-82c5-738ed5cf3c9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:45.642816 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82187a2e-f9ca-45cb-82c5-738ed5cf3c9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:21:45.643133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82187a2e-f9ca-45cb-82c5-738ed5cf3c9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:45.645193 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82187a2e-f9ca-45cb-82c5-738ed5cf3c9a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:45.646963 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:45.661313 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1124/2259] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:21:45.666430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819c102-f4ca-4b18-ac5a-66a82495f1a5 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:45.669727 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82187a2e-f9ca-45cb-82c5-738ed5cf3c9a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:45.671721 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-82187a2e-f9ca-45cb-82c5-738ed5cf3c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:45.680325 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819c102-f4ca-4b18-ac5a-66a82495f1a5 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:45.686984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38255a-d596-49cd-bc8d-cb5741095afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:45.687693 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38255a-d596-49cd-bc8d-cb5741095afd admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:45.688042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38255a-d596-49cd-bc8d-cb5741095afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:45.688488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38255a-d596-49cd-bc8d-cb5741095afd admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:45.689227 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82187a2e-f9ca-45cb-82c5-738ed5cf3c9a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:45.689993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38255a-d596-49cd-bc8d-cb5741095afd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:45.692092 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38255a-d596-49cd-bc8d-cb5741095afd admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:45.694881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06679562-0733-41b9-98c7-4d85b597829e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:45.695550 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06679562-0733-41b9-98c7-4d85b597829e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:45.695986 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06679562-0733-41b9-98c7-4d85b597829e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:45.696282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06679562-0733-41b9-98c7-4d85b597829e admin admin] PATH_INFO: `/v3/projects/486df15b12c841f89334e8d6efabb8c2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:45.697519 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06679562-0733-41b9-98c7-4d85b597829e admin admin] RBAC: Authorizing `identity:delete_project(project_id=486df15b12c841f89334e8d6efabb8c2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:45.699388 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06679562-0733-41b9-98c7-4d85b597829e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:45.726748 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1136/2260] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:45 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:45.728859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38255a-d596-49cd-bc8d-cb5741095afd admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:45.752725 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-06679562-0733-41b9-98c7-4d85b597829e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '486df15b12c841f89334e8d6efabb8c2', 'request_id': 'req-06679562-0733-41b9-98c7-4d85b597829e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:45.760514 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-06679562-0733-41b9-98c7-4d85b597829e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '486df15b12c841f89334e8d6efabb8c2', 'request_id': 'req-06679562-0733-41b9-98c7-4d85b597829e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:45.768154 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-06679562-0733-41b9-98c7-4d85b597829e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '486df15b12c841f89334e8d6efabb8c2', 'request_id': 'req-06679562-0733-41b9-98c7-4d85b597829e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:45.782445 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-06679562-0733-41b9-98c7-4d85b597829e admin admin] The token cache is being invalidate because project 486df15b12c841f89334e8d6efabb8c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:45.782762 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-06679562-0733-41b9-98c7-4d85b597829e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:45.783417 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-06679562-0733-41b9-98c7-4d85b597829e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:45.785124 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1125/2261] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:45 2022] DELETE /identity/v3/projects/486df15b12c841f89334e8d6efabb8c2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:45.790148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d4055-087b-441f-a53c-d83757a91d2e None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:45.790435 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d4055-087b-441f-a53c-d83757a91d2e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:45.790709 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d4055-087b-441f-a53c-d83757a91d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:45.801812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38255a-d596-49cd-bc8d-cb5741095afd admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:45.810674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d91d4055-087b-441f-a53c-d83757a91d2e None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:45.811985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d91d4055-087b-441f-a53c-d83757a91d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:45.855079 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:45.867334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a054391-32e5-44da-bc8a-b5b3be580ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:45.868056 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a054391-32e5-44da-bc8a-b5b3be580ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:45.868393 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a054391-32e5-44da-bc8a-b5b3be580ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:45.868671 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a054391-32e5-44da-bc8a-b5b3be580ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:45.869420 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a054391-32e5-44da-bc8a-b5b3be580ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:45.872283 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a054391-32e5-44da-bc8a-b5b3be580ae2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:45.875018 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1126/2262] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:45.883066 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc95dc7-1bd8-475e-bb26-ac200d6dd1cb None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:45.883360 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc95dc7-1bd8-475e-bb26-ac200d6dd1cb None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:45.883643 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc95dc7-1bd8-475e-bb26-ac200d6dd1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:45.899665 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1137/2263] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:45 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:45.901022 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a054391-32e5-44da-bc8a-b5b3be580ae2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:45.902794 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0a054391-32e5-44da-bc8a-b5b3be580ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:45.905763 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1fc95dc7-1bd8-475e-bb26-ac200d6dd1cb None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:45.907009 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1fc95dc7-1bd8-475e-bb26-ac200d6dd1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:45.925557 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1127/2264] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:45.927491 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a054391-32e5-44da-bc8a-b5b3be580ae2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:45.930576 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc95dc7-1bd8-475e-bb26-ac200d6dd1cb None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:45.932889 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49972d-e28d-442b-868d-e861ea3e7ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:45.933512 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49972d-e28d-442b-868d-e861ea3e7ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:45.933798 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49972d-e28d-442b-868d-e861ea3e7ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:45.934066 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49972d-e28d-442b-868d-e861ea3e7ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:45.934740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49972d-e28d-442b-868d-e861ea3e7ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:45.936401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49972d-e28d-442b-868d-e861ea3e7ff6 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:45.941237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc95dc7-1bd8-475e-bb26-ac200d6dd1cb None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:45.945882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c952d9-8d94-4926-ae7b-3f7051817569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:45.946479 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c952d9-8d94-4926-ae7b-3f7051817569 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:45.946798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c952d9-8d94-4926-ae7b-3f7051817569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:45.947089 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c952d9-8d94-4926-ae7b-3f7051817569 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:45.950333 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1138/2265] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:45.950488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c952d9-8d94-4926-ae7b-3f7051817569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:21:45.950488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c952d9-8d94-4926-ae7b-3f7051817569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:45.950488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c952d9-8d94-4926-ae7b-3f7051817569 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:45.951838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49972d-e28d-442b-868d-e861ea3e7ff6 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:45.961611 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49972d-e28d-442b-868d-e861ea3e7ff6 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:45.961769 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1128/2266] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:21:45.965800 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c952d9-8d94-4926-ae7b-3f7051817569 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:45.970855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d5971-12fc-465f-97c1-706665113d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:45.970855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d5971-12fc-465f-97c1-706665113d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:45.970855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d5971-12fc-465f-97c1-706665113d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:45.970855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d5971-12fc-465f-97c1-706665113d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:45.971324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d5971-12fc-465f-97c1-706665113d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:45.971324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d5971-12fc-465f-97c1-706665113d2a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:45.980499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c952d9-8d94-4926-ae7b-3f7051817569 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:45.981509 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1139/2267] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:45.986207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31daaa1-2f80-40e2-9975-18415220e62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:45.986357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d5971-12fc-465f-97c1-706665113d2a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:45.986836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31daaa1-2f80-40e2-9975-18415220e62e admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:45.987124 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31daaa1-2f80-40e2-9975-18415220e62e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:45.987398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31daaa1-2f80-40e2-9975-18415220e62e admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:45.988034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31daaa1-2f80-40e2-9975-18415220e62e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:45.989935 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31daaa1-2f80-40e2-9975-18415220e62e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:45.996469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d5971-12fc-465f-97c1-706665113d2a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:46.001163 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e116a76-6216-4ee9-8268-3768a86f74cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:46.002303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e116a76-6216-4ee9-8268-3768a86f74cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:46.002582 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e116a76-6216-4ee9-8268-3768a86f74cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:46.002894 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e116a76-6216-4ee9-8268-3768a86f74cf admin admin] PATH_INFO: `/v3/projects/1b64ee2a77e54d92ad39e47af7417d2b/users/43f056fdd425429ea2e748c5011a30d5/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:46.018404 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e116a76-6216-4ee9-8268-3768a86f74cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b64ee2a77e54d92ad39e47af7417d2b, user_id=43f056fdd425429ea2e748c5011a30d5, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:46.018778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1129/2268] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:45 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:46.022557 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31daaa1-2f80-40e2-9975-18415220e62e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:46.024384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e116a76-6216-4ee9-8268-3768a86f74cf admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:46.039644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1140/2269] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:45 2022] PUT /identity/v3/projects/1b64ee2a77e54d92ad39e47af7417d2b/users/43f056fdd425429ea2e748c5011a30d5/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:46.052348 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f4b1-9328-4e92-aa3d-487c42133e69 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:46.052710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f4b1-9328-4e92-aa3d-487c42133e69 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:46.052987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f4b1-9328-4e92-aa3d-487c42133e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:46.073710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:46.080468 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5651f4b1-9328-4e92-aa3d-487c42133e69 None None] MFA Rules not processed for user `43f056fdd425429ea2e748c5011a30d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:46.081665 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5651f4b1-9328-4e92-aa3d-487c42133e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:46.100911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31daaa1-2f80-40e2-9975-18415220e62e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:46.153393 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1141/2270] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:46.157973 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651f4b1-9328-4e92-aa3d-487c42133e69 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:46.159419 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6671010-379d-4563-9dbd-d5bc50173de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:46.160026 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6671010-379d-4563-9dbd-d5bc50173de9 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:46.160305 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6671010-379d-4563-9dbd-d5bc50173de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:46.160576 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6671010-379d-4563-9dbd-d5bc50173de9 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:46.161217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6671010-379d-4563-9dbd-d5bc50173de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:46.163294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6671010-379d-4563-9dbd-d5bc50173de9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:46.168384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651f4b1-9328-4e92-aa3d-487c42133e69 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:46.173978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3d35d-4394-49c7-b34b-e44ca18d19d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:46.174573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3d35d-4394-49c7-b34b-e44ca18d19d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:46.174889 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3d35d-4394-49c7-b34b-e44ca18d19d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:46.175173 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3d35d-4394-49c7-b34b-e44ca18d19d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:46.175959 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3d35d-4394-49c7-b34b-e44ca18d19d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:46.178629 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3d35d-4394-49c7-b34b-e44ca18d19d7 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:46.187400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1130/2271] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:46 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:46.191410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6671010-379d-4563-9dbd-d5bc50173de9 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:46.201568 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6671010-379d-4563-9dbd-d5bc50173de9 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:46.206469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a112e-0ba5-4dd3-b52a-a111848c6647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:46.207183 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a112e-0ba5-4dd3-b52a-a111848c6647 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:46.207571 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a112e-0ba5-4dd3-b52a-a111848c6647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:46.207927 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a112e-0ba5-4dd3-b52a-a111848c6647 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:46.208711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a112e-0ba5-4dd3-b52a-a111848c6647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:46.209909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1142/2272] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:46 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:46.211311 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a112e-0ba5-4dd3-b52a-a111848c6647 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:46.214002 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3d35d-4394-49c7-b34b-e44ca18d19d7 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:46.222614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1131/2273] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:46.226497 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a112e-0ba5-4dd3-b52a-a111848c6647 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:46.237016 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a112e-0ba5-4dd3-b52a-a111848c6647 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:46.290430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3d35d-4394-49c7-b34b-e44ca18d19d7 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:46.296125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f9796-b527-4423-b65b-345e3f4fcabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:46.297025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f9796-b527-4423-b65b-345e3f4fcabe admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:46.297475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f9796-b527-4423-b65b-345e3f4fcabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:46.297939 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f9796-b527-4423-b65b-345e3f4fcabe admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:46.298814 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f9796-b527-4423-b65b-345e3f4fcabe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:46.300792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f9796-b527-4423-b65b-345e3f4fcabe admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:46.306468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c05c0-cf29-456c-a59c-70a9ae85bc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:46.307110 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c05c0-cf29-456c-a59c-70a9ae85bc16 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:46.307398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c05c0-cf29-456c-a59c-70a9ae85bc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:46.307818 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c05c0-cf29-456c-a59c-70a9ae85bc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:46.308478 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c05c0-cf29-456c-a59c-70a9ae85bc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:46.310434 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c05c0-cf29-456c-a59c-70a9ae85bc16 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:46.315078 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:46.338036 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1143/2274] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:46 2022] POST /identity/v3/users => generated 300 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:46.339425 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f9796-b527-4423-b65b-345e3f4fcabe admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:46.341947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1132/2275] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:46.343947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c05c0-cf29-456c-a59c-70a9ae85bc16 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:46.347259 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6e8c05c0-cf29-456c-a59c-70a9ae85bc16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:46.350170 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f9796-b527-4423-b65b-345e3f4fcabe admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:46.354997 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e29f24-e1ad-4f2a-aec1-1c515c6bf393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:46.355682 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e29f24-e1ad-4f2a-aec1-1c515c6bf393 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:46.356030 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e29f24-e1ad-4f2a-aec1-1c515c6bf393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:46.356374 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e29f24-e1ad-4f2a-aec1-1c515c6bf393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:46.357372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e29f24-e1ad-4f2a-aec1-1c515c6bf393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:46.359016 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e29f24-e1ad-4f2a-aec1-1c515c6bf393 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:46.360816 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c05c0-cf29-456c-a59c-70a9ae85bc16 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:46.365673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8d04f-c127-47f5-bd34-553536d503f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:46.366309 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8d04f-c127-47f5-bd34-553536d503f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:46.366593 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8d04f-c127-47f5-bd34-553536d503f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:46.366903 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8d04f-c127-47f5-bd34-553536d503f6 admin admin] PATH_INFO: `/v3/users/8c3d988f8b57434ab4b12c44735b1628` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:46.368054 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8d04f-c127-47f5-bd34-553536d503f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3d988f8b57434ab4b12c44735b1628)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:46.370120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8d04f-c127-47f5-bd34-553536d503f6 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:46.370493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1144/2276] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:46.375175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e29f24-e1ad-4f2a-aec1-1c515c6bf393 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:46.408605 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e29f24-e1ad-4f2a-aec1-1c515c6bf393 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:46.415034 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf4540-258a-49e7-99da-f8edf93a45eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:46.416252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf4540-258a-49e7-99da-f8edf93a45eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:46.416546 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf4540-258a-49e7-99da-f8edf93a45eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:46.416828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf4540-258a-49e7-99da-f8edf93a45eb admin admin] PATH_INFO: `/v3/projects/078743b2442043259fde097d67439f35/users/d22266d9c6ef430c9cb9dc428f95c36b/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:46.441575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf4540-258a-49e7-99da-f8edf93a45eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=078743b2442043259fde097d67439f35, user_id=d22266d9c6ef430c9cb9dc428f95c36b, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:46.444589 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf4540-258a-49e7-99da-f8edf93a45eb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:46.458610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1145/2277] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:46 2022] PUT /identity/v3/projects/078743b2442043259fde097d67439f35/users/d22266d9c6ef430c9cb9dc428f95c36b/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:46.459479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf4540-258a-49e7-99da-f8edf93a45eb admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:46.464451 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-35b8d04f-c127-47f5-bd34-553536d503f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3d988f8b57434ab4b12c44735b1628'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:46.469977 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:46.474436 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-35b8d04f-c127-47f5-bd34-553536d503f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3d988f8b57434ab4b12c44735b1628'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:46.475549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-35b8d04f-c127-47f5-bd34-553536d503f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3d988f8b57434ab4b12c44735b1628'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:46.490078 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-35b8d04f-c127-47f5-bd34-553536d503f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3d988f8b57434ab4b12c44735b1628'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:46.498302 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-35b8d04f-c127-47f5-bd34-553536d503f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3d988f8b57434ab4b12c44735b1628'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:46.506128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1133/2278] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:46 2022] DELETE /identity/v3/users/8c3d988f8b57434ab4b12c44735b1628 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:46.508525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe47cb-a397-417a-8a40-fd377722a3d8 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:46.509146 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe47cb-a397-417a-8a40-fd377722a3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:46.509427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe47cb-a397-417a-8a40-fd377722a3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:46.529259 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf4540-258a-49e7-99da-f8edf93a45eb admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:46.537168 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8ebe47cb-a397-417a-8a40-fd377722a3d8 None None] MFA Rules not processed for user `d22266d9c6ef430c9cb9dc428f95c36b`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:46.538372 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8ebe47cb-a397-417a-8a40-fd377722a3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:46.590773 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1553926-36d9-4be5-ae52-a63efa507d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:46.591436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1553926-36d9-4be5-ae52-a63efa507d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:46.591716 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1553926-36d9-4be5-ae52-a63efa507d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:46.591994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1553926-36d9-4be5-ae52-a63efa507d45 admin admin] PATH_INFO: `/v3/projects/13e208f36f34431d8aeb1b4c10bb2114/users/4f242c2e1ad54005b6b94ad7ef644c80/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:46.601974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1134/2279] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:46.603304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5843157-4e9d-4879-af2f-68be67140806 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:46.603596 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5843157-4e9d-4879-af2f-68be67140806 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:46.603875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5843157-4e9d-4879-af2f-68be67140806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:46.606900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1553926-36d9-4be5-ae52-a63efa507d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e208f36f34431d8aeb1b4c10bb2114, user_id=4f242c2e1ad54005b6b94ad7ef644c80, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:46.609805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1553926-36d9-4be5-ae52-a63efa507d45 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:46.623615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1146/2280] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:46 2022] PUT /identity/v3/projects/13e208f36f34431d8aeb1b4c10bb2114/users/4f242c2e1ad54005b6b94ad7ef644c80/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:46.624828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1553926-36d9-4be5-ae52-a63efa507d45 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:46.628231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d1553926-36d9-4be5-ae52-a63efa507d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:46.628457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b5843157-4e9d-4879-af2f-68be67140806 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:46.629703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b5843157-4e9d-4879-af2f-68be67140806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:46.682950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:46.687387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1553926-36d9-4be5-ae52-a63efa507d45 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:46.692265 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1135/2281] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:46.693273 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5843157-4e9d-4879-af2f-68be67140806 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:46.694832 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76999abd-098f-419f-bdbd-2fdda75a639d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:46.694975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b5843157-4e9d-4879-af2f-68be67140806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:46.699159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76999abd-098f-419f-bdbd-2fdda75a639d service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:46.699543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76999abd-098f-419f-bdbd-2fdda75a639d service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:46.699890 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76999abd-098f-419f-bdbd-2fdda75a639d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:46.707240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5843157-4e9d-4879-af2f-68be67140806 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:46.711961 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa352f5-8ced-40ef-bd49-22598fd24710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:46.712590 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa352f5-8ced-40ef-bd49-22598fd24710 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:46.712877 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa352f5-8ced-40ef-bd49-22598fd24710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:46.713159 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa352f5-8ced-40ef-bd49-22598fd24710 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:46.713814 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa352f5-8ced-40ef-bd49-22598fd24710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:46.715468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa352f5-8ced-40ef-bd49-22598fd24710 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:46.725645 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1136/2282] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:46.726593 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa352f5-8ced-40ef-bd49-22598fd24710 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:46.728290 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5fa352f5-8ced-40ef-bd49-22598fd24710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:46.765977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76999abd-098f-419f-bdbd-2fdda75a639d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:46.767497 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76999abd-098f-419f-bdbd-2fdda75a639d service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:46.776847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1147/2283] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:46 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:46.778436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76999abd-098f-419f-bdbd-2fdda75a639d service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:46.788464 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:46.790036 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76999abd-098f-419f-bdbd-2fdda75a639d service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:46.794869 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa220b-9ac7-4a33-b62c-dab190ed2dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:46.795526 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa220b-9ac7-4a33-b62c-dab190ed2dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:46.795798 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa220b-9ac7-4a33-b62c-dab190ed2dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:46.796079 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa220b-9ac7-4a33-b62c-dab190ed2dcb admin admin] PATH_INFO: `/v3/projects/13e208f36f34431d8aeb1b4c10bb2114/users/4f242c2e1ad54005b6b94ad7ef644c80/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:46.798574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa220b-9ac7-4a33-b62c-dab190ed2dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e208f36f34431d8aeb1b4c10bb2114, user_id=4f242c2e1ad54005b6b94ad7ef644c80, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:46.798808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa352f5-8ced-40ef-bd49-22598fd24710 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:46.802973 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93250478-1fb3-4a65-8f65-733738afe0d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:46.803609 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93250478-1fb3-4a65-8f65-733738afe0d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:46.803853 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93250478-1fb3-4a65-8f65-733738afe0d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:46.804187 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93250478-1fb3-4a65-8f65-733738afe0d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:46.804825 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa220b-9ac7-4a33-b62c-dab190ed2dcb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:46.814648 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93250478-1fb3-4a65-8f65-733738afe0d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:46.816833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1148/2284] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:46 2022] PUT /identity/v3/projects/13e208f36f34431d8aeb1b4c10bb2114/users/4f242c2e1ad54005b6b94ad7ef644c80/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:46.817061 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93250478-1fb3-4a65-8f65-733738afe0d2 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:46.827467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162275f-c341-4562-bf7f-86a81485f237 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:46.827775 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162275f-c341-4562-bf7f-86a81485f237 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:46.828100 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162275f-c341-4562-bf7f-86a81485f237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:46.830048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1137/2285] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:46.860125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-4162275f-c341-4562-bf7f-86a81485f237 None None] MFA Rules not processed for user `4f242c2e1ad54005b6b94ad7ef644c80`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:46.862120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4162275f-c341-4562-bf7f-86a81485f237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:46.962381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1149/2286] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:46.974494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93250478-1fb3-4a65-8f65-733738afe0d2 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:46.976319 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-93250478-1fb3-4a65-8f65-733738afe0d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:46.990770 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93250478-1fb3-4a65-8f65-733738afe0d2 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:47.080988 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1249997-3c43-41c2-a0a5-294dd6e183db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:47.081760 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1249997-3c43-41c2-a0a5-294dd6e183db service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:47.082125 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1249997-3c43-41c2-a0a5-294dd6e183db service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:47.082477 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1249997-3c43-41c2-a0a5-294dd6e183db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:47.094579 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1249997-3c43-41c2-a0a5-294dd6e183db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:47.096991 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1249997-3c43-41c2-a0a5-294dd6e183db service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:47.108195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1138/2287] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:47.174603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162275f-c341-4562-bf7f-86a81485f237 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:47.176282 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4162275f-c341-4562-bf7f-86a81485f237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:47.187841 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1249997-3c43-41c2-a0a5-294dd6e183db service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:47.260307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162275f-c341-4562-bf7f-86a81485f237 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:47.265403 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc8f51-74e4-4cae-8c10-bce9aba4750c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:47.266144 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc8f51-74e4-4cae-8c10-bce9aba4750c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:47.266434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc8f51-74e4-4cae-8c10-bce9aba4750c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:47.267543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc8f51-74e4-4cae-8c10-bce9aba4750c admin admin] PATH_INFO: `/v3/projects/638973de0ba248ea867a2f5d9339f0d6` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:47.268782 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc8f51-74e4-4cae-8c10-bce9aba4750c admin admin] RBAC: Authorizing `identity:delete_project(project_id=638973de0ba248ea867a2f5d9339f0d6)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:47.270982 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc8f51-74e4-4cae-8c10-bce9aba4750c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:47.295074 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1249997-3c43-41c2-a0a5-294dd6e183db service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:47.297504 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:47.300700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc185e9d-57ad-4013-b513-ed91b733b0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:47.301621 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc185e9d-57ad-4013-b513-ed91b733b0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:47.302297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc185e9d-57ad-4013-b513-ed91b733b0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:47.302938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc185e9d-57ad-4013-b513-ed91b733b0b0 admin admin] PATH_INFO: `/v3/users/43f056fdd425429ea2e748c5011a30d5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:47.305300 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc185e9d-57ad-4013-b513-ed91b733b0b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f056fdd425429ea2e748c5011a30d5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:47.307892 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc185e9d-57ad-4013-b513-ed91b733b0b0 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:47.341765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fabc8f51-74e4-4cae-8c10-bce9aba4750c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638973de0ba248ea867a2f5d9339f0d6', 'request_id': 'req-fabc8f51-74e4-4cae-8c10-bce9aba4750c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:47.359405 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fabc8f51-74e4-4cae-8c10-bce9aba4750c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638973de0ba248ea867a2f5d9339f0d6', 'request_id': 'req-fabc8f51-74e4-4cae-8c10-bce9aba4750c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:47.368492 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fabc8f51-74e4-4cae-8c10-bce9aba4750c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638973de0ba248ea867a2f5d9339f0d6', 'request_id': 'req-fabc8f51-74e4-4cae-8c10-bce9aba4750c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:47.374004 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cc185e9d-57ad-4013-b513-ed91b733b0b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f056fdd425429ea2e748c5011a30d5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:47.381201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fabc8f51-74e4-4cae-8c10-bce9aba4750c admin admin] The token cache is being invalidate because project 638973de0ba248ea867a2f5d9339f0d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:47.381518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fabc8f51-74e4-4cae-8c10-bce9aba4750c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:47.382266 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fabc8f51-74e4-4cae-8c10-bce9aba4750c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:47.382377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cc185e9d-57ad-4013-b513-ed91b733b0b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f056fdd425429ea2e748c5011a30d5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:47.383149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cc185e9d-57ad-4013-b513-ed91b733b0b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f056fdd425429ea2e748c5011a30d5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:47.386983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1150/2288] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:47 2022] DELETE /identity/v3/projects/638973de0ba248ea867a2f5d9339f0d6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:47.388929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc8f51-74e4-4cae-8c10-bce9aba4750c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:47.390381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fabc8f51-74e4-4cae-8c10-bce9aba4750c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:47.398874 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cc185e9d-57ad-4013-b513-ed91b733b0b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f056fdd425429ea2e748c5011a30d5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:47.406332 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cc185e9d-57ad-4013-b513-ed91b733b0b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f056fdd425429ea2e748c5011a30d5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:47.414687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1139/2289] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:47 2022] DELETE /identity/v3/users/43f056fdd425429ea2e748c5011a30d5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:47.419434 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ccdc1-c8a4-4bee-9ae4-d67bf7c65ea4 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:47.419663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ccdc1-c8a4-4bee-9ae4-d67bf7c65ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:47.419941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ccdc1-c8a4-4bee-9ae4-d67bf7c65ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:47.443538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-892ccdc1-c8a4-4bee-9ae4-d67bf7c65ea4 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:47.445001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-892ccdc1-c8a4-4bee-9ae4-d67bf7c65ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:47.453499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:47.495424 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc8f51-74e4-4cae-8c10-bce9aba4750c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:47.515175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1140/2290] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:47.527534 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ccdc1-c8a4-4bee-9ae4-d67bf7c65ea4 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:47.528941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-892ccdc1-c8a4-4bee-9ae4-d67bf7c65ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:47.570115 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042e60c-d20a-4740-9607-7a06403c1214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:47.570783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042e60c-d20a-4740-9607-7a06403c1214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:47.571110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042e60c-d20a-4740-9607-7a06403c1214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:47.571348 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042e60c-d20a-4740-9607-7a06403c1214 admin admin] PATH_INFO: `/v3/users/ede8b4b361a94a4586eb733e11fee3e2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:47.572509 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042e60c-d20a-4740-9607-7a06403c1214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede8b4b361a94a4586eb733e11fee3e2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:47.574475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042e60c-d20a-4740-9607-7a06403c1214 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:47.594453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ccdc1-c8a4-4bee-9ae4-d67bf7c65ea4 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:47.599507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f97a09-fe6c-4e61-9727-1d6c0b4d831b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:47.600275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f97a09-fe6c-4e61-9727-1d6c0b4d831b service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:47.600686 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f97a09-fe6c-4e61-9727-1d6c0b4d831b service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:47.600957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f97a09-fe6c-4e61-9727-1d6c0b4d831b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:47.612332 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f97a09-fe6c-4e61-9727-1d6c0b4d831b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:47.614153 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f97a09-fe6c-4e61-9727-1d6c0b4d831b service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:47.624513 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1141/2291] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:21:47.631293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4042e60c-d20a-4740-9607-7a06403c1214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede8b4b361a94a4586eb733e11fee3e2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:47.638799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:47.640960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4042e60c-d20a-4740-9607-7a06403c1214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede8b4b361a94a4586eb733e11fee3e2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:47.665250 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4042e60c-d20a-4740-9607-7a06403c1214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede8b4b361a94a4586eb733e11fee3e2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:47.666106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4042e60c-d20a-4740-9607-7a06403c1214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede8b4b361a94a4586eb733e11fee3e2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:47.676515 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4042e60c-d20a-4740-9607-7a06403c1214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede8b4b361a94a4586eb733e11fee3e2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:47.683804 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1151/2292] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:47 2022] DELETE /identity/v3/users/ede8b4b361a94a4586eb733e11fee3e2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:47.980447 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f97a09-fe6c-4e61-9727-1d6c0b4d831b service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:47.981977 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-40f97a09-fe6c-4e61-9727-1d6c0b4d831b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:47.999228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f97a09-fe6c-4e61-9727-1d6c0b4d831b service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:48.069363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042e60c-d20a-4740-9607-7a06403c1214 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:48.071251 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4042e60c-d20a-4740-9607-7a06403c1214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:48.072256 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6684d-273f-458e-97cb-31300c2be44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:48.073173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6684d-273f-458e-97cb-31300c2be44e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:48.074948 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6684d-273f-458e-97cb-31300c2be44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:48.075579 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6684d-273f-458e-97cb-31300c2be44e admin admin] PATH_INFO: `/v3/projects/1b64ee2a77e54d92ad39e47af7417d2b` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:48.077348 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6684d-273f-458e-97cb-31300c2be44e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b64ee2a77e54d92ad39e47af7417d2b)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:48.079816 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6684d-273f-458e-97cb-31300c2be44e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:48.089896 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042e60c-d20a-4740-9607-7a06403c1214 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:48.095022 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c13633-5943-4c98-823b-6cc5ca15f040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:48.095671 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c13633-5943-4c98-823b-6cc5ca15f040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:48.095955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c13633-5943-4c98-823b-6cc5ca15f040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:48.096234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c13633-5943-4c98-823b-6cc5ca15f040 admin admin] PATH_INFO: `/v3/projects/1a23a099c5324108a44630b47f2e516d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:48.097378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c13633-5943-4c98-823b-6cc5ca15f040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a23a099c5324108a44630b47f2e516d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:48.099346 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c13633-5943-4c98-823b-6cc5ca15f040 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:48.135081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6cd6684d-273f-458e-97cb-31300c2be44e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b64ee2a77e54d92ad39e47af7417d2b', 'request_id': 'req-6cd6684d-273f-458e-97cb-31300c2be44e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.142329 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6cd6684d-273f-458e-97cb-31300c2be44e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b64ee2a77e54d92ad39e47af7417d2b', 'request_id': 'req-6cd6684d-273f-458e-97cb-31300c2be44e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.143555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:48.149782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6cd6684d-273f-458e-97cb-31300c2be44e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b64ee2a77e54d92ad39e47af7417d2b', 'request_id': 'req-6cd6684d-273f-458e-97cb-31300c2be44e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.156336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-09c13633-5943-4c98-823b-6cc5ca15f040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a23a099c5324108a44630b47f2e516d', 'request_id': 'req-09c13633-5943-4c98-823b-6cc5ca15f040'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.163291 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-09c13633-5943-4c98-823b-6cc5ca15f040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a23a099c5324108a44630b47f2e516d', 'request_id': 'req-09c13633-5943-4c98-823b-6cc5ca15f040'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.163520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6cd6684d-273f-458e-97cb-31300c2be44e admin admin] The token cache is being invalidate because project 1b64ee2a77e54d92ad39e47af7417d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:48.163815 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6cd6684d-273f-458e-97cb-31300c2be44e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.164443 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6cd6684d-273f-458e-97cb-31300c2be44e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.166687 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1142/2293] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:47 2022] DELETE /identity/v3/projects/1b64ee2a77e54d92ad39e47af7417d2b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:48.170325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6684d-273f-458e-97cb-31300c2be44e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:48.170898 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-09c13633-5943-4c98-823b-6cc5ca15f040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a23a099c5324108a44630b47f2e516d', 'request_id': 'req-09c13633-5943-4c98-823b-6cc5ca15f040'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.171635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6cd6684d-273f-458e-97cb-31300c2be44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:48.182143 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-09c13633-5943-4c98-823b-6cc5ca15f040 admin admin] The token cache is being invalidate because project 1a23a099c5324108a44630b47f2e516d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:48.182435 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-09c13633-5943-4c98-823b-6cc5ca15f040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.183430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-09c13633-5943-4c98-823b-6cc5ca15f040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.185332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1152/2294] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:48 2022] DELETE /identity/v3/projects/1a23a099c5324108a44630b47f2e516d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:48.191281 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f559af9-efd0-4ffe-bf4f-af97030cd364 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:48.192041 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f559af9-efd0-4ffe-bf4f-af97030cd364 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:48.192041 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f559af9-efd0-4ffe-bf4f-af97030cd364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:48.214248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8f559af9-efd0-4ffe-bf4f-af97030cd364 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:48.215495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8f559af9-efd0-4ffe-bf4f-af97030cd364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:48.240619 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6684d-273f-458e-97cb-31300c2be44e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:48.281343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1153/2295] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:48.289611 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4efb2-e916-42fc-972a-105a5fc3758d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:48.289896 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4efb2-e916-42fc-972a-105a5fc3758d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:48.290196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4efb2-e916-42fc-972a-105a5fc3758d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:48.300220 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b431a0a-4ca0-46c2-a3b8-f6bd04ef3fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:48.301011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b431a0a-4ca0-46c2-a3b8-f6bd04ef3fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:48.301292 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b431a0a-4ca0-46c2-a3b8-f6bd04ef3fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:48.301565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b431a0a-4ca0-46c2-a3b8-f6bd04ef3fa4 admin admin] PATH_INFO: `/v3/users/4f242c2e1ad54005b6b94ad7ef644c80` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:48.302696 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b431a0a-4ca0-46c2-a3b8-f6bd04ef3fa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f242c2e1ad54005b6b94ad7ef644c80)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:48.304663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b431a0a-4ca0-46c2-a3b8-f6bd04ef3fa4 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:48.310104 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5df4efb2-e916-42fc-972a-105a5fc3758d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:48.311337 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5df4efb2-e916-42fc-972a-105a5fc3758d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:48.319516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1154/2296] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:48.323561 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4efb2-e916-42fc-972a-105a5fc3758d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:48.334019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4efb2-e916-42fc-972a-105a5fc3758d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:48.343329 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff98d8-367f-417c-abd6-fe8f22f6485a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:48.343957 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff98d8-367f-417c-abd6-fe8f22f6485a admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:48.344243 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff98d8-367f-417c-abd6-fe8f22f6485a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:48.344522 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff98d8-367f-417c-abd6-fe8f22f6485a admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:48.345723 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff98d8-367f-417c-abd6-fe8f22f6485a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:21:48.346035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff98d8-367f-417c-abd6-fe8f22f6485a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:48.347735 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff98d8-367f-417c-abd6-fe8f22f6485a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:48.361365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1155/2297] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:21:48.365480 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4b431a0a-4ca0-46c2-a3b8-f6bd04ef3fa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f242c2e1ad54005b6b94ad7ef644c80'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.365958 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff98d8-367f-417c-abd6-fe8f22f6485a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:48.374135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4b431a0a-4ca0-46c2-a3b8-f6bd04ef3fa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f242c2e1ad54005b6b94ad7ef644c80'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.375054 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4b431a0a-4ca0-46c2-a3b8-f6bd04ef3fa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f242c2e1ad54005b6b94ad7ef644c80'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.375794 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff98d8-367f-417c-abd6-fe8f22f6485a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:48.382164 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a6733-a280-4052-bada-97a8803f4ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:48.387909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a6733-a280-4052-bada-97a8803f4ebe admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:48.387909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a6733-a280-4052-bada-97a8803f4ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:48.387909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a6733-a280-4052-bada-97a8803f4ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:48.387909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a6733-a280-4052-bada-97a8803f4ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:48.387909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a6733-a280-4052-bada-97a8803f4ebe admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:48.417117 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4b431a0a-4ca0-46c2-a3b8-f6bd04ef3fa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f242c2e1ad54005b6b94ad7ef644c80'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.425707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4b431a0a-4ca0-46c2-a3b8-f6bd04ef3fa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f242c2e1ad54005b6b94ad7ef644c80'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.433095 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1156/2298] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:48 2022] POST /identity/v3/projects => generated 403 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:48.433555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1143/2299] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:48 2022] DELETE /identity/v3/users/4f242c2e1ad54005b6b94ad7ef644c80 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:48.437046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a6733-a280-4052-bada-97a8803f4ebe admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:48.440165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2e0a6733-a280-4052-bada-97a8803f4ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:48.455192 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:48.526448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a6733-a280-4052-bada-97a8803f4ebe admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:48.619033 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7ab94-ad92-4edf-a7e3-b99f2c2b4470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:48.620756 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7ab94-ad92-4edf-a7e3-b99f2c2b4470 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:48.621047 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7ab94-ad92-4edf-a7e3-b99f2c2b4470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:48.621471 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7ab94-ad92-4edf-a7e3-b99f2c2b4470 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:48.622135 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7ab94-ad92-4edf-a7e3-b99f2c2b4470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:48.624812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7ab94-ad92-4edf-a7e3-b99f2c2b4470 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:48.654770 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1157/2300] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:48 2022] POST /identity/v3/users => generated 302 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:48.658020 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b431a0a-4ca0-46c2-a3b8-f6bd04ef3fa4 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:48.670602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b431a0a-4ca0-46c2-a3b8-f6bd04ef3fa4 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:48.676281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59eb37-9136-4fac-9f22-1182278c3123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:48.676893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59eb37-9136-4fac-9f22-1182278c3123 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:48.677184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59eb37-9136-4fac-9f22-1182278c3123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:48.677552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59eb37-9136-4fac-9f22-1182278c3123 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:48.678228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59eb37-9136-4fac-9f22-1182278c3123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:48.679937 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59eb37-9136-4fac-9f22-1182278c3123 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:48.692633 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1144/2301] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:48.697448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7ab94-ad92-4edf-a7e3-b99f2c2b4470 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:48.711099 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7ab94-ad92-4edf-a7e3-b99f2c2b4470 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:48.716353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee9477-145f-4c99-9a51-0f968d7ac204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:48.717041 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee9477-145f-4c99-9a51-0f968d7ac204 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:48.717390 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee9477-145f-4c99-9a51-0f968d7ac204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:48.717764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee9477-145f-4c99-9a51-0f968d7ac204 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:48.718481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee9477-145f-4c99-9a51-0f968d7ac204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:48.720776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee9477-145f-4c99-9a51-0f968d7ac204 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:48.734758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1158/2302] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:48.736713 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59eb37-9136-4fac-9f22-1182278c3123 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:48.743060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:48.749317 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59eb37-9136-4fac-9f22-1182278c3123 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:48.759550 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246dcf8-4098-4df8-9cd4-a13898938ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:48.760022 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee9477-145f-4c99-9a51-0f968d7ac204 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:48.760734 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246dcf8-4098-4df8-9cd4-a13898938ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:48.761458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246dcf8-4098-4df8-9cd4-a13898938ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:48.761824 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246dcf8-4098-4df8-9cd4-a13898938ff7 admin admin] PATH_INFO: `/v3/projects/9782304cc6584b9b83618fe788540770/users/0980f07ca315413d974d51e504b9284a/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:48.763477 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-86ee9477-145f-4c99-9a51-0f968d7ac204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:48.781206 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee9477-145f-4c99-9a51-0f968d7ac204 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:48.786950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd4e59-7372-4405-bb9a-959a8ea99cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:48.787599 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd4e59-7372-4405-bb9a-959a8ea99cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:48.787877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd4e59-7372-4405-bb9a-959a8ea99cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:48.788153 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd4e59-7372-4405-bb9a-959a8ea99cc2 admin admin] PATH_INFO: `/v3/projects/13e208f36f34431d8aeb1b4c10bb2114` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:48.789430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd4e59-7372-4405-bb9a-959a8ea99cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e208f36f34431d8aeb1b4c10bb2114)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:48.791545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd4e59-7372-4405-bb9a-959a8ea99cc2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:48.803433 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246dcf8-4098-4df8-9cd4-a13898938ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9782304cc6584b9b83618fe788540770, user_id=0980f07ca315413d974d51e504b9284a, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:48.806475 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246dcf8-4098-4df8-9cd4-a13898938ff7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:48.829914 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1145/2303] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:48 2022] PUT /identity/v3/projects/9782304cc6584b9b83618fe788540770/users/0980f07ca315413d974d51e504b9284a/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:48.840629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af992a9-932a-4a1b-a5b4-040f8c5b2890 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:48.840921 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af992a9-932a-4a1b-a5b4-040f8c5b2890 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:48.841203 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af992a9-932a-4a1b-a5b4-040f8c5b2890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:48.861917 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6afd4e59-7372-4405-bb9a-959a8ea99cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e208f36f34431d8aeb1b4c10bb2114', 'request_id': 'req-6afd4e59-7372-4405-bb9a-959a8ea99cc2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.871318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6afd4e59-7372-4405-bb9a-959a8ea99cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e208f36f34431d8aeb1b4c10bb2114', 'request_id': 'req-6afd4e59-7372-4405-bb9a-959a8ea99cc2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.891353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6afd4e59-7372-4405-bb9a-959a8ea99cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e208f36f34431d8aeb1b4c10bb2114', 'request_id': 'req-6afd4e59-7372-4405-bb9a-959a8ea99cc2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.892275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5af992a9-932a-4a1b-a5b4-040f8c5b2890 None None] MFA Rules not processed for user `0980f07ca315413d974d51e504b9284a`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:48.893919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5af992a9-932a-4a1b-a5b4-040f8c5b2890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:48.903876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6afd4e59-7372-4405-bb9a-959a8ea99cc2 admin admin] The token cache is being invalidate because project 13e208f36f34431d8aeb1b4c10bb2114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:48.904172 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6afd4e59-7372-4405-bb9a-959a8ea99cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.904833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6afd4e59-7372-4405-bb9a-959a8ea99cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:48.906422 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1159/2304] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:48 2022] DELETE /identity/v3/projects/13e208f36f34431d8aeb1b4c10bb2114 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:48.911870 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec999f-5028-4780-b8ea-0a4f80850a10 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:48.912161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec999f-5028-4780-b8ea-0a4f80850a10 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:48.912471 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec999f-5028-4780-b8ea-0a4f80850a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:48.933118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-eeec999f-5028-4780-b8ea-0a4f80850a10 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:48.934586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-eeec999f-5028-4780-b8ea-0a4f80850a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:48.951437 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:48.967814 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1146/2305] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:48 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:48.972996 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af992a9-932a-4a1b-a5b4-040f8c5b2890 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:48.974495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5af992a9-932a-4a1b-a5b4-040f8c5b2890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:48.999394 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1160/2306] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:49.006900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b777689-b53d-42d9-b595-13e7c5098993 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.007187 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b777689-b53d-42d9-b595-13e7c5098993 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.007464 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b777689-b53d-42d9-b595-13e7c5098993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.027644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-2b777689-b53d-42d9-b595-13e7c5098993 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:49.028838 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2b777689-b53d-42d9-b595-13e7c5098993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:49.042247 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1161/2307] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:49.043662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af992a9-932a-4a1b-a5b4-040f8c5b2890 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:49.046495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b777689-b53d-42d9-b595-13e7c5098993 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:49.048718 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578bd54-e0a2-45bb-bd20-da3707966682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:49.049342 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578bd54-e0a2-45bb-bd20-da3707966682 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.049631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578bd54-e0a2-45bb-bd20-da3707966682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.049915 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578bd54-e0a2-45bb-bd20-da3707966682 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.050565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578bd54-e0a2-45bb-bd20-da3707966682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:49.052649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578bd54-e0a2-45bb-bd20-da3707966682 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:49.056266 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b777689-b53d-42d9-b595-13e7c5098993 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:49.062023 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5997a-b443-426c-8b9f-4ecf496b77d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:49.063081 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5997a-b443-426c-8b9f-4ecf496b77d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.063387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5997a-b443-426c-8b9f-4ecf496b77d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.064148 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5997a-b443-426c-8b9f-4ecf496b77d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.065244 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5997a-b443-426c-8b9f-4ecf496b77d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:21:49.065554 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5997a-b443-426c-8b9f-4ecf496b77d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:49.067185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5997a-b443-426c-8b9f-4ecf496b77d1 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:49.080234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1162/2308] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:21:49.081602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1147/2309] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:48 2022] POST /identity/v3/projects => generated 409 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:49.085165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5997a-b443-426c-8b9f-4ecf496b77d1 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:49.085545 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578bd54-e0a2-45bb-bd20-da3707966682 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:49.096481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5997a-b443-426c-8b9f-4ecf496b77d1 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:49.140969 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:49.154448 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578bd54-e0a2-45bb-bd20-da3707966682 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:49.160190 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5329e2-f50b-496e-8e65-2edf2944b810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:49.160839 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5329e2-f50b-496e-8e65-2edf2944b810 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.161114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5329e2-f50b-496e-8e65-2edf2944b810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.161396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5329e2-f50b-496e-8e65-2edf2944b810 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.162069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5329e2-f50b-496e-8e65-2edf2944b810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:49.164182 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5329e2-f50b-496e-8e65-2edf2944b810 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:49.188363 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1148/2310] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:49 2022] POST /identity/v3/users => generated 311 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:49.193427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5329e2-f50b-496e-8e65-2edf2944b810 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:49.203936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5329e2-f50b-496e-8e65-2edf2944b810 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:49.209435 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4892c52-1e1c-4c89-8bb3-067e3a59839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:49.210071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892c52-1e1c-4c89-8bb3-067e3a59839b admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.210358 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892c52-1e1c-4c89-8bb3-067e3a59839b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.210648 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892c52-1e1c-4c89-8bb3-067e3a59839b admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.211851 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4892c52-1e1c-4c89-8bb3-067e3a59839b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:49.213546 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4892c52-1e1c-4c89-8bb3-067e3a59839b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:49.226577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1149/2311] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:49.230058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4892c52-1e1c-4c89-8bb3-067e3a59839b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:49.241664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4892c52-1e1c-4c89-8bb3-067e3a59839b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:49.246393 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9621045-833f-410c-be1c-1a3bcd6ef260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:49.247089 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9621045-833f-410c-be1c-1a3bcd6ef260 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.247380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9621045-833f-410c-be1c-1a3bcd6ef260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.247663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9621045-833f-410c-be1c-1a3bcd6ef260 admin admin] PATH_INFO: `/v3/projects/7c0322e86d0c4b3d945f1d6c932a6d5f/users/ed925f03181c4190b67147d41d337c57/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.262963 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9621045-833f-410c-be1c-1a3bcd6ef260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0322e86d0c4b3d945f1d6c932a6d5f, user_id=ed925f03181c4190b67147d41d337c57, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:49.265654 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9621045-833f-410c-be1c-1a3bcd6ef260 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:49.283106 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1150/2312] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:49 2022] PUT /identity/v3/projects/7c0322e86d0c4b3d945f1d6c932a6d5f/users/ed925f03181c4190b67147d41d337c57/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:49.284491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9621045-833f-410c-be1c-1a3bcd6ef260 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:49.285388 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f2b9c-1bfe-4363-a1e8-4e3c8abf76e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:49.286042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f2b9c-1bfe-4363-a1e8-4e3c8abf76e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.286326 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f2b9c-1bfe-4363-a1e8-4e3c8abf76e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.286594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f2b9c-1bfe-4363-a1e8-4e3c8abf76e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.287293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f2b9c-1bfe-4363-a1e8-4e3c8abf76e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:49.289259 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f2b9c-1bfe-4363-a1e8-4e3c8abf76e6 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:49.320079 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1163/2313] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:49 2022] POST /identity/v3/projects => generated 367 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:49.321150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f2b9c-1bfe-4363-a1e8-4e3c8abf76e6 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:49.355081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9621045-833f-410c-be1c-1a3bcd6ef260 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:49.385400 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f2b9c-1bfe-4363-a1e8-4e3c8abf76e6 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:49.390066 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971040f-622f-4bae-ad1f-4667c6f8a26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:49.390657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971040f-622f-4bae-ad1f-4667c6f8a26e admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.390961 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971040f-622f-4bae-ad1f-4667c6f8a26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.391231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971040f-622f-4bae-ad1f-4667c6f8a26e admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.392444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971040f-622f-4bae-ad1f-4667c6f8a26e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:49.394355 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971040f-622f-4bae-ad1f-4667c6f8a26e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:49.414830 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f74d4-0b7c-4d4a-a3ea-b5241e3d72ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:49.415508 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f74d4-0b7c-4d4a-a3ea-b5241e3d72ee admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.415792 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f74d4-0b7c-4d4a-a3ea-b5241e3d72ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.416072 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f74d4-0b7c-4d4a-a3ea-b5241e3d72ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.419772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1164/2314] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:49 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:49.419945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f74d4-0b7c-4d4a-a3ea-b5241e3d72ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:49.419945 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f74d4-0b7c-4d4a-a3ea-b5241e3d72ee admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:49.421001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971040f-622f-4bae-ad1f-4667c6f8a26e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:49.431710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971040f-622f-4bae-ad1f-4667c6f8a26e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:49.435305 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1151/2315] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:49.437313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d43ff-8fef-4c8c-aa6c-d655eb0d8c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:49.437918 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d43ff-8fef-4c8c-aa6c-d655eb0d8c49 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.438309 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d43ff-8fef-4c8c-aa6c-d655eb0d8c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.439198 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d43ff-8fef-4c8c-aa6c-d655eb0d8c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.439847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d43ff-8fef-4c8c-aa6c-d655eb0d8c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:49.440030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f74d4-0b7c-4d4a-a3ea-b5241e3d72ee admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:49.441476 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d43ff-8fef-4c8c-aa6c-d655eb0d8c49 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:49.449835 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f74d4-0b7c-4d4a-a3ea-b5241e3d72ee admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:49.454374 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1165/2316] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:49.455359 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d43ff-8fef-4c8c-aa6c-d655eb0d8c49 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:49.457277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d314768-5a53-4ec2-b082-43bad90afedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:49.457979 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d314768-5a53-4ec2-b082-43bad90afedf admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.458267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d314768-5a53-4ec2-b082-43bad90afedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.458547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d314768-5a53-4ec2-b082-43bad90afedf admin admin] PATH_INFO: `/v3/projects/7c0322e86d0c4b3d945f1d6c932a6d5f/users/ed925f03181c4190b67147d41d337c57/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.460472 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d314768-5a53-4ec2-b082-43bad90afedf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0322e86d0c4b3d945f1d6c932a6d5f, user_id=ed925f03181c4190b67147d41d337c57, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:49.463157 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d314768-5a53-4ec2-b082-43bad90afedf admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:49.464834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d43ff-8fef-4c8c-aa6c-d655eb0d8c49 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:49.469457 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56205d64-8026-4bcd-a72d-0611f038f37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:49.470125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56205d64-8026-4bcd-a72d-0611f038f37b admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.470370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56205d64-8026-4bcd-a72d-0611f038f37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.470771 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56205d64-8026-4bcd-a72d-0611f038f37b admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.471436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56205d64-8026-4bcd-a72d-0611f038f37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:49.473006 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56205d64-8026-4bcd-a72d-0611f038f37b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:49.474383 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:49.474504 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1152/2317] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:49 2022] PUT /identity/v3/projects/7c0322e86d0c4b3d945f1d6c932a6d5f/users/ed925f03181c4190b67147d41d337c57/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:49.485182 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1166/2318] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:49.487954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc2e4a-e734-4234-8685-c87f4d5cd5b6 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.488318 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc2e4a-e734-4234-8685-c87f4d5cd5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.488705 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc2e4a-e734-4234-8685-c87f4d5cd5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.489666 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56205d64-8026-4bcd-a72d-0611f038f37b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:49.504486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56205d64-8026-4bcd-a72d-0611f038f37b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:49.519190 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-62fc2e4a-e734-4234-8685-c87f4d5cd5b6 None None] MFA Rules not processed for user `ed925f03181c4190b67147d41d337c57`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:49.520424 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-62fc2e4a-e734-4234-8685-c87f4d5cd5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:49.549558 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:49.564477 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d7aed-d393-4003-989f-2caaee303447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:49.565326 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d7aed-d393-4003-989f-2caaee303447 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.565604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d7aed-d393-4003-989f-2caaee303447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.565876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d7aed-d393-4003-989f-2caaee303447 admin admin] PATH_INFO: `/v3/projects/5ecb2da75cf54245815637758d284fac/users/d1ba08badd9a4def943d027f81a58f66/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.581532 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d7aed-d393-4003-989f-2caaee303447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ecb2da75cf54245815637758d284fac, user_id=d1ba08badd9a4def943d027f81a58f66, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:49.585115 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d7aed-d393-4003-989f-2caaee303447 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:49.602083 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1167/2319] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:49 2022] PUT /identity/v3/projects/5ecb2da75cf54245815637758d284fac/users/d1ba08badd9a4def943d027f81a58f66/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:49.613818 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1153/2320] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:49 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:49.614001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29707e8a-68e1-4672-8f63-0cea1a615e8a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.614225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29707e8a-68e1-4672-8f63-0cea1a615e8a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.614501 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29707e8a-68e1-4672-8f63-0cea1a615e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.624152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc2e4a-e734-4234-8685-c87f4d5cd5b6 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:49.625630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-62fc2e4a-e734-4234-8685-c87f4d5cd5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:49.648144 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-29707e8a-68e1-4672-8f63-0cea1a615e8a None None] MFA Rules not processed for user `d1ba08badd9a4def943d027f81a58f66`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:49.649693 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-29707e8a-68e1-4672-8f63-0cea1a615e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:49.687563 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc2e4a-e734-4234-8685-c87f4d5cd5b6 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:49.722932 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1168/2321] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:49.727538 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29707e8a-68e1-4672-8f63-0cea1a615e8a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:49.743961 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1fcaa-fd25-4b00-b5dd-c440a8ca5128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:49.744918 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1fcaa-fd25-4b00-b5dd-c440a8ca5128 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.745204 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1fcaa-fd25-4b00-b5dd-c440a8ca5128 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.745474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1fcaa-fd25-4b00-b5dd-c440a8ca5128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.804445 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29707e8a-68e1-4672-8f63-0cea1a615e8a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:49.811219 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c20da-6348-4c31-9851-a8da06eb5d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:49.811900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c20da-6348-4c31-9851-a8da06eb5d6d admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.812277 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c20da-6348-4c31-9851-a8da06eb5d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.812812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c20da-6348-4c31-9851-a8da06eb5d6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.813359 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c20da-6348-4c31-9851-a8da06eb5d6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:49.815416 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c20da-6348-4c31-9851-a8da06eb5d6d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:49.817317 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1fcaa-fd25-4b00-b5dd-c440a8ca5128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:49.818864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1fcaa-fd25-4b00-b5dd-c440a8ca5128 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:49.829207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1154/2322] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:49 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:21:49.831815 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:49.845187 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1169/2323] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:49 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:49.849482 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1fcaa-fd25-4b00-b5dd-c440a8ca5128 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:49.859920 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1fcaa-fd25-4b00-b5dd-c440a8ca5128 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:49.886783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:49.930037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9034f2c-c477-4e2a-bed0-f72ced7dc75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:49.931100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9034f2c-c477-4e2a-bed0-f72ced7dc75b admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.931441 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9034f2c-c477-4e2a-bed0-f72ced7dc75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.931791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9034f2c-c477-4e2a-bed0-f72ced7dc75b admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.932506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9034f2c-c477-4e2a-bed0-f72ced7dc75b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:49.934793 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9034f2c-c477-4e2a-bed0-f72ced7dc75b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:49.957383 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1155/2324] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:49 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:49.961460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c20da-6348-4c31-9851-a8da06eb5d6d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:49.972446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c20da-6348-4c31-9851-a8da06eb5d6d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:49.977195 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d5b9a-58d6-47bf-8c01-ea38ab2f1c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:49.977827 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d5b9a-58d6-47bf-8c01-ea38ab2f1c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:49.978109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d5b9a-58d6-47bf-8c01-ea38ab2f1c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:49.978637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d5b9a-58d6-47bf-8c01-ea38ab2f1c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:49.979094 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d5b9a-58d6-47bf-8c01-ea38ab2f1c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:49.980803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d5b9a-58d6-47bf-8c01-ea38ab2f1c5f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:49.995507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1170/2325] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:49.996783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9034f2c-c477-4e2a-bed0-f72ced7dc75b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:49.999780 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d5b9a-58d6-47bf-8c01-ea38ab2f1c5f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:50.008640 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9034f2c-c477-4e2a-bed0-f72ced7dc75b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:50.013649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585524b5-6e4b-4126-a662-cef5fcbef69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:50.014387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585524b5-6e4b-4126-a662-cef5fcbef69d admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:50.014758 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585524b5-6e4b-4126-a662-cef5fcbef69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:50.015111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585524b5-6e4b-4126-a662-cef5fcbef69d admin admin] PATH_INFO: `/v3/projects/5421ebcd24a243b99a452ecffd25107d/users/ef0a9796407e4ff48468a9cd9c164148/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:50.031795 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585524b5-6e4b-4126-a662-cef5fcbef69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5421ebcd24a243b99a452ecffd25107d, user_id=ef0a9796407e4ff48468a9cd9c164148, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:50.037367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585524b5-6e4b-4126-a662-cef5fcbef69d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:50.058317 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1156/2326] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:49 2022] PUT /identity/v3/projects/5421ebcd24a243b99a452ecffd25107d/users/ef0a9796407e4ff48468a9cd9c164148/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:50.059368 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585524b5-6e4b-4126-a662-cef5fcbef69d admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:50.064171 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d5b9a-58d6-47bf-8c01-ea38ab2f1c5f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:50.133206 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5350b-304a-412d-a463-0a1150b3bee7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:50.133893 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5350b-304a-412d-a463-0a1150b3bee7 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:50.133995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585524b5-6e4b-4126-a662-cef5fcbef69d admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:50.134356 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5350b-304a-412d-a463-0a1150b3bee7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:50.134691 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5350b-304a-412d-a463-0a1150b3bee7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:50.138633 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255f585-8ed3-4895-b138-41a3a89db374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:50.139281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255f585-8ed3-4895-b138-41a3a89db374 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:50.139567 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255f585-8ed3-4895-b138-41a3a89db374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:50.139845 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255f585-8ed3-4895-b138-41a3a89db374 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:50.140503 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255f585-8ed3-4895-b138-41a3a89db374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:50.142142 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255f585-8ed3-4895-b138-41a3a89db374 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:50.153629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1157/2327] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:21:50.158222 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255f585-8ed3-4895-b138-41a3a89db374 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:50.167805 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255f585-8ed3-4895-b138-41a3a89db374 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:50.173921 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16f283-3ec5-4dd8-b3b2-278be3df06d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:50.174138 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16f283-3ec5-4dd8-b3b2-278be3df06d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:50.174418 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16f283-3ec5-4dd8-b3b2-278be3df06d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:50.174692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16f283-3ec5-4dd8-b3b2-278be3df06d2 admin admin] PATH_INFO: `/v3/projects/5421ebcd24a243b99a452ecffd25107d/users/ef0a9796407e4ff48468a9cd9c164148/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:50.176597 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16f283-3ec5-4dd8-b3b2-278be3df06d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5421ebcd24a243b99a452ecffd25107d, user_id=ef0a9796407e4ff48468a9cd9c164148, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:50.179246 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16f283-3ec5-4dd8-b3b2-278be3df06d2 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:50.190670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1158/2328] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:50 2022] PUT /identity/v3/projects/5421ebcd24a243b99a452ecffd25107d/users/ef0a9796407e4ff48468a9cd9c164148/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:50.200686 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce593432-9e6a-4fde-bd36-a04f2b3e3de7 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:50.200974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce593432-9e6a-4fde-bd36-a04f2b3e3de7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:50.201330 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce593432-9e6a-4fde-bd36-a04f2b3e3de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:50.201906 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5350b-304a-412d-a463-0a1150b3bee7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:50.203396 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5350b-304a-412d-a463-0a1150b3bee7 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:50.213165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1171/2329] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:49 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:21:50.232128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-ce593432-9e6a-4fde-bd36-a04f2b3e3de7 None None] MFA Rules not processed for user `ef0a9796407e4ff48468a9cd9c164148`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:50.233624 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ce593432-9e6a-4fde-bd36-a04f2b3e3de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:50.303168 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1159/2330] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:50.314992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5350b-304a-412d-a463-0a1150b3bee7 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:50.316478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-77f5350b-304a-412d-a463-0a1150b3bee7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:50.327327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5350b-304a-412d-a463-0a1150b3bee7 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:50.377308 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a5a42-f5fe-4218-b46e-94368a47fd10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:50.377916 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a5a42-f5fe-4218-b46e-94368a47fd10 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:50.378194 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a5a42-f5fe-4218-b46e-94368a47fd10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:50.378483 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a5a42-f5fe-4218-b46e-94368a47fd10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:50.385658 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:50.388361 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a5a42-f5fe-4218-b46e-94368a47fd10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:50.390767 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a5a42-f5fe-4218-b46e-94368a47fd10 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:50.401279 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1172/2331] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:50.493737 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce593432-9e6a-4fde-bd36-a04f2b3e3de7 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:50.498695 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:50.519244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce593432-9e6a-4fde-bd36-a04f2b3e3de7 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:50.523291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22998c37-257b-4f76-b35c-f1d15c9d9fdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:50.523928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22998c37-257b-4f76-b35c-f1d15c9d9fdc service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:50.524213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22998c37-257b-4f76-b35c-f1d15c9d9fdc service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:50.524508 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22998c37-257b-4f76-b35c-f1d15c9d9fdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:50.583453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22998c37-257b-4f76-b35c-f1d15c9d9fdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:50.584909 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22998c37-257b-4f76-b35c-f1d15c9d9fdc service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:50.593661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1160/2332] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:52.001597 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a5a42-f5fe-4218-b46e-94368a47fd10 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:52.003157 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ed6a5a42-f5fe-4218-b46e-94368a47fd10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:52.070424 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a5a42-f5fe-4218-b46e-94368a47fd10 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:52.075030 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0879104-c820-425d-8fca-02242b8a57b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:52.075655 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0879104-c820-425d-8fca-02242b8a57b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:52.075938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0879104-c820-425d-8fca-02242b8a57b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:52.076216 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0879104-c820-425d-8fca-02242b8a57b3 admin admin] PATH_INFO: `/v3/users/d22266d9c6ef430c9cb9dc428f95c36b` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:52.077344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0879104-c820-425d-8fca-02242b8a57b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22266d9c6ef430c9cb9dc428f95c36b)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:52.079868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0879104-c820-425d-8fca-02242b8a57b3 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:52.126856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c0879104-c820-425d-8fca-02242b8a57b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22266d9c6ef430c9cb9dc428f95c36b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:52.133955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c0879104-c820-425d-8fca-02242b8a57b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22266d9c6ef430c9cb9dc428f95c36b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:52.151026 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c0879104-c820-425d-8fca-02242b8a57b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22266d9c6ef430c9cb9dc428f95c36b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:52.151743 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c0879104-c820-425d-8fca-02242b8a57b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22266d9c6ef430c9cb9dc428f95c36b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:52.160565 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c0879104-c820-425d-8fca-02242b8a57b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22266d9c6ef430c9cb9dc428f95c36b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:52.167357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1173/2333] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:52 2022] DELETE /identity/v3/users/d22266d9c6ef430c9cb9dc428f95c36b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:52.172172 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594835f-df63-4280-992d-117e0493a257 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:52.172643 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594835f-df63-4280-992d-117e0493a257 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:52.172643 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594835f-df63-4280-992d-117e0493a257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:52.193916 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-6594835f-df63-4280-992d-117e0493a257 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:52.195756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6594835f-df63-4280-992d-117e0493a257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:52.262557 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1161/2334] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:52.273193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0879104-c820-425d-8fca-02242b8a57b3 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:52.274606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c0879104-c820-425d-8fca-02242b8a57b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:52.333758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0879104-c820-425d-8fca-02242b8a57b3 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:52.337747 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a50fa4-d208-4921-ae57-4432c36d105a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:52.338373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a50fa4-d208-4921-ae57-4432c36d105a service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:52.338642 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a50fa4-d208-4921-ae57-4432c36d105a service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:52.338949 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a50fa4-d208-4921-ae57-4432c36d105a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:52.348688 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a50fa4-d208-4921-ae57-4432c36d105a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:52.350217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a50fa4-d208-4921-ae57-4432c36d105a service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:52.360062 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1174/2335] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:52.624061 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594835f-df63-4280-992d-117e0493a257 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:52.625482 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6594835f-df63-4280-992d-117e0493a257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:52.638213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594835f-df63-4280-992d-117e0493a257 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:52.643072 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4f3c8-359e-4e1c-a552-12ebf0566aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:52.643642 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4f3c8-359e-4e1c-a552-12ebf0566aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:52.643922 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4f3c8-359e-4e1c-a552-12ebf0566aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:52.644197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4f3c8-359e-4e1c-a552-12ebf0566aba admin admin] PATH_INFO: `/v3/projects/078743b2442043259fde097d67439f35` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:52.645365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4f3c8-359e-4e1c-a552-12ebf0566aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=078743b2442043259fde097d67439f35)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:52.647317 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4f3c8-359e-4e1c-a552-12ebf0566aba admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:52.695338 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-64b4f3c8-359e-4e1c-a552-12ebf0566aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078743b2442043259fde097d67439f35', 'request_id': 'req-64b4f3c8-359e-4e1c-a552-12ebf0566aba'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:52.701053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-64b4f3c8-359e-4e1c-a552-12ebf0566aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078743b2442043259fde097d67439f35', 'request_id': 'req-64b4f3c8-359e-4e1c-a552-12ebf0566aba'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:52.707138 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-64b4f3c8-359e-4e1c-a552-12ebf0566aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078743b2442043259fde097d67439f35', 'request_id': 'req-64b4f3c8-359e-4e1c-a552-12ebf0566aba'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:52.719102 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-64b4f3c8-359e-4e1c-a552-12ebf0566aba admin admin] The token cache is being invalidate because project 078743b2442043259fde097d67439f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:52.719417 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-64b4f3c8-359e-4e1c-a552-12ebf0566aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:52.720044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-64b4f3c8-359e-4e1c-a552-12ebf0566aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:52.721539 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1162/2336] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:52 2022] DELETE /identity/v3/projects/078743b2442043259fde097d67439f35 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:55.496241 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a50fa4-d208-4921-ae57-4432c36d105a service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:55.497761 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c7a50fa4-d208-4921-ae57-4432c36d105a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:55.510911 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a50fa4-d208-4921-ae57-4432c36d105a service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:55.523103 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:55.569011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e374d-aceb-415a-95e6-9f3e9f43f7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:55.569635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e374d-aceb-415a-95e6-9f3e9f43f7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:55.569915 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e374d-aceb-415a-95e6-9f3e9f43f7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:55.570192 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e374d-aceb-415a-95e6-9f3e9f43f7ba admin admin] PATH_INFO: `/v3/users/d1ba08badd9a4def943d027f81a58f66` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:55.571321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e374d-aceb-415a-95e6-9f3e9f43f7ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ba08badd9a4def943d027f81a58f66)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:55.573239 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e374d-aceb-415a-95e6-9f3e9f43f7ba admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:55.625863 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ae8e374d-aceb-415a-95e6-9f3e9f43f7ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ba08badd9a4def943d027f81a58f66'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:55.632483 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ae8e374d-aceb-415a-95e6-9f3e9f43f7ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ba08badd9a4def943d027f81a58f66'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:55.644828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ae8e374d-aceb-415a-95e6-9f3e9f43f7ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ba08badd9a4def943d027f81a58f66'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:55.645579 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ae8e374d-aceb-415a-95e6-9f3e9f43f7ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ba08badd9a4def943d027f81a58f66'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:55.652884 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ae8e374d-aceb-415a-95e6-9f3e9f43f7ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ba08badd9a4def943d027f81a58f66'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:55.658917 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1175/2337] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:55 2022] DELETE /identity/v3/users/d1ba08badd9a4def943d027f81a58f66 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:55.663412 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31e8dd-0aa2-493e-891c-68ab946f7e8a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:55.663845 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31e8dd-0aa2-493e-891c-68ab946f7e8a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:55.664167 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31e8dd-0aa2-493e-891c-68ab946f7e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:55.685823 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8a31e8dd-0aa2-493e-891c-68ab946f7e8a None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:55.687091 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8a31e8dd-0aa2-493e-891c-68ab946f7e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:55.705303 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:55.746237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1163/2338] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:55.756593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e374d-aceb-415a-95e6-9f3e9f43f7ba admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:55.758016 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ae8e374d-aceb-415a-95e6-9f3e9f43f7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:55.817194 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e374d-aceb-415a-95e6-9f3e9f43f7ba admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:55.821869 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731893c9-2b44-49ca-8ec6-44eb11ce16d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:55.822495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731893c9-2b44-49ca-8ec6-44eb11ce16d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:55.822793 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731893c9-2b44-49ca-8ec6-44eb11ce16d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:55.823073 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731893c9-2b44-49ca-8ec6-44eb11ce16d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:55.832660 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731893c9-2b44-49ca-8ec6-44eb11ce16d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:55.834097 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731893c9-2b44-49ca-8ec6-44eb11ce16d3 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:55.843764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1176/2339] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:56.196724 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31e8dd-0aa2-493e-891c-68ab946f7e8a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:56.198317 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8a31e8dd-0aa2-493e-891c-68ab946f7e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:56.216477 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31e8dd-0aa2-493e-891c-68ab946f7e8a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:56.222797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c3103-f917-4df5-8b3f-43ae74edf383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:56.223434 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c3103-f917-4df5-8b3f-43ae74edf383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:56.223806 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c3103-f917-4df5-8b3f-43ae74edf383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:56.223978 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c3103-f917-4df5-8b3f-43ae74edf383 admin admin] PATH_INFO: `/v3/projects/5ecb2da75cf54245815637758d284fac` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:56.225288 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c3103-f917-4df5-8b3f-43ae74edf383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ecb2da75cf54245815637758d284fac)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:56.227272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c3103-f917-4df5-8b3f-43ae74edf383 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:56.276069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-554c3103-f917-4df5-8b3f-43ae74edf383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ecb2da75cf54245815637758d284fac', 'request_id': 'req-554c3103-f917-4df5-8b3f-43ae74edf383'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.281540 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-554c3103-f917-4df5-8b3f-43ae74edf383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ecb2da75cf54245815637758d284fac', 'request_id': 'req-554c3103-f917-4df5-8b3f-43ae74edf383'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.288068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-554c3103-f917-4df5-8b3f-43ae74edf383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ecb2da75cf54245815637758d284fac', 'request_id': 'req-554c3103-f917-4df5-8b3f-43ae74edf383'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.300164 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-554c3103-f917-4df5-8b3f-43ae74edf383 admin admin] The token cache is being invalidate because project 5ecb2da75cf54245815637758d284fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:56.300463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-554c3103-f917-4df5-8b3f-43ae74edf383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.301097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-554c3103-f917-4df5-8b3f-43ae74edf383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.302596 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1164/2340] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:56 2022] DELETE /identity/v3/projects/5ecb2da75cf54245815637758d284fac => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:56.306539 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731893c9-2b44-49ca-8ec6-44eb11ce16d3 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:56.316082 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731893c9-2b44-49ca-8ec6-44eb11ce16d3 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:56.353765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:56.373300 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84017248-0e3c-4903-9d1e-0cd639edeff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:56.373918 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84017248-0e3c-4903-9d1e-0cd639edeff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:56.374201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84017248-0e3c-4903-9d1e-0cd639edeff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:56.374478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84017248-0e3c-4903-9d1e-0cd639edeff7 admin admin] PATH_INFO: `/v3/users/ef0a9796407e4ff48468a9cd9c164148` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:56.375649 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84017248-0e3c-4903-9d1e-0cd639edeff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef0a9796407e4ff48468a9cd9c164148)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:56.377577 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84017248-0e3c-4903-9d1e-0cd639edeff7 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:56.427338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-84017248-0e3c-4903-9d1e-0cd639edeff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef0a9796407e4ff48468a9cd9c164148'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.434473 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-84017248-0e3c-4903-9d1e-0cd639edeff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef0a9796407e4ff48468a9cd9c164148'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.447604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-84017248-0e3c-4903-9d1e-0cd639edeff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef0a9796407e4ff48468a9cd9c164148'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.448253 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-84017248-0e3c-4903-9d1e-0cd639edeff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef0a9796407e4ff48468a9cd9c164148'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.456725 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-84017248-0e3c-4903-9d1e-0cd639edeff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef0a9796407e4ff48468a9cd9c164148'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.463176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1177/2341] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:56 2022] DELETE /identity/v3/users/ef0a9796407e4ff48468a9cd9c164148 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:56.561364 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c3103-f917-4df5-8b3f-43ae74edf383 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:56.563043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-554c3103-f917-4df5-8b3f-43ae74edf383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:56.577967 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c3103-f917-4df5-8b3f-43ae74edf383 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:56.651291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1894f-ce3c-442d-9f01-954ada8747be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:56.651924 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1894f-ce3c-442d-9f01-954ada8747be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:56.652210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1894f-ce3c-442d-9f01-954ada8747be admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:56.652486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1894f-ce3c-442d-9f01-954ada8747be admin admin] PATH_INFO: `/v3/users/0980f07ca315413d974d51e504b9284a` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:56.653648 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1894f-ce3c-442d-9f01-954ada8747be admin admin] RBAC: Authorizing `identity:delete_user(user_id=0980f07ca315413d974d51e504b9284a)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:56.655634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1894f-ce3c-442d-9f01-954ada8747be admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:56.708151 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-97f1894f-ce3c-442d-9f01-954ada8747be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0980f07ca315413d974d51e504b9284a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.710169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:56.716609 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-97f1894f-ce3c-442d-9f01-954ada8747be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0980f07ca315413d974d51e504b9284a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.717324 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-97f1894f-ce3c-442d-9f01-954ada8747be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0980f07ca315413d974d51e504b9284a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.733216 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-97f1894f-ce3c-442d-9f01-954ada8747be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0980f07ca315413d974d51e504b9284a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.740811 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-97f1894f-ce3c-442d-9f01-954ada8747be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0980f07ca315413d974d51e504b9284a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.745001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84017248-0e3c-4903-9d1e-0cd639edeff7 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:56.746423 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-84017248-0e3c-4903-9d1e-0cd639edeff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:56.753642 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1165/2342] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:56 2022] DELETE /identity/v3/users/0980f07ca315413d974d51e504b9284a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:56.758929 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62d142-1e78-4d7f-92a0-675fe1456578 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:56.759224 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62d142-1e78-4d7f-92a0-675fe1456578 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:56.759504 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62d142-1e78-4d7f-92a0-675fe1456578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:56.760792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84017248-0e3c-4903-9d1e-0cd639edeff7 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:56.779542 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-4e62d142-1e78-4d7f-92a0-675fe1456578 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:56.780754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4e62d142-1e78-4d7f-92a0-675fe1456578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:56.820745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14fc55-d1eb-416a-b57c-879a9e5b30eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:56.821500 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14fc55-d1eb-416a-b57c-879a9e5b30eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:56.821837 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14fc55-d1eb-416a-b57c-879a9e5b30eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:56.822173 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14fc55-d1eb-416a-b57c-879a9e5b30eb admin admin] PATH_INFO: `/v3/projects/5421ebcd24a243b99a452ecffd25107d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:56.823407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14fc55-d1eb-416a-b57c-879a9e5b30eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5421ebcd24a243b99a452ecffd25107d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:56.825306 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14fc55-d1eb-416a-b57c-879a9e5b30eb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:56.840633 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1166/2343] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:56.850086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62d142-1e78-4d7f-92a0-675fe1456578 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:56.851518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4e62d142-1e78-4d7f-92a0-675fe1456578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:56.874403 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2d14fc55-d1eb-416a-b57c-879a9e5b30eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5421ebcd24a243b99a452ecffd25107d', 'request_id': 'req-2d14fc55-d1eb-416a-b57c-879a9e5b30eb'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.881639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2d14fc55-d1eb-416a-b57c-879a9e5b30eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5421ebcd24a243b99a452ecffd25107d', 'request_id': 'req-2d14fc55-d1eb-416a-b57c-879a9e5b30eb'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.889490 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2d14fc55-d1eb-416a-b57c-879a9e5b30eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5421ebcd24a243b99a452ecffd25107d', 'request_id': 'req-2d14fc55-d1eb-416a-b57c-879a9e5b30eb'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.890692 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:56.904765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2d14fc55-d1eb-416a-b57c-879a9e5b30eb admin admin] The token cache is being invalidate because project 5421ebcd24a243b99a452ecffd25107d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:56.905108 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2d14fc55-d1eb-416a-b57c-879a9e5b30eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.905742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2d14fc55-d1eb-416a-b57c-879a9e5b30eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:56.907323 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1178/2344] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:56 2022] DELETE /identity/v3/projects/5421ebcd24a243b99a452ecffd25107d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:21:56.911903 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b7975-2be4-4748-8a87-0e06d1a4afd1 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:56.912080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62d142-1e78-4d7f-92a0-675fe1456578 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:56.912184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b7975-2be4-4748-8a87-0e06d1a4afd1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:56.912459 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b7975-2be4-4748-8a87-0e06d1a4afd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:56.931919 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-972b7975-2be4-4748-8a87-0e06d1a4afd1 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:56.933119 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-972b7975-2be4-4748-8a87-0e06d1a4afd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:56.961877 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98422e9-a27e-43d3-9456-7addecaec6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:56.962414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98422e9-a27e-43d3-9456-7addecaec6ae service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:56.962697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98422e9-a27e-43d3-9456-7addecaec6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:56.963027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98422e9-a27e-43d3-9456-7addecaec6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:56.964774 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c98422e9-a27e-43d3-9456-7addecaec6ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:57.005837 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1179/2345] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:57.007469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3b805-23fd-406c-a4df-abf1239c146e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:57.007757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3b805-23fd-406c-a4df-abf1239c146e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:57.008034 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3b805-23fd-406c-a4df-abf1239c146e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:57.015585 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:57.028270 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-9ac3b805-23fd-406c-a4df-abf1239c146e None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:57.029479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9ac3b805-23fd-406c-a4df-abf1239c146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:57.040109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1180/2346] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:57.043664 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3b805-23fd-406c-a4df-abf1239c146e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:57.054455 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98422e9-a27e-43d3-9456-7addecaec6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:57.055960 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98422e9-a27e-43d3-9456-7addecaec6ae service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:57.056428 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3b805-23fd-406c-a4df-abf1239c146e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:57.061750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009b309-7221-4be4-8630-0f6f2c5c2689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:57.062455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009b309-7221-4be4-8630-0f6f2c5c2689 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:57.062864 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009b309-7221-4be4-8630-0f6f2c5c2689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:57.063867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009b309-7221-4be4-8630-0f6f2c5c2689 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:57.064872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009b309-7221-4be4-8630-0f6f2c5c2689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:21:57.064991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009b309-7221-4be4-8630-0f6f2c5c2689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:57.066741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009b309-7221-4be4-8630-0f6f2c5c2689 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:57.067180 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1167/2347] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:21:57.079562 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1181/2348] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:21:57.083879 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98422e9-a27e-43d3-9456-7addecaec6ae service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:57.096678 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98422e9-a27e-43d3-9456-7addecaec6ae service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:57.103356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92a191-5742-41eb-b14d-5957356cfe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:57.104010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92a191-5742-41eb-b14d-5957356cfe59 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:57.104278 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92a191-5742-41eb-b14d-5957356cfe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:57.104558 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92a191-5742-41eb-b14d-5957356cfe59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:57.105211 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92a191-5742-41eb-b14d-5957356cfe59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:57.107506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92a191-5742-41eb-b14d-5957356cfe59 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:57.138763 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1168/2349] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:57 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:21:57.141950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009b309-7221-4be4-8630-0f6f2c5c2689 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:57.152253 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009b309-7221-4be4-8630-0f6f2c5c2689 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:57.223787 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc886546-6d59-4f78-a752-880adda7e11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:57.224467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc886546-6d59-4f78-a752-880adda7e11a admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:57.224755 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc886546-6d59-4f78-a752-880adda7e11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:57.225051 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc886546-6d59-4f78-a752-880adda7e11a admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:57.225706 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc886546-6d59-4f78-a752-880adda7e11a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:57.227732 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc886546-6d59-4f78-a752-880adda7e11a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:57.250441 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1182/2350] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:57 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:57.255282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92a191-5742-41eb-b14d-5957356cfe59 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:57.266053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92a191-5742-41eb-b14d-5957356cfe59 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:57.272298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b1ae4-d481-4dd6-b4f6-134ef7b4d5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:57.273147 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b1ae4-d481-4dd6-b4f6-134ef7b4d5ff admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:57.273500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b1ae4-d481-4dd6-b4f6-134ef7b4d5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:57.273846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b1ae4-d481-4dd6-b4f6-134ef7b4d5ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:57.274653 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b1ae4-d481-4dd6-b4f6-134ef7b4d5ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:57.276495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b1ae4-d481-4dd6-b4f6-134ef7b4d5ff admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:57.288781 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1169/2351] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:57.292780 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc886546-6d59-4f78-a752-880adda7e11a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:57.304528 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc886546-6d59-4f78-a752-880adda7e11a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:57.310691 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f921b8-7cdf-43d1-8ee0-7c4608b971e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:57.311350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f921b8-7cdf-43d1-8ee0-7c4608b971e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:57.311639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f921b8-7cdf-43d1-8ee0-7c4608b971e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:57.311910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f921b8-7cdf-43d1-8ee0-7c4608b971e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:57.312569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f921b8-7cdf-43d1-8ee0-7c4608b971e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:57.314229 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f921b8-7cdf-43d1-8ee0-7c4608b971e7 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:57.325717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1183/2352] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:57.329981 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b1ae4-d481-4dd6-b4f6-134ef7b4d5ff admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:57.340819 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b1ae4-d481-4dd6-b4f6-134ef7b4d5ff admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:57.346381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73410e58-80be-413c-8d4d-946040c61130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:57.347095 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73410e58-80be-413c-8d4d-946040c61130 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:57.347378 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73410e58-80be-413c-8d4d-946040c61130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:57.347718 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73410e58-80be-413c-8d4d-946040c61130 admin admin] PATH_INFO: `/v3/projects/db04e0430aaa41559485f4cfe42c1a3b/users/e76cb36ebe7e47a4a6d063eb88b0f1ba/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:57.365186 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73410e58-80be-413c-8d4d-946040c61130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db04e0430aaa41559485f4cfe42c1a3b, user_id=e76cb36ebe7e47a4a6d063eb88b0f1ba, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:57.368046 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73410e58-80be-413c-8d4d-946040c61130 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:57.382597 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1170/2353] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:57 2022] PUT /identity/v3/projects/db04e0430aaa41559485f4cfe42c1a3b/users/e76cb36ebe7e47a4a6d063eb88b0f1ba/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:57.393493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e539b-eedc-4714-af40-0ad6ccd9ed59 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:57.393895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e539b-eedc-4714-af40-0ad6ccd9ed59 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:57.394235 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e539b-eedc-4714-af40-0ad6ccd9ed59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:57.426456 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-551e539b-eedc-4714-af40-0ad6ccd9ed59 None None] MFA Rules not processed for user `e76cb36ebe7e47a4a6d063eb88b0f1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:57.427807 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-551e539b-eedc-4714-af40-0ad6ccd9ed59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:57.468625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:57.497234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1184/2354] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:57.509291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73410e58-80be-413c-8d4d-946040c61130 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:57.511093 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-73410e58-80be-413c-8d4d-946040c61130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:57.579031 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73410e58-80be-413c-8d4d-946040c61130 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:57.583033 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054b875-fd64-40b0-9e6e-e417886ab359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:57.583645 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054b875-fd64-40b0-9e6e-e417886ab359 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:57.583926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054b875-fd64-40b0-9e6e-e417886ab359 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:57.584204 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054b875-fd64-40b0-9e6e-e417886ab359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:57.592732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054b875-fd64-40b0-9e6e-e417886ab359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:57.594178 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054b875-fd64-40b0-9e6e-e417886ab359 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:57.603802 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1171/2355] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:57.643874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e539b-eedc-4714-af40-0ad6ccd9ed59 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:57.645387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-551e539b-eedc-4714-af40-0ad6ccd9ed59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:57.714874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e539b-eedc-4714-af40-0ad6ccd9ed59 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:57.719546 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd5bb3-d7ae-44e1-bf24-eaff6cfafa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:57.720682 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd5bb3-d7ae-44e1-bf24-eaff6cfafa88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:57.720960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd5bb3-d7ae-44e1-bf24-eaff6cfafa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:57.721231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd5bb3-d7ae-44e1-bf24-eaff6cfafa88 admin admin] PATH_INFO: `/v3/projects/9782304cc6584b9b83618fe788540770` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:57.722344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd5bb3-d7ae-44e1-bf24-eaff6cfafa88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9782304cc6584b9b83618fe788540770)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:57.724281 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd5bb3-d7ae-44e1-bf24-eaff6cfafa88 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:57.773529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-73cd5bb3-d7ae-44e1-bf24-eaff6cfafa88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9782304cc6584b9b83618fe788540770', 'request_id': 'req-73cd5bb3-d7ae-44e1-bf24-eaff6cfafa88'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:57.779804 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-73cd5bb3-d7ae-44e1-bf24-eaff6cfafa88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9782304cc6584b9b83618fe788540770', 'request_id': 'req-73cd5bb3-d7ae-44e1-bf24-eaff6cfafa88'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:57.788698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-73cd5bb3-d7ae-44e1-bf24-eaff6cfafa88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9782304cc6584b9b83618fe788540770', 'request_id': 'req-73cd5bb3-d7ae-44e1-bf24-eaff6cfafa88'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:57.800287 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-73cd5bb3-d7ae-44e1-bf24-eaff6cfafa88 admin admin] The token cache is being invalidate because project 9782304cc6584b9b83618fe788540770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:57.800577 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-73cd5bb3-d7ae-44e1-bf24-eaff6cfafa88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:57.801214 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-73cd5bb3-d7ae-44e1-bf24-eaff6cfafa88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:57.802891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1185/2356] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:57 2022] DELETE /identity/v3/projects/9782304cc6584b9b83618fe788540770 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:57.806743 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054b875-fd64-40b0-9e6e-e417886ab359 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:57.817349 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054b875-fd64-40b0-9e6e-e417886ab359 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:57.896735 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065d057-8281-44a4-b9b6-2cbc4b1e93c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:57.897610 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065d057-8281-44a4-b9b6-2cbc4b1e93c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:57.898060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065d057-8281-44a4-b9b6-2cbc4b1e93c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:57.899189 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065d057-8281-44a4-b9b6-2cbc4b1e93c8 admin admin] PATH_INFO: `/v3/users/ed925f03181c4190b67147d41d337c57` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:57.900820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065d057-8281-44a4-b9b6-2cbc4b1e93c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed925f03181c4190b67147d41d337c57)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:57.903070 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065d057-8281-44a4-b9b6-2cbc4b1e93c8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:57.943768 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:57.973345 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8065d057-8281-44a4-b9b6-2cbc4b1e93c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed925f03181c4190b67147d41d337c57'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:57.980337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8065d057-8281-44a4-b9b6-2cbc4b1e93c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed925f03181c4190b67147d41d337c57'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:57.981005 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8065d057-8281-44a4-b9b6-2cbc4b1e93c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed925f03181c4190b67147d41d337c57'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:57.994004 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8065d057-8281-44a4-b9b6-2cbc4b1e93c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed925f03181c4190b67147d41d337c57'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:58.001589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8065d057-8281-44a4-b9b6-2cbc4b1e93c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed925f03181c4190b67147d41d337c57'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:58.007951 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1172/2357] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:57 2022] DELETE /identity/v3/users/ed925f03181c4190b67147d41d337c57 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:58.284160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd5bb3-d7ae-44e1-bf24-eaff6cfafa88 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:58.285557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-73cd5bb3-d7ae-44e1-bf24-eaff6cfafa88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:58.298135 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd5bb3-d7ae-44e1-bf24-eaff6cfafa88 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:58.357782 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf36cd-1908-45b2-a6e2-b2df33eab2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:58.358419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf36cd-1908-45b2-a6e2-b2df33eab2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:58.358851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf36cd-1908-45b2-a6e2-b2df33eab2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:58.359182 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf36cd-1908-45b2-a6e2-b2df33eab2a3 admin admin] PATH_INFO: `/v3/projects/7c0322e86d0c4b3d945f1d6c932a6d5f` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:58.360333 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf36cd-1908-45b2-a6e2-b2df33eab2a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0322e86d0c4b3d945f1d6c932a6d5f)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:58.362283 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf36cd-1908-45b2-a6e2-b2df33eab2a3 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:58.372831 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:58.417398 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1dbf36cd-1908-45b2-a6e2-b2df33eab2a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0322e86d0c4b3d945f1d6c932a6d5f', 'request_id': 'req-1dbf36cd-1908-45b2-a6e2-b2df33eab2a3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:58.423973 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1dbf36cd-1908-45b2-a6e2-b2df33eab2a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0322e86d0c4b3d945f1d6c932a6d5f', 'request_id': 'req-1dbf36cd-1908-45b2-a6e2-b2df33eab2a3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:58.431845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1dbf36cd-1908-45b2-a6e2-b2df33eab2a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0322e86d0c4b3d945f1d6c932a6d5f', 'request_id': 'req-1dbf36cd-1908-45b2-a6e2-b2df33eab2a3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:58.444271 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1dbf36cd-1908-45b2-a6e2-b2df33eab2a3 admin admin] The token cache is being invalidate because project 7c0322e86d0c4b3d945f1d6c932a6d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:58.444627 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1dbf36cd-1908-45b2-a6e2-b2df33eab2a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:58.445320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1dbf36cd-1908-45b2-a6e2-b2df33eab2a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:58.446922 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1186/2358] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:58 2022] DELETE /identity/v3/projects/7c0322e86d0c4b3d945f1d6c932a6d5f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:58.452043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710553b1-a736-43cd-98f0-b303a70ab3d0 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:58.452332 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710553b1-a736-43cd-98f0-b303a70ab3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:58.452614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710553b1-a736-43cd-98f0-b303a70ab3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:58.471987 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-710553b1-a736-43cd-98f0-b303a70ab3d0 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:58.473197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-710553b1-a736-43cd-98f0-b303a70ab3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:58.532907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1173/2359] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:58.540701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144d3d3-9277-4b61-9d5f-444f30511356 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:58.541055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144d3d3-9277-4b61-9d5f-444f30511356 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:58.541355 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144d3d3-9277-4b61-9d5f-444f30511356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:58.561154 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-6144d3d3-9277-4b61-9d5f-444f30511356 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:58.562352 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6144d3d3-9277-4b61-9d5f-444f30511356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:58.570942 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1187/2360] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:58.575013 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710553b1-a736-43cd-98f0-b303a70ab3d0 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:58.584772 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710553b1-a736-43cd-98f0-b303a70ab3d0 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:58.589294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2210f14-18e2-4c81-bc67-87d079b8936b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:58.589921 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2210f14-18e2-4c81-bc67-87d079b8936b admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:58.590195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2210f14-18e2-4c81-bc67-87d079b8936b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:58.590467 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2210f14-18e2-4c81-bc67-87d079b8936b admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:58.591155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2210f14-18e2-4c81-bc67-87d079b8936b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:21:58.591456 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2210f14-18e2-4c81-bc67-87d079b8936b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:58.593037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2210f14-18e2-4c81-bc67-87d079b8936b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:58.609000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1174/2361] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:21:58.610810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144d3d3-9277-4b61-9d5f-444f30511356 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:58.620277 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144d3d3-9277-4b61-9d5f-444f30511356 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:58.624952 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e269b-d80f-4235-bb4b-a0314cede34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:58.625524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e269b-d80f-4235-bb4b-a0314cede34f admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:58.626420 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e269b-d80f-4235-bb4b-a0314cede34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:58.626693 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e269b-d80f-4235-bb4b-a0314cede34f admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:58.627362 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e269b-d80f-4235-bb4b-a0314cede34f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:58.629239 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e269b-d80f-4235-bb4b-a0314cede34f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:58.661882 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1188/2362] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:21:58 2022] POST /identity/v3/projects => generated 361 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:58.670433 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2210f14-18e2-4c81-bc67-87d079b8936b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:58.680727 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2210f14-18e2-4c81-bc67-87d079b8936b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:58.739783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfbc08-b904-4f08-b4e7-dee848f75ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:58.740397 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfbc08-b904-4f08-b4e7-dee848f75ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:58.740689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfbc08-b904-4f08-b4e7-dee848f75ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:58.741118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfbc08-b904-4f08-b4e7-dee848f75ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:58.741821 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfbc08-b904-4f08-b4e7-dee848f75ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:58.743764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfbc08-b904-4f08-b4e7-dee848f75ca2 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:58.770577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1175/2363] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:21:58 2022] POST /identity/v3/users => generated 281 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:21:58.771820 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e269b-d80f-4235-bb4b-a0314cede34f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:58.783256 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e269b-d80f-4235-bb4b-a0314cede34f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:58.787948 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ab52c-266e-4ed6-b1f1-15f889039f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:58.788638 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ab52c-266e-4ed6-b1f1-15f889039f4d admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:58.788938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ab52c-266e-4ed6-b1f1-15f889039f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:58.789281 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ab52c-266e-4ed6-b1f1-15f889039f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:58.789955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ab52c-266e-4ed6-b1f1-15f889039f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:58.791681 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ab52c-266e-4ed6-b1f1-15f889039f4d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:58.802206 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1189/2364] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:58.806215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfbc08-b904-4f08-b4e7-dee848f75ca2 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:58.822771 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfbc08-b904-4f08-b4e7-dee848f75ca2 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:58.828306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ba61d-e5a7-4972-bfe8-c4e9a932adf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:58.829583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ba61d-e5a7-4972-bfe8-c4e9a932adf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:58.829897 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ba61d-e5a7-4972-bfe8-c4e9a932adf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:58.830169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ba61d-e5a7-4972-bfe8-c4e9a932adf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:58.830944 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ba61d-e5a7-4972-bfe8-c4e9a932adf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:58.832631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ba61d-e5a7-4972-bfe8-c4e9a932adf7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:58.844764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1176/2365] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:21:58.848991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ab52c-266e-4ed6-b1f1-15f889039f4d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:58.861813 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ab52c-266e-4ed6-b1f1-15f889039f4d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:58.867617 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb5f0d-b783-4e25-9ef3-c32d38a49b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:58.868507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb5f0d-b783-4e25-9ef3-c32d38a49b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:58.868893 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb5f0d-b783-4e25-9ef3-c32d38a49b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:58.869392 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb5f0d-b783-4e25-9ef3-c32d38a49b82 admin admin] PATH_INFO: `/v3/projects/e08bfd1ed8dd412abf5fac3c40779b50/users/a31a31d7cb134a50afe9412cebd36cad/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:58.888670 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb5f0d-b783-4e25-9ef3-c32d38a49b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08bfd1ed8dd412abf5fac3c40779b50, user_id=a31a31d7cb134a50afe9412cebd36cad, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:58.892755 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb5f0d-b783-4e25-9ef3-c32d38a49b82 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:58.922610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1190/2366] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:21:58 2022] PUT /identity/v3/projects/e08bfd1ed8dd412abf5fac3c40779b50/users/a31a31d7cb134a50afe9412cebd36cad/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:58.924954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f1198-4d0c-4fd2-888c-cb7c437d5be0 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:58.925600 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f1198-4d0c-4fd2-888c-cb7c437d5be0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:58.925600 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f1198-4d0c-4fd2-888c-cb7c437d5be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:58.934215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:58.961704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e22f1198-4d0c-4fd2-888c-cb7c437d5be0 None None] MFA Rules not processed for user `a31a31d7cb134a50afe9412cebd36cad`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:58.962951 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e22f1198-4d0c-4fd2-888c-cb7c437d5be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:59.028536 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1177/2367] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:59.062504 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb5f0d-b783-4e25-9ef3-c32d38a49b82 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:59.064870 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2eeb5f0d-b783-4e25-9ef3-c32d38a49b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:59.128758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb5f0d-b783-4e25-9ef3-c32d38a49b82 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:59.132876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13964042-26cd-40f0-a671-fc726497567e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:59.133480 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13964042-26cd-40f0-a671-fc726497567e service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:59.133756 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13964042-26cd-40f0-a671-fc726497567e service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:59.134627 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13964042-26cd-40f0-a671-fc726497567e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:59.148832 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13964042-26cd-40f0-a671-fc726497567e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:59.150363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13964042-26cd-40f0-a671-fc726497567e service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:59.161080 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1191/2368] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:59.177897 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f1198-4d0c-4fd2-888c-cb7c437d5be0 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:59.249055 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f1198-4d0c-4fd2-888c-cb7c437d5be0 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:59.254159 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e957cac-f66a-4ae9-ab8f-b8f10aba5bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:59.254825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e957cac-f66a-4ae9-ab8f-b8f10aba5bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:59.255113 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e957cac-f66a-4ae9-ab8f-b8f10aba5bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:59.255390 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e957cac-f66a-4ae9-ab8f-b8f10aba5bad admin admin] PATH_INFO: `/v3/users/a31a31d7cb134a50afe9412cebd36cad` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:59.256500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e957cac-f66a-4ae9-ab8f-b8f10aba5bad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a31a31d7cb134a50afe9412cebd36cad)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:59.258428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e957cac-f66a-4ae9-ab8f-b8f10aba5bad admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:59.304607 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9e957cac-f66a-4ae9-ab8f-b8f10aba5bad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a31a31d7cb134a50afe9412cebd36cad'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:59.311364 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9e957cac-f66a-4ae9-ab8f-b8f10aba5bad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a31a31d7cb134a50afe9412cebd36cad'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:59.312024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9e957cac-f66a-4ae9-ab8f-b8f10aba5bad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a31a31d7cb134a50afe9412cebd36cad'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:59.324175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9e957cac-f66a-4ae9-ab8f-b8f10aba5bad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a31a31d7cb134a50afe9412cebd36cad'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:59.331225 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9e957cac-f66a-4ae9-ab8f-b8f10aba5bad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a31a31d7cb134a50afe9412cebd36cad'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:59.337049 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1178/2369] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:21:59 2022] DELETE /identity/v3/users/a31a31d7cb134a50afe9412cebd36cad => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:59.341506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd95bcc-acda-4d00-928c-ea16cb047174 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:59.341862 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd95bcc-acda-4d00-928c-ea16cb047174 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:59.343071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd95bcc-acda-4d00-928c-ea16cb047174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:59.362547 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ecd95bcc-acda-4d00-928c-ea16cb047174 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:59.363750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ecd95bcc-acda-4d00-928c-ea16cb047174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:59.395211 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:59.423458 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1192/2370] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:21:59.433053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e957cac-f66a-4ae9-ab8f-b8f10aba5bad admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:59.434452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9e957cac-f66a-4ae9-ab8f-b8f10aba5bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:59.449289 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:21:59.492720 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e957cac-f66a-4ae9-ab8f-b8f10aba5bad admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:59.496394 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8c472-b05b-4159-a548-5e26a24ed33f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:59.496998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8c472-b05b-4159-a548-5e26a24ed33f service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:59.497286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8c472-b05b-4159-a548-5e26a24ed33f service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:59.497566 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8c472-b05b-4159-a548-5e26a24ed33f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:59.507087 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8c472-b05b-4159-a548-5e26a24ed33f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:59.508528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8c472-b05b-4159-a548-5e26a24ed33f service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:59.517886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1179/2371] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:21:59.782673 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd95bcc-acda-4d00-928c-ea16cb047174 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:21:59.784159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ecd95bcc-acda-4d00-928c-ea16cb047174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:59.796893 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd95bcc-acda-4d00-928c-ea16cb047174 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:21:59.802139 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c022a8a-ad26-4d43-8c19-c65c4166a44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:21:59.802809 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c022a8a-ad26-4d43-8c19-c65c4166a44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:59.803094 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c022a8a-ad26-4d43-8c19-c65c4166a44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:59.803370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c022a8a-ad26-4d43-8c19-c65c4166a44b admin admin] PATH_INFO: `/v3/projects/e08bfd1ed8dd412abf5fac3c40779b50` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:59.804514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c022a8a-ad26-4d43-8c19-c65c4166a44b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08bfd1ed8dd412abf5fac3c40779b50)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:21:59.806453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c022a8a-ad26-4d43-8c19-c65c4166a44b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:21:59.854508 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7c022a8a-ad26-4d43-8c19-c65c4166a44b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08bfd1ed8dd412abf5fac3c40779b50', 'request_id': 'req-7c022a8a-ad26-4d43-8c19-c65c4166a44b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:59.861758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7c022a8a-ad26-4d43-8c19-c65c4166a44b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08bfd1ed8dd412abf5fac3c40779b50', 'request_id': 'req-7c022a8a-ad26-4d43-8c19-c65c4166a44b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:59.869088 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7c022a8a-ad26-4d43-8c19-c65c4166a44b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08bfd1ed8dd412abf5fac3c40779b50', 'request_id': 'req-7c022a8a-ad26-4d43-8c19-c65c4166a44b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:59.879903 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7c022a8a-ad26-4d43-8c19-c65c4166a44b admin admin] The token cache is being invalidate because project e08bfd1ed8dd412abf5fac3c40779b50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:21:59.880188 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7c022a8a-ad26-4d43-8c19-c65c4166a44b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:59.880817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7c022a8a-ad26-4d43-8c19-c65c4166a44b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:21:59.882259 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1193/2372] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:21:59 2022] DELETE /identity/v3/projects/e08bfd1ed8dd412abf5fac3c40779b50 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:21:59.887806 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5502e-f76b-47f7-a138-52582bf7a55f None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:59.888264 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5502e-f76b-47f7-a138-52582bf7a55f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:59.888376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5502e-f76b-47f7-a138-52582bf7a55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:21:59.908032 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-18f5502e-f76b-47f7-a138-52582bf7a55f None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:21:59.909213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-18f5502e-f76b-47f7-a138-52582bf7a55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:21:59.974010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1180/2373] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:21:59.981776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82b89a-9cc5-4120-8f26-428c681c113f None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:21:59.983002 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82b89a-9cc5-4120-8f26-428c681c113f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:21:59.983312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82b89a-9cc5-4120-8f26-428c681c113f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:00.005970 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-eb82b89a-9cc5-4120-8f26-428c681c113f None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:22:00.007190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-eb82b89a-9cc5-4120-8f26-428c681c113f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:00.015082 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1194/2374] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:22:00.020039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5502e-f76b-47f7-a138-52582bf7a55f None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:00.029920 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5502e-f76b-47f7-a138-52582bf7a55f None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:00.035304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854cdcf-1c12-4789-b631-d820a613b7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:00.035975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854cdcf-1c12-4789-b631-d820a613b7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:00.036332 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854cdcf-1c12-4789-b631-d820a613b7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:00.036701 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854cdcf-1c12-4789-b631-d820a613b7d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:00.037423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854cdcf-1c12-4789-b631-d820a613b7d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:22:00.037800 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854cdcf-1c12-4789-b631-d820a613b7d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:00.039512 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854cdcf-1c12-4789-b631-d820a613b7d7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:00.051481 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1181/2375] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:22:00.055973 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82b89a-9cc5-4120-8f26-428c681c113f None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:00.065288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82b89a-9cc5-4120-8f26-428c681c113f None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:00.069861 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10525df2-5aca-4e06-b360-7fddd447a6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:00.070449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10525df2-5aca-4e06-b360-7fddd447a6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:00.070736 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10525df2-5aca-4e06-b360-7fddd447a6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:00.071025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10525df2-5aca-4e06-b360-7fddd447a6b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:00.071678 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10525df2-5aca-4e06-b360-7fddd447a6b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:00.073564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10525df2-5aca-4e06-b360-7fddd447a6b7 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:00.104216 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1195/2376] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:22:00 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:22:00.105481 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854cdcf-1c12-4789-b631-d820a613b7d7 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:00.115818 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854cdcf-1c12-4789-b631-d820a613b7d7 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:00.336875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ad009-6fdc-4bee-a586-ee64bf0da29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:00.337681 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ad009-6fdc-4bee-a586-ee64bf0da29e admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:00.338140 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ad009-6fdc-4bee-a586-ee64bf0da29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:00.338558 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ad009-6fdc-4bee-a586-ee64bf0da29e admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:00.339576 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ad009-6fdc-4bee-a586-ee64bf0da29e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:00.341742 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ad009-6fdc-4bee-a586-ee64bf0da29e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:00.377986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10525df2-5aca-4e06-b360-7fddd447a6b7 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:00.378623 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1182/2377] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:22:00 2022] POST /identity/v3/users => generated 287 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:22:00.397334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10525df2-5aca-4e06-b360-7fddd447a6b7 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:00.405099 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe90ca-b27b-47bc-b5d1-c2512338b921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:00.405877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe90ca-b27b-47bc-b5d1-c2512338b921 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:00.406044 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe90ca-b27b-47bc-b5d1-c2512338b921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:00.406289 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe90ca-b27b-47bc-b5d1-c2512338b921 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:00.407030 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe90ca-b27b-47bc-b5d1-c2512338b921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:00.408978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe90ca-b27b-47bc-b5d1-c2512338b921 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:00.422758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1196/2378] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:22:00.426467 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ad009-6fdc-4bee-a586-ee64bf0da29e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:00.438792 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ad009-6fdc-4bee-a586-ee64bf0da29e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:00.443844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e9dcd-02c6-4e7b-98ec-b0679eaff31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:00.444549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e9dcd-02c6-4e7b-98ec-b0679eaff31e admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:00.444829 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e9dcd-02c6-4e7b-98ec-b0679eaff31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:00.445214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e9dcd-02c6-4e7b-98ec-b0679eaff31e admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:00.446154 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e9dcd-02c6-4e7b-98ec-b0679eaff31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:00.447902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e9dcd-02c6-4e7b-98ec-b0679eaff31e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:00.467519 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe90ca-b27b-47bc-b5d1-c2512338b921 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:00.470805 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1183/2379] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:22:00.481555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe90ca-b27b-47bc-b5d1-c2512338b921 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:00.489849 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd82e8c-5f96-4174-a59c-1f6df5dcfa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:00.490487 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd82e8c-5f96-4174-a59c-1f6df5dcfa87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:00.490802 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd82e8c-5f96-4174-a59c-1f6df5dcfa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:00.491080 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd82e8c-5f96-4174-a59c-1f6df5dcfa87 admin admin] PATH_INFO: `/v3/projects/6ed8abe129004d5f80f14b48d9dc4365/users/12d95c07b86343ad9c05bd2a8e3ea7c4/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:00.511422 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd82e8c-5f96-4174-a59c-1f6df5dcfa87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed8abe129004d5f80f14b48d9dc4365, user_id=12d95c07b86343ad9c05bd2a8e3ea7c4, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:00.514371 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd82e8c-5f96-4174-a59c-1f6df5dcfa87 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:00.534267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1197/2380] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:22:00 2022] PUT /identity/v3/projects/6ed8abe129004d5f80f14b48d9dc4365/users/12d95c07b86343ad9c05bd2a8e3ea7c4/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:22:00.544491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd26391-41e0-4a33-ab48-71169d093b51 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:00.544774 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd26391-41e0-4a33-ab48-71169d093b51 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:00.545049 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd26391-41e0-4a33-ab48-71169d093b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:00.576870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1fd26391-41e0-4a33-ab48-71169d093b51 None None] MFA Rules not processed for user `12d95c07b86343ad9c05bd2a8e3ea7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:22:00.578486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1fd26391-41e0-4a33-ab48-71169d093b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:00.590607 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:22:00.676400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1184/2381] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:22:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:22:00.690810 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd82e8c-5f96-4174-a59c-1f6df5dcfa87 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:00.692877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bdd82e8c-5f96-4174-a59c-1f6df5dcfa87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:00.756550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd82e8c-5f96-4174-a59c-1f6df5dcfa87 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:00.760456 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a41e97-0f84-49cc-8a64-b38db9c3ce42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:00.761454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a41e97-0f84-49cc-8a64-b38db9c3ce42 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:00.762013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a41e97-0f84-49cc-8a64-b38db9c3ce42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:00.762433 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a41e97-0f84-49cc-8a64-b38db9c3ce42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:00.771983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a41e97-0f84-49cc-8a64-b38db9c3ce42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:00.773062 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a41e97-0f84-49cc-8a64-b38db9c3ce42 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:00.777677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:22:00.783245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1198/2382] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:22:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:22:00.811717 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd26391-41e0-4a33-ab48-71169d093b51 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:00.880853 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd26391-41e0-4a33-ab48-71169d093b51 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:00.885639 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528b395-7c2d-49b0-a8b4-1afd149040d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:00.886251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528b395-7c2d-49b0-a8b4-1afd149040d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:00.886514 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528b395-7c2d-49b0-a8b4-1afd149040d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:00.886867 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528b395-7c2d-49b0-a8b4-1afd149040d6 admin admin] PATH_INFO: `/v3/users/12d95c07b86343ad9c05bd2a8e3ea7c4` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:00.888006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528b395-7c2d-49b0-a8b4-1afd149040d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d95c07b86343ad9c05bd2a8e3ea7c4)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:00.890390 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528b395-7c2d-49b0-a8b4-1afd149040d6 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:00.935950 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f528b395-7c2d-49b0-a8b4-1afd149040d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d95c07b86343ad9c05bd2a8e3ea7c4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:00.943766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f528b395-7c2d-49b0-a8b4-1afd149040d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d95c07b86343ad9c05bd2a8e3ea7c4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:00.944539 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f528b395-7c2d-49b0-a8b4-1afd149040d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d95c07b86343ad9c05bd2a8e3ea7c4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:00.956771 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f528b395-7c2d-49b0-a8b4-1afd149040d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d95c07b86343ad9c05bd2a8e3ea7c4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:00.964089 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f528b395-7c2d-49b0-a8b4-1afd149040d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d95c07b86343ad9c05bd2a8e3ea7c4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:00.970342 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1185/2383] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:22:00 2022] DELETE /identity/v3/users/12d95c07b86343ad9c05bd2a8e3ea7c4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:22:00.975106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067644d-852d-4e68-9d6c-5db267f5d1f4 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:00.975557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067644d-852d-4e68-9d6c-5db267f5d1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:00.975688 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067644d-852d-4e68-9d6c-5db267f5d1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:00.996752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-4067644d-852d-4e68-9d6c-5db267f5d1f4 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:22:00.997767 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4067644d-852d-4e68-9d6c-5db267f5d1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:01.056205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1199/2384] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:22:01.065848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528b395-7c2d-49b0-a8b4-1afd149040d6 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:01.067203 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f528b395-7c2d-49b0-a8b4-1afd149040d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:01.100868 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:22:01.126286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528b395-7c2d-49b0-a8b4-1afd149040d6 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:01.129875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa37e65-3952-4619-8a0f-2d97d416949b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:01.130470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa37e65-3952-4619-8a0f-2d97d416949b service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:01.130771 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa37e65-3952-4619-8a0f-2d97d416949b service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:01.131071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa37e65-3952-4619-8a0f-2d97d416949b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:01.139804 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa37e65-3952-4619-8a0f-2d97d416949b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:01.141223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa37e65-3952-4619-8a0f-2d97d416949b service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:01.150277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1186/2385] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:22:01.419840 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067644d-852d-4e68-9d6c-5db267f5d1f4 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:01.422043 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4067644d-852d-4e68-9d6c-5db267f5d1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:01.436541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067644d-852d-4e68-9d6c-5db267f5d1f4 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:01.441264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787732c-8b90-49c1-a472-ae37231c56ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:01.441887 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787732c-8b90-49c1-a472-ae37231c56ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:01.442168 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787732c-8b90-49c1-a472-ae37231c56ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:01.442444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787732c-8b90-49c1-a472-ae37231c56ef admin admin] PATH_INFO: `/v3/projects/6ed8abe129004d5f80f14b48d9dc4365` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:01.444110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787732c-8b90-49c1-a472-ae37231c56ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed8abe129004d5f80f14b48d9dc4365)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:01.446115 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787732c-8b90-49c1-a472-ae37231c56ef admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:01.495262 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5787732c-8b90-49c1-a472-ae37231c56ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed8abe129004d5f80f14b48d9dc4365', 'request_id': 'req-5787732c-8b90-49c1-a472-ae37231c56ef'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:01.503160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5787732c-8b90-49c1-a472-ae37231c56ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed8abe129004d5f80f14b48d9dc4365', 'request_id': 'req-5787732c-8b90-49c1-a472-ae37231c56ef'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:01.512800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5787732c-8b90-49c1-a472-ae37231c56ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed8abe129004d5f80f14b48d9dc4365', 'request_id': 'req-5787732c-8b90-49c1-a472-ae37231c56ef'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:01.527572 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5787732c-8b90-49c1-a472-ae37231c56ef admin admin] The token cache is being invalidate because project 6ed8abe129004d5f80f14b48d9dc4365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:22:01.527865 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5787732c-8b90-49c1-a472-ae37231c56ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:01.528526 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5787732c-8b90-49c1-a472-ae37231c56ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:01.530266 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1200/2386] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:22:01 2022] DELETE /identity/v3/projects/6ed8abe129004d5f80f14b48d9dc4365 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:22:03.522487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110c966-22a5-49aa-aa3a-962157f44111 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:03.523012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110c966-22a5-49aa-aa3a-962157f44111 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:03.523126 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110c966-22a5-49aa-aa3a-962157f44111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:03.542494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-7110c966-22a5-49aa-aa3a-962157f44111 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:22:03.543741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7110c966-22a5-49aa-aa3a-962157f44111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:03.602289 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1187/2387] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 27 04:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:22:03.632117 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787732c-8b90-49c1-a472-ae37231c56ef admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:03.633630 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5787732c-8b90-49c1-a472-ae37231c56ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:03.710862 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787732c-8b90-49c1-a472-ae37231c56ef admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:03.717169 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526468d-79df-4e5c-94f0-4489c34e51ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:03.717930 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526468d-79df-4e5c-94f0-4489c34e51ee service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:03.718234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526468d-79df-4e5c-94f0-4489c34e51ee service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:03.718508 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526468d-79df-4e5c-94f0-4489c34e51ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:03.727418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526468d-79df-4e5c-94f0-4489c34e51ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:03.729039 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526468d-79df-4e5c-94f0-4489c34e51ee service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:03.738625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1201/2388] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:22:07.474883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c338e-29ad-42e1-a5ee-88d6dbfbd3a1 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:07.475415 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c338e-29ad-42e1-a5ee-88d6dbfbd3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:07.475415 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c338e-29ad-42e1-a5ee-88d6dbfbd3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:07.494861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9e1c338e-29ad-42e1-a5ee-88d6dbfbd3a1 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:22:07.496045 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9e1c338e-29ad-42e1-a5ee-88d6dbfbd3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:07.503652 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1188/2389] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 27 04:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:22:07.516960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526468d-79df-4e5c-94f0-4489c34e51ee service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:07.528585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526468d-79df-4e5c-94f0-4489c34e51ee service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:07.535074 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bf633-e209-42f5-bdf7-ee24a9daf294 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:07.535735 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bf633-e209-42f5-bdf7-ee24a9daf294 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:07.536083 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bf633-e209-42f5-bdf7-ee24a9daf294 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:07.536424 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bf633-e209-42f5-bdf7-ee24a9daf294 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:07.542614 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:22:07.545086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bf633-e209-42f5-bdf7-ee24a9daf294 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:07.546791 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bf633-e209-42f5-bdf7-ee24a9daf294 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:07.558500 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1202/2390] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:22:11.386101 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c338e-29ad-42e1-a5ee-88d6dbfbd3a1 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:11.387518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9e1c338e-29ad-42e1-a5ee-88d6dbfbd3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:11.399392 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c338e-29ad-42e1-a5ee-88d6dbfbd3a1 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:11.404143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7eb25-cb68-4aa8-acce-90a508db768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:11.404769 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7eb25-cb68-4aa8-acce-90a508db768a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:11.405051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7eb25-cb68-4aa8-acce-90a508db768a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:11.405325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7eb25-cb68-4aa8-acce-90a508db768a admin admin] PATH_INFO: `/v3/users/e76cb36ebe7e47a4a6d063eb88b0f1ba` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:11.406445 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7eb25-cb68-4aa8-acce-90a508db768a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e76cb36ebe7e47a4a6d063eb88b0f1ba)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:11.408400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7eb25-cb68-4aa8-acce-90a508db768a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:11.456592 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-65a7eb25-cb68-4aa8-acce-90a508db768a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e76cb36ebe7e47a4a6d063eb88b0f1ba'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:11.463823 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-65a7eb25-cb68-4aa8-acce-90a508db768a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e76cb36ebe7e47a4a6d063eb88b0f1ba'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:11.464523 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-65a7eb25-cb68-4aa8-acce-90a508db768a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e76cb36ebe7e47a4a6d063eb88b0f1ba'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:11.477412 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-65a7eb25-cb68-4aa8-acce-90a508db768a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e76cb36ebe7e47a4a6d063eb88b0f1ba'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:11.485769 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-65a7eb25-cb68-4aa8-acce-90a508db768a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e76cb36ebe7e47a4a6d063eb88b0f1ba'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:11.493537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1189/2391] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:22:11 2022] DELETE /identity/v3/users/e76cb36ebe7e47a4a6d063eb88b0f1ba => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:22:11.497758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500ddaa-364d-4ac8-8c90-1f5f57b006c5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:11.498211 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500ddaa-364d-4ac8-8c90-1f5f57b006c5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:11.498484 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500ddaa-364d-4ac8-8c90-1f5f57b006c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:11.517708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-6500ddaa-364d-4ac8-8c90-1f5f57b006c5 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:22:11.518889 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6500ddaa-364d-4ac8-8c90-1f5f57b006c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:11.580039 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1203/2392] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:22:11.589787 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7eb25-cb68-4aa8-acce-90a508db768a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:11.591425 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-65a7eb25-cb68-4aa8-acce-90a508db768a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:11.645038 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:22:11.661264 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7eb25-cb68-4aa8-acce-90a508db768a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:11.665710 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bf206-a7fc-4aa1-ba19-c7d040c4bdb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:11.666449 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bf206-a7fc-4aa1-ba19-c7d040c4bdb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:11.666795 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bf206-a7fc-4aa1-ba19-c7d040c4bdb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:11.667152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bf206-a7fc-4aa1-ba19-c7d040c4bdb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:11.677094 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bf206-a7fc-4aa1-ba19-c7d040c4bdb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:11.678618 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bf206-a7fc-4aa1-ba19-c7d040c4bdb1 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:11.688199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1190/2393] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:22:11.746442 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aaaf42-135c-4ba0-8d03-0964944312ab None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:11.746709 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aaaf42-135c-4ba0-8d03-0964944312ab None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:11.747050 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aaaf42-135c-4ba0-8d03-0964944312ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:11.767862 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f3aaaf42-135c-4ba0-8d03-0964944312ab None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:22:11.769030 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f3aaaf42-135c-4ba0-8d03-0964944312ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:11.777216 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1204/2394] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 27 04:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:22:11.791825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bf206-a7fc-4aa1-ba19-c7d040c4bdb1 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:11.793267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1e9bf206-a7fc-4aa1-ba19-c7d040c4bdb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:11.877477 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bf206-a7fc-4aa1-ba19-c7d040c4bdb1 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:11.885127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03429b-1018-4f30-9b0f-7389a5b0e213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:11.885749 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03429b-1018-4f30-9b0f-7389a5b0e213 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:11.886036 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03429b-1018-4f30-9b0f-7389a5b0e213 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:11.886314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03429b-1018-4f30-9b0f-7389a5b0e213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:11.896324 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03429b-1018-4f30-9b0f-7389a5b0e213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:11.897931 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03429b-1018-4f30-9b0f-7389a5b0e213 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:11.907856 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1191/2395] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:22:11.963708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aaaf42-135c-4ba0-8d03-0964944312ab None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:11.965155 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f3aaaf42-135c-4ba0-8d03-0964944312ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:11.977770 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aaaf42-135c-4ba0-8d03-0964944312ab None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:11.983932 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed0110-518d-4ca9-9b86-bbc6b3488dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:11.984671 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed0110-518d-4ca9-9b86-bbc6b3488dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:11.984959 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed0110-518d-4ca9-9b86-bbc6b3488dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:11.985238 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed0110-518d-4ca9-9b86-bbc6b3488dd0 admin admin] PATH_INFO: `/v3/projects/db04e0430aaa41559485f4cfe42c1a3b` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:11.986397 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed0110-518d-4ca9-9b86-bbc6b3488dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db04e0430aaa41559485f4cfe42c1a3b)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:11.988641 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed0110-518d-4ca9-9b86-bbc6b3488dd0 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:12.036265 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8eed0110-518d-4ca9-9b86-bbc6b3488dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db04e0430aaa41559485f4cfe42c1a3b', 'request_id': 'req-8eed0110-518d-4ca9-9b86-bbc6b3488dd0'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:12.042221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8eed0110-518d-4ca9-9b86-bbc6b3488dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db04e0430aaa41559485f4cfe42c1a3b', 'request_id': 'req-8eed0110-518d-4ca9-9b86-bbc6b3488dd0'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:12.049457 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8eed0110-518d-4ca9-9b86-bbc6b3488dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db04e0430aaa41559485f4cfe42c1a3b', 'request_id': 'req-8eed0110-518d-4ca9-9b86-bbc6b3488dd0'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:12.060025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8eed0110-518d-4ca9-9b86-bbc6b3488dd0 admin admin] The token cache is being invalidate because project db04e0430aaa41559485f4cfe42c1a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:22:12.060314 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8eed0110-518d-4ca9-9b86-bbc6b3488dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:12.060938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8eed0110-518d-4ca9-9b86-bbc6b3488dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:12.062484 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1205/2396] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:22:11 2022] DELETE /identity/v3/projects/db04e0430aaa41559485f4cfe42c1a3b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:22:12.067305 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f85248-4e75-45a8-b1be-9a49d2e6ad5f None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:12.067596 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f85248-4e75-45a8-b1be-9a49d2e6ad5f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:12.067877 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f85248-4e75-45a8-b1be-9a49d2e6ad5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:12.087489 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-93f85248-4e75-45a8-b1be-9a49d2e6ad5f None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:22:12.088682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-93f85248-4e75-45a8-b1be-9a49d2e6ad5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:12.145991 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1192/2397] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:22:12.153688 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0b4b7-4898-4bdd-945e-1f558b70a217 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:12.153985 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0b4b7-4898-4bdd-945e-1f558b70a217 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:12.154260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0b4b7-4898-4bdd-945e-1f558b70a217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:12.173950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-66a0b4b7-4898-4bdd-945e-1f558b70a217 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:22:12.175169 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-66a0b4b7-4898-4bdd-945e-1f558b70a217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:12.182895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1206/2398] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:22:12.187294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f85248-4e75-45a8-b1be-9a49d2e6ad5f None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:12.196803 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f85248-4e75-45a8-b1be-9a49d2e6ad5f None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:12.201320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e9e20-494d-419d-af6b-fd92c1f38c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:12.201909 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e9e20-494d-419d-af6b-fd92c1f38c54 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:12.202189 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e9e20-494d-419d-af6b-fd92c1f38c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:12.202461 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e9e20-494d-419d-af6b-fd92c1f38c54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:12.203139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e9e20-494d-419d-af6b-fd92c1f38c54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:22:12.203445 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e9e20-494d-419d-af6b-fd92c1f38c54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:12.205034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e9e20-494d-419d-af6b-fd92c1f38c54 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:12.216748 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1193/2399] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:22:12.220948 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0b4b7-4898-4bdd-945e-1f558b70a217 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:12.230991 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0b4b7-4898-4bdd-945e-1f558b70a217 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:12.236138 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b03f26-86d5-48ec-acc5-7642d79a80ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:12.236963 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b03f26-86d5-48ec-acc5-7642d79a80ab admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:12.237240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b03f26-86d5-48ec-acc5-7642d79a80ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:12.237514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b03f26-86d5-48ec-acc5-7642d79a80ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:12.238152 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b03f26-86d5-48ec-acc5-7642d79a80ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:12.240093 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b03f26-86d5-48ec-acc5-7642d79a80ab admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:12.269169 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1207/2400] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:22:12 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:22:12.273348 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e9e20-494d-419d-af6b-fd92c1f38c54 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:12.284034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e9e20-494d-419d-af6b-fd92c1f38c54 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:12.337633 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:22:12.345018 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2bf64-c334-4672-bf97-754c47aff571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:12.345660 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2bf64-c334-4672-bf97-754c47aff571 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:12.345947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2bf64-c334-4672-bf97-754c47aff571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:12.346228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2bf64-c334-4672-bf97-754c47aff571 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:12.346905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2bf64-c334-4672-bf97-754c47aff571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:12.348861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2bf64-c334-4672-bf97-754c47aff571 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:12.374196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1194/2401] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:22:12 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:22:12.375061 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b03f26-86d5-48ec-acc5-7642d79a80ab admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:12.385981 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b03f26-86d5-48ec-acc5-7642d79a80ab admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:12.390883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bc6a6-3917-4a8b-9f1c-675b2fa084e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:12.391591 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bc6a6-3917-4a8b-9f1c-675b2fa084e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:12.391947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bc6a6-3917-4a8b-9f1c-675b2fa084e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:12.392299 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bc6a6-3917-4a8b-9f1c-675b2fa084e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:12.393096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bc6a6-3917-4a8b-9f1c-675b2fa084e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:12.395399 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bc6a6-3917-4a8b-9f1c-675b2fa084e9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:12.407983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1208/2402] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:22:12.412045 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2bf64-c334-4672-bf97-754c47aff571 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:12.422007 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2bf64-c334-4672-bf97-754c47aff571 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:12.426637 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665d0b2-804e-4f0c-a038-d67fef9b9d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:12.427264 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665d0b2-804e-4f0c-a038-d67fef9b9d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:12.427548 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665d0b2-804e-4f0c-a038-d67fef9b9d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:12.427827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665d0b2-804e-4f0c-a038-d67fef9b9d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:12.428471 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665d0b2-804e-4f0c-a038-d67fef9b9d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:12.430083 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665d0b2-804e-4f0c-a038-d67fef9b9d3b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:12.440898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1195/2403] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:22:12.444888 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bc6a6-3917-4a8b-9f1c-675b2fa084e9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:12.454605 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bc6a6-3917-4a8b-9f1c-675b2fa084e9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:12.459896 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b674d-64bb-40ef-a739-bc0dd44fca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:12.460533 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b674d-64bb-40ef-a739-bc0dd44fca7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:12.460817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b674d-64bb-40ef-a739-bc0dd44fca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:12.461093 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b674d-64bb-40ef-a739-bc0dd44fca7f admin admin] PATH_INFO: `/v3/projects/d05bec9eb0f14df9a9ec1667bf07924c/users/07bfbca8129f45ea871108dc6990af8d/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:12.475722 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b674d-64bb-40ef-a739-bc0dd44fca7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d05bec9eb0f14df9a9ec1667bf07924c, user_id=07bfbca8129f45ea871108dc6990af8d, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:12.478691 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b674d-64bb-40ef-a739-bc0dd44fca7f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:12.491355 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1209/2404] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:22:12 2022] PUT /identity/v3/projects/d05bec9eb0f14df9a9ec1667bf07924c/users/07bfbca8129f45ea871108dc6990af8d/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:22:12.557812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba42216-361e-48ef-bcb2-7a88874771c7 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:12.558106 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba42216-361e-48ef-bcb2-7a88874771c7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:12.558377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba42216-361e-48ef-bcb2-7a88874771c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:12.587124 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-4ba42216-361e-48ef-bcb2-7a88874771c7 None None] MFA Rules not processed for user `07bfbca8129f45ea871108dc6990af8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:22:12.588269 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4ba42216-361e-48ef-bcb2-7a88874771c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:12.655223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1196/2405] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:22:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:22:12.666619 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b674d-64bb-40ef-a739-bc0dd44fca7f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:12.668357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ff6b674d-64bb-40ef-a739-bc0dd44fca7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:12.683211 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:22:12.730469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b674d-64bb-40ef-a739-bc0dd44fca7f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:12.734403 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948ffc4-b9ac-4888-8f62-38c8fb85449c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '405499a1b5dc4fb6ac7af73910c3d992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:12.735038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948ffc4-b9ac-4888-8f62-38c8fb85449c service glance] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:12.735324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948ffc4-b9ac-4888-8f62-38c8fb85449c service glance] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:12.735602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948ffc4-b9ac-4888-8f62-38c8fb85449c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:12.744313 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948ffc4-b9ac-4888-8f62-38c8fb85449c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:12.745751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948ffc4-b9ac-4888-8f62-38c8fb85449c service glance] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:12.755350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1210/2406] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:22:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:22:17.926741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a664370-9510-4e1f-8155-40e6fa62142a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:17.927271 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a664370-9510-4e1f-8155-40e6fa62142a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:17.927380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a664370-9510-4e1f-8155-40e6fa62142a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:17.947144 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9a664370-9510-4e1f-8155-40e6fa62142a None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:22:17.948365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9a664370-9510-4e1f-8155-40e6fa62142a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:18.006650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1197/2407] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 27 04:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:22:18.025572 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948ffc4-b9ac-4888-8f62-38c8fb85449c service glance] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:18.027266 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9948ffc4-b9ac-4888-8f62-38c8fb85449c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:18.103180 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948ffc4-b9ac-4888-8f62-38c8fb85449c service glance] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:18.108806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c2aeb-0951-4d38-848e-95db57c0db1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:18.109411 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c2aeb-0951-4d38-848e-95db57c0db1f service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:18.109690 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c2aeb-0951-4d38-848e-95db57c0db1f service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:18.109963 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c2aeb-0951-4d38-848e-95db57c0db1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:18.118471 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c2aeb-0951-4d38-848e-95db57c0db1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:18.120088 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c2aeb-0951-4d38-848e-95db57c0db1f service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:18.130125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1211/2408] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:22:24.723468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa33ba-e60d-495e-bfca-032fa8f58410 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:24.723967 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa33ba-e60d-495e-bfca-032fa8f58410 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:24.724084 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa33ba-e60d-495e-bfca-032fa8f58410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:24.743570 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-03fa33ba-e60d-495e-bfca-032fa8f58410 None None] MFA Rules not processed for user `84c92ec374504550aa3c2bbc8bf3eb8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:22:24.744890 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-03fa33ba-e60d-495e-bfca-032fa8f58410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:24.802901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1198/2409] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:22:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:22:25.225051 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7e4c5-628a-4cfe-b20c-063eb1f62cd8 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:25.225589 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7e4c5-628a-4cfe-b20c-063eb1f62cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:25.225695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7e4c5-628a-4cfe-b20c-063eb1f62cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:25.245624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-61c7e4c5-628a-4cfe-b20c-063eb1f62cd8 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:22:25.246939 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-61c7e4c5-628a-4cfe-b20c-063eb1f62cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:25.254673 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1212/2410] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 27 04:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:22:25.269824 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa33ba-e60d-495e-bfca-032fa8f58410 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:25.271240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-03fa33ba-e60d-495e-bfca-032fa8f58410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:25.287268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa33ba-e60d-495e-bfca-032fa8f58410 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:25.292635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af25d0-cab2-4e5f-a3a0-4b70b6cd3f1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:25.293234 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af25d0-cab2-4e5f-a3a0-4b70b6cd3f1e service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:25.293513 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af25d0-cab2-4e5f-a3a0-4b70b6cd3f1e service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:25.293785 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af25d0-cab2-4e5f-a3a0-4b70b6cd3f1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:25.299838 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:22:25.303004 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af25d0-cab2-4e5f-a3a0-4b70b6cd3f1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:25.305742 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af25d0-cab2-4e5f-a3a0-4b70b6cd3f1e service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:25.316848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1199/2411] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:22:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:22:30.428122 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58979d-91cd-4e01-b520-e9d05aafaeb0 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:30.428557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58979d-91cd-4e01-b520-e9d05aafaeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:30.428663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58979d-91cd-4e01-b520-e9d05aafaeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:30.448175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ec58979d-91cd-4e01-b520-e9d05aafaeb0 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:22:30.449354 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ec58979d-91cd-4e01-b520-e9d05aafaeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:30.457752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1213/2412] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 27 04:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:22:30.472499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af25d0-cab2-4e5f-a3a0-4b70b6cd3f1e service nova] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:30.483618 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af25d0-cab2-4e5f-a3a0-4b70b6cd3f1e service nova] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:30.488974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17900b-00a7-4888-a897-3fae7d8a08fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:30.489561 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17900b-00a7-4888-a897-3fae7d8a08fd service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:30.489839 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17900b-00a7-4888-a897-3fae7d8a08fd service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:30.490112 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17900b-00a7-4888-a897-3fae7d8a08fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:30.498238 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17900b-00a7-4888-a897-3fae7d8a08fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:30.499830 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17900b-00a7-4888-a897-3fae7d8a08fd service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:30.509455 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1200/2413] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:22:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:22:40.443504 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=62 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:22:40.505436 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=8 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:22:42.890123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58979d-91cd-4e01-b520-e9d05aafaeb0 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:42.900663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58979d-91cd-4e01-b520-e9d05aafaeb0 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:42.905586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48685333-4b4d-4841-ab45-640e0b870960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:42.906223 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48685333-4b4d-4841-ab45-640e0b870960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:42.906522 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48685333-4b4d-4841-ab45-640e0b870960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:42.906821 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48685333-4b4d-4841-ab45-640e0b870960 admin admin] PATH_INFO: `/v3/users/07bfbca8129f45ea871108dc6990af8d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:42.907976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48685333-4b4d-4841-ab45-640e0b870960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07bfbca8129f45ea871108dc6990af8d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:42.909909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48685333-4b4d-4841-ab45-640e0b870960 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:42.960777 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-48685333-4b4d-4841-ab45-640e0b870960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07bfbca8129f45ea871108dc6990af8d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:42.968061 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-48685333-4b4d-4841-ab45-640e0b870960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07bfbca8129f45ea871108dc6990af8d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:42.980715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-48685333-4b4d-4841-ab45-640e0b870960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07bfbca8129f45ea871108dc6990af8d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:42.981459 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-48685333-4b4d-4841-ab45-640e0b870960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07bfbca8129f45ea871108dc6990af8d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:42.990005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-48685333-4b4d-4841-ab45-640e0b870960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07bfbca8129f45ea871108dc6990af8d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:42.996240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1214/2414] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:22:42 2022] DELETE /identity/v3/users/07bfbca8129f45ea871108dc6990af8d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:22:43.000711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f9668-4138-4ab2-91f1-c20af61b69f2 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:43.001168 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f9668-4138-4ab2-91f1-c20af61b69f2 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:43.001304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f9668-4138-4ab2-91f1-c20af61b69f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:43.021720 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-070f9668-4138-4ab2-91f1-c20af61b69f2 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:22:43.022944 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-070f9668-4138-4ab2-91f1-c20af61b69f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:43.085772 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1201/2415] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:22:43.099187 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48685333-4b4d-4841-ab45-640e0b870960 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:43.100983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-48685333-4b4d-4841-ab45-640e0b870960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:43.160130 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48685333-4b4d-4841-ab45-640e0b870960 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:43.163873 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe54268-2283-4b31-b7d4-d72251e8b574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:43.164489 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe54268-2283-4b31-b7d4-d72251e8b574 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:43.164769 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe54268-2283-4b31-b7d4-d72251e8b574 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:43.165042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe54268-2283-4b31-b7d4-d72251e8b574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:43.174775 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe54268-2283-4b31-b7d4-d72251e8b574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:43.176266 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe54268-2283-4b31-b7d4-d72251e8b574 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:43.186416 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1215/2416] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:22:43.459996 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f9668-4138-4ab2-91f1-c20af61b69f2 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:22:43.461583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-070f9668-4138-4ab2-91f1-c20af61b69f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:43.479113 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f9668-4138-4ab2-91f1-c20af61b69f2 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:22:43.484034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cec853-76b7-4bee-9a88-fd47696d2cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:22:43.484699 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cec853-76b7-4bee-9a88-fd47696d2cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:43.484984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cec853-76b7-4bee-9a88-fd47696d2cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:43.485293 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cec853-76b7-4bee-9a88-fd47696d2cd4 admin admin] PATH_INFO: `/v3/projects/d05bec9eb0f14df9a9ec1667bf07924c` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:43.486412 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cec853-76b7-4bee-9a88-fd47696d2cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d05bec9eb0f14df9a9ec1667bf07924c)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:22:43.488929 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cec853-76b7-4bee-9a88-fd47696d2cd4 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:22:43.535739 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-91cec853-76b7-4bee-9a88-fd47696d2cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd05bec9eb0f14df9a9ec1667bf07924c', 'request_id': 'req-91cec853-76b7-4bee-9a88-fd47696d2cd4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:43.541246 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-91cec853-76b7-4bee-9a88-fd47696d2cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd05bec9eb0f14df9a9ec1667bf07924c', 'request_id': 'req-91cec853-76b7-4bee-9a88-fd47696d2cd4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:43.547345 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-91cec853-76b7-4bee-9a88-fd47696d2cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd05bec9eb0f14df9a9ec1667bf07924c', 'request_id': 'req-91cec853-76b7-4bee-9a88-fd47696d2cd4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:43.559971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-91cec853-76b7-4bee-9a88-fd47696d2cd4 admin admin] The token cache is being invalidate because project d05bec9eb0f14df9a9ec1667bf07924c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:22:43.560263 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-91cec853-76b7-4bee-9a88-fd47696d2cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:43.560925 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-91cec853-76b7-4bee-9a88-fd47696d2cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:22:43.562392 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1202/2417] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:22:43 2022] DELETE /identity/v3/projects/d05bec9eb0f14df9a9ec1667bf07924c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:22:52.004395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70111bff-423e-4b0d-a7ee-acb05b788fd1 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:22:52.004913 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70111bff-423e-4b0d-a7ee-acb05b788fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:22:52.004913 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70111bff-423e-4b0d-a7ee-acb05b788fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:22:52.023292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-70111bff-423e-4b0d-a7ee-acb05b788fd1 None None] MFA Rules not processed for user `f8d95e1ddc2e49f88e893cc9b9f89cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:22:52.024480 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-70111bff-423e-4b0d-a7ee-acb05b788fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:22:52.078348 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1216/2418] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:22:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:22:53.556985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:23:02.071757 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=80,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:23:05.890353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080545c-2c3c-4710-8b9f-3359f2626bee None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:23:05.890934 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080545c-2c3c-4710-8b9f-3359f2626bee None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:23:05.890934 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080545c-2c3c-4710-8b9f-3359f2626bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:23:05.910074 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9080545c-2c3c-4710-8b9f-3359f2626bee None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:23:05.911242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9080545c-2c3c-4710-8b9f-3359f2626bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:23:05.969660 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1203/2419] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 27 04:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:23:05.984106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70111bff-423e-4b0d-a7ee-acb05b788fd1 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:23:05.985586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-70111bff-423e-4b0d-a7ee-acb05b788fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:23:06.057319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70111bff-423e-4b0d-a7ee-acb05b788fd1 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:23:06.062707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab71e0-562f-49f3-829d-72db37374bfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:23:06.063321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab71e0-562f-49f3-829d-72db37374bfa service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:23:06.063600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab71e0-562f-49f3-829d-72db37374bfa service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:23:06.063871 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab71e0-562f-49f3-829d-72db37374bfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:23:06.072450 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab71e0-562f-49f3-829d-72db37374bfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:23:06.074018 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab71e0-562f-49f3-829d-72db37374bfa service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:23:06.083815 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1217/2420] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:23:09.357341 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956dce2b-ee67-4e14-a471-4daa2c007986 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:23:09.357751 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956dce2b-ee67-4e14-a471-4daa2c007986 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:23:09.357901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956dce2b-ee67-4e14-a471-4daa2c007986 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:23:09.359599 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1204/2421] 10.222.0.48 () {54 vars in 961 bytes} [Tue Sep 27 04:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:23:09.365204 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc1b04-c46f-4879-9877-434d984d91bc None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:23:09.365642 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc1b04-c46f-4879-9877-434d984d91bc None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:23:09.365745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc1b04-c46f-4879-9877-434d984d91bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:23:09.384981 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-dacc1b04-c46f-4879-9877-434d984d91bc None None] MFA Rules not processed for user `efd209a50a994b7c8485f2996697218b`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:23:09.386176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-dacc1b04-c46f-4879-9877-434d984d91bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:23:09.449402 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1218/2422] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Sep 27 04:23:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:23:09.456793 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956dce2b-ee67-4e14-a471-4daa2c007986 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:23:09.475641 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956dce2b-ee67-4e14-a471-4daa2c007986 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:23:09.481178 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4de68-fab5-45e2-8a6e-46a442ddf29f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efd209a50a994b7c8485f2996697218b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:23:09.481764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4de68-fab5-45e2-8a6e-46a442ddf29f service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:23:09.482042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4de68-fab5-45e2-8a6e-46a442ddf29f service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:23:09.482314 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4de68-fab5-45e2-8a6e-46a442ddf29f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:23:09.484312 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3ab4de68-fab5-45e2-8a6e-46a442ddf29f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:23:09.496419 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4de68-fab5-45e2-8a6e-46a442ddf29f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:23:09.497986 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4de68-fab5-45e2-8a6e-46a442ddf29f service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:23:09.507750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1205/2423] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:23:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:23:10.180474 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb8d41-3313-4d76-bb01-fb28a882277b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:23:10.180759 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb8d41-3313-4d76-bb01-fb28a882277b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:23:10.181102 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb8d41-3313-4d76-bb01-fb28a882277b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:23:10.201114 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-25cb8d41-3313-4d76-bb01-fb28a882277b None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:23:10.202307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-25cb8d41-3313-4d76-bb01-fb28a882277b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:23:10.210611 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1219/2424] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 27 04:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:23:10.230117 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4de68-fab5-45e2-8a6e-46a442ddf29f service placement] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:23:10.231856 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3ab4de68-fab5-45e2-8a6e-46a442ddf29f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:23:10.251006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4de68-fab5-45e2-8a6e-46a442ddf29f service placement] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:23:10.257934 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64da9a-6005-4bdd-a46f-b4c6cacf9476 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:23:10.258946 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64da9a-6005-4bdd-a46f-b4c6cacf9476 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:23:10.259344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64da9a-6005-4bdd-a46f-b4c6cacf9476 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:23:10.259502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64da9a-6005-4bdd-a46f-b4c6cacf9476 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:23:10.268919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64da9a-6005-4bdd-a46f-b4c6cacf9476 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:23:10.270886 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64da9a-6005-4bdd-a46f-b4c6cacf9476 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:23:10.282563 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1206/2425] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:23:15.321588 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fd2db-d7ad-49c3-b96d-7be6344bcdca None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:23:15.322105 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fd2db-d7ad-49c3-b96d-7be6344bcdca None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:23:15.322214 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fd2db-d7ad-49c3-b96d-7be6344bcdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:23:15.353054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-760fd2db-d7ad-49c3-b96d-7be6344bcdca None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:23:15.354266 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-760fd2db-d7ad-49c3-b96d-7be6344bcdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:23:15.362462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1220/2426] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 27 04:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:23:15.380636 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64da9a-6005-4bdd-a46f-b4c6cacf9476 service nova] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:23:15.391703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64da9a-6005-4bdd-a46f-b4c6cacf9476 service nova] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:23:15.400683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fad5bb-1e2f-44b5-80cb-7c405146de32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:23:15.401509 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fad5bb-1e2f-44b5-80cb-7c405146de32 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:23:15.401951 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fad5bb-1e2f-44b5-80cb-7c405146de32 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:23:15.402386 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fad5bb-1e2f-44b5-80cb-7c405146de32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:23:15.411893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fad5bb-1e2f-44b5-80cb-7c405146de32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:23:15.413515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fad5bb-1e2f-44b5-80cb-7c405146de32 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:23:15.423955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1207/2427] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:23:15.875078 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08100e22-3e59-4dbb-a931-e89a2c00b22c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:23:15.875371 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08100e22-3e59-4dbb-a931-e89a2c00b22c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:23:15.875653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08100e22-3e59-4dbb-a931-e89a2c00b22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:23:15.896338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-08100e22-3e59-4dbb-a931-e89a2c00b22c None None] MFA Rules not processed for user `8e03bcebeee44978afe2ce5040ddf122`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:23:15.897542 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-08100e22-3e59-4dbb-a931-e89a2c00b22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:23:15.951623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1221/2428] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:23:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:23:19.507890 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dc6d6-8024-478f-92d0-4153d76210a9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:23:19.508384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dc6d6-8024-478f-92d0-4153d76210a9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:23:19.508507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dc6d6-8024-478f-92d0-4153d76210a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:23:19.531297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b81dc6d6-8024-478f-92d0-4153d76210a9 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:23:19.532789 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b81dc6d6-8024-478f-92d0-4153d76210a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:23:19.543222 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1208/2429] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 27 04:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:23:19.557484 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08100e22-3e59-4dbb-a931-e89a2c00b22c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:23:19.571064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08100e22-3e59-4dbb-a931-e89a2c00b22c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:23:19.576820 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbbfaf-1d43-4b71-ad4b-96cb43d45d03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:23:19.577558 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbbfaf-1d43-4b71-ad4b-96cb43d45d03 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:23:19.577937 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbbfaf-1d43-4b71-ad4b-96cb43d45d03 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:23:19.578308 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbbfaf-1d43-4b71-ad4b-96cb43d45d03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:23:19.589971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbbfaf-1d43-4b71-ad4b-96cb43d45d03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:23:19.591734 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbbfaf-1d43-4b71-ad4b-96cb43d45d03 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:23:19.598564 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:23:19.618910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1222/2430] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:23:28.873588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fd4b5-5fe2-468e-b658-c2bf665157a5 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:23:28.874162 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fd4b5-5fe2-468e-b658-c2bf665157a5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:23:28.874162 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fd4b5-5fe2-468e-b658-c2bf665157a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:23:28.894460 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-2e3fd4b5-5fe2-468e-b658-c2bf665157a5 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:23:28.895776 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2e3fd4b5-5fe2-468e-b658-c2bf665157a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:23:28.903693 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1209/2431] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 27 04:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:23:28.920682 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbbfaf-1d43-4b71-ad4b-96cb43d45d03 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:23:28.949639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbbfaf-1d43-4b71-ad4b-96cb43d45d03 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:23:28.955909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b011961-45b7-4637-b4e6-a85cd6d56890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:23:28.957492 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b011961-45b7-4637-b4e6-a85cd6d56890 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:23:28.958127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b011961-45b7-4637-b4e6-a85cd6d56890 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:23:28.958612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b011961-45b7-4637-b4e6-a85cd6d56890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:23:28.968687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b011961-45b7-4637-b4e6-a85cd6d56890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:23:28.970439 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b011961-45b7-4637-b4e6-a85cd6d56890 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:23:28.981149 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1223/2432] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:23:38.889095 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=51 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:23:38.976427 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=6 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:23:46.932022 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7593cdf-ef28-4588-93ec-25283aa8b50c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:23:46.932507 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7593cdf-ef28-4588-93ec-25283aa8b50c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:23:46.932697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7593cdf-ef28-4588-93ec-25283aa8b50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:23:46.951909 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b7593cdf-ef28-4588-93ec-25283aa8b50c None None] MFA Rules not processed for user `71c7a54c598642a4b9219ae21c34f0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:23:46.953113 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b7593cdf-ef28-4588-93ec-25283aa8b50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:23:47.009947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1210/2433] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 27 04:23:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:23:47.052875 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b011961-45b7-4637-b4e6-a85cd6d56890 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:23:47.054649 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3b011961-45b7-4637-b4e6-a85cd6d56890 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:23:47.124318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b011961-45b7-4637-b4e6-a85cd6d56890 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:23:47.130952 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e9d8f-14bb-4655-acf5-03956aa6bb02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c295a3063c3b45be96b406f586180142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:23:47.131587 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e9d8f-14bb-4655-acf5-03956aa6bb02 service swift] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:23:47.131863 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e9d8f-14bb-4655-acf5-03956aa6bb02 service swift] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:23:47.132133 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e9d8f-14bb-4655-acf5-03956aa6bb02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:23:47.140645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e9d8f-14bb-4655-acf5-03956aa6bb02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:23:47.142255 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e9d8f-14bb-4655-acf5-03956aa6bb02 service swift] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:23:47.150379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1224/2434] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 27 04:23:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:23:57.003316 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=25 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:23:57.147246 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=32 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:24:01.996447 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432f803-2c31-44e1-8a4c-1b4738bc5c6f None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:24:01.997000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432f803-2c31-44e1-8a4c-1b4738bc5c6f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:24:01.997114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432f803-2c31-44e1-8a4c-1b4738bc5c6f None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:24:01.998567 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1211/2435] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 27 04:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:24:02.004448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8068ca-9987-405a-9ef8-80a063f8ae20 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:24:02.004938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8068ca-9987-405a-9ef8-80a063f8ae20 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:24:02.005161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8068ca-9987-405a-9ef8-80a063f8ae20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:24:02.026084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-cc8068ca-9987-405a-9ef8-80a063f8ae20 None None] MFA Rules not processed for user `3960d52dee8443cf9ec8930a389a7b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:24:02.027402 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-cc8068ca-9987-405a-9ef8-80a063f8ae20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:24:02.037932 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1225/2436] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 27 04:24:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:24:02.049574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432f803-2c31-44e1-8a4c-1b4738bc5c6f None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:24:02.051400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2432f803-2c31-44e1-8a4c-1b4738bc5c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:24:02.112322 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432f803-2c31-44e1-8a4c-1b4738bc5c6f None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:24:02.115779 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b903a1d-5434-4e8e-b03d-d7b4ae49c767 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '405499a1b5dc4fb6ac7af73910c3d992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:24:02.116399 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b903a1d-5434-4e8e-b03d-d7b4ae49c767 service glance] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:24:02.116680 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b903a1d-5434-4e8e-b03d-d7b4ae49c767 service glance] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:24:02.117081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b903a1d-5434-4e8e-b03d-d7b4ae49c767 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:24:02.128069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b903a1d-5434-4e8e-b03d-d7b4ae49c767 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:24:02.129527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b903a1d-5434-4e8e-b03d-d7b4ae49c767 service glance] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:24:02.140280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1212/2437] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:24:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:24:02.210247 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f78f69-3464-4817-8c25-09365133a9a0 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:24:02.210681 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f78f69-3464-4817-8c25-09365133a9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:24:02.210940 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f78f69-3464-4817-8c25-09365133a9a0 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:24:02.212390 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1226/2438] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 27 04:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:24:02.217221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a9796-a52b-4560-a569-f461890d5702 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:24:02.217535 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a9796-a52b-4560-a569-f461890d5702 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:24:02.217812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a9796-a52b-4560-a569-f461890d5702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:24:02.239663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-462a9796-a52b-4560-a569-f461890d5702 None None] MFA Rules not processed for user `e94f9a63cb4847c6916a84735d00b48f`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:24:02.240934 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-462a9796-a52b-4560-a569-f461890d5702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:24:02.295973 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1213/2439] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 27 04:24:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:24:02.307634 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f78f69-3464-4817-8c25-09365133a9a0 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:24:02.309307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f8f78f69-3464-4817-8c25-09365133a9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:24:02.322609 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f78f69-3464-4817-8c25-09365133a9a0 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:24:02.326201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02265f6a-bc96-4594-8cf7-02ad1ed1f207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:24:02.326875 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02265f6a-bc96-4594-8cf7-02ad1ed1f207 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:24:02.327157 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02265f6a-bc96-4594-8cf7-02ad1ed1f207 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:24:02.327431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02265f6a-bc96-4594-8cf7-02ad1ed1f207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:24:02.335353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02265f6a-bc96-4594-8cf7-02ad1ed1f207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:24:02.336804 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02265f6a-bc96-4594-8cf7-02ad1ed1f207 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:24:02.344945 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1227/2440] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:24:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:24:02.436298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa308a1-bd44-4753-9a15-fee385943d7a None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:24:02.436588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa308a1-bd44-4753-9a15-fee385943d7a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:24:02.436899 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa308a1-bd44-4753-9a15-fee385943d7a None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:24:02.438258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1214/2441] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 27 04:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:24:02.444977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c808e4-a077-457a-bb64-2b58b40a4218 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:24:02.445261 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c808e4-a077-457a-bb64-2b58b40a4218 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:24:02.445530 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c808e4-a077-457a-bb64-2b58b40a4218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:24:02.467157 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-95c808e4-a077-457a-bb64-2b58b40a4218 None None] MFA Rules not processed for user `3960d52dee8443cf9ec8930a389a7b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:24:02.468362 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-95c808e4-a077-457a-bb64-2b58b40a4218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:24:02.477723 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1228/2442] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 27 04:24:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:24:02.488970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa308a1-bd44-4753-9a15-fee385943d7a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:24:02.490917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7fa308a1-bd44-4753-9a15-fee385943d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:24:02.505011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa308a1-bd44-4753-9a15-fee385943d7a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:24:02.511301 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351f31b-0cb5-4ee7-90bc-08f1ae300529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:24:02.511916 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351f31b-0cb5-4ee7-90bc-08f1ae300529 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:24:02.512196 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351f31b-0cb5-4ee7-90bc-08f1ae300529 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:24:02.512469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351f31b-0cb5-4ee7-90bc-08f1ae300529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:24:02.524127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351f31b-0cb5-4ee7-90bc-08f1ae300529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:24:02.525585 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351f31b-0cb5-4ee7-90bc-08f1ae300529 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:24:02.538907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1215/2443] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:24:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:24:04.813609 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5318cac-cd05-4ffb-a942-c7b025983c9d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:24:04.814081 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5318cac-cd05-4ffb-a942-c7b025983c9d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:24:04.814194 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5318cac-cd05-4ffb-a942-c7b025983c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:24:04.833929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c5318cac-cd05-4ffb-a942-c7b025983c9d None None] MFA Rules not processed for user `71c7a54c598642a4b9219ae21c34f0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:24:04.835156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c5318cac-cd05-4ffb-a942-c7b025983c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:24:04.842264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1229/2444] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 27 04:24:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:24:04.854240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351f31b-0cb5-4ee7-90bc-08f1ae300529 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:24:04.866046 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351f31b-0cb5-4ee7-90bc-08f1ae300529 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:24:04.871086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacad7a-6240-401a-b5e7-caff9e9089e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c295a3063c3b45be96b406f586180142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:24:04.871679 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacad7a-6240-401a-b5e7-caff9e9089e1 service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:24:04.871966 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacad7a-6240-401a-b5e7-caff9e9089e1 service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:24:04.872245 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacad7a-6240-401a-b5e7-caff9e9089e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:24:04.880781 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacad7a-6240-401a-b5e7-caff9e9089e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:24:04.882374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacad7a-6240-401a-b5e7-caff9e9089e1 service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:24:04.890613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1216/2445] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 27 04:24:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:24:06.939826 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf8338-8c00-45e3-b058-5ca6c5065046 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:24:06.940367 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf8338-8c00-45e3-b058-5ca6c5065046 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:24:06.940367 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf8338-8c00-45e3-b058-5ca6c5065046 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:24:06.942551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1230/2446] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 27 04:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:24:06.976420 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e29375-26a9-418b-8630-a5c9a674d701 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:24:06.976959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e29375-26a9-418b-8630-a5c9a674d701 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:24:06.976959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e29375-26a9-418b-8630-a5c9a674d701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:24:07.007394 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-58e29375-26a9-418b-8630-a5c9a674d701 None None] MFA Rules not processed for user `efd209a50a994b7c8485f2996697218b`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:24:07.011450 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-58e29375-26a9-418b-8630-a5c9a674d701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:24:07.012551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf8338-8c00-45e3-b058-5ca6c5065046 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:24:07.014415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bcdf8338-8c00-45e3-b058-5ca6c5065046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:24:07.022685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1217/2447] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 27 04:24:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:24:07.039398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e29375-26a9-418b-8630-a5c9a674d701 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:24:07.039907 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf8338-8c00-45e3-b058-5ca6c5065046 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:24:07.041042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-58e29375-26a9-418b-8630-a5c9a674d701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:24:07.045008 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877afe96-e51c-4504-a77f-52fd4e52a53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:24:07.045820 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877afe96-e51c-4504-a77f-52fd4e52a53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:24:07.046296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877afe96-e51c-4504-a77f-52fd4e52a53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:24:07.046809 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877afe96-e51c-4504-a77f-52fd4e52a53b admin admin] PATH_INFO: `/v3/users/f8d95e1ddc2e49f88e893cc9b9f89cb9` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:24:07.048222 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877afe96-e51c-4504-a77f-52fd4e52a53b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8d95e1ddc2e49f88e893cc9b9f89cb9)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:24:07.050858 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877afe96-e51c-4504-a77f-52fd4e52a53b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:24:07.056321 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e29375-26a9-418b-8630-a5c9a674d701 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:24:07.061273 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094df90-869c-4b39-ba5c-56f6414fcb29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efd209a50a994b7c8485f2996697218b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:24:07.061878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094df90-869c-4b39-ba5c-56f6414fcb29 service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:24:07.062161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094df90-869c-4b39-ba5c-56f6414fcb29 service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:24:07.062433 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094df90-869c-4b39-ba5c-56f6414fcb29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:24:07.071961 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094df90-869c-4b39-ba5c-56f6414fcb29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:24:07.073565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094df90-869c-4b39-ba5c-56f6414fcb29 service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:24:07.085243 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1218/2448] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:24:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:24:07.106795 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-877afe96-e51c-4504-a77f-52fd4e52a53b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8d95e1ddc2e49f88e893cc9b9f89cb9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:24:07.115856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-877afe96-e51c-4504-a77f-52fd4e52a53b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8d95e1ddc2e49f88e893cc9b9f89cb9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:24:07.130303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-877afe96-e51c-4504-a77f-52fd4e52a53b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8d95e1ddc2e49f88e893cc9b9f89cb9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:24:07.131684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-877afe96-e51c-4504-a77f-52fd4e52a53b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8d95e1ddc2e49f88e893cc9b9f89cb9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:24:07.141971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-877afe96-e51c-4504-a77f-52fd4e52a53b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8d95e1ddc2e49f88e893cc9b9f89cb9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:24:07.149379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1231/2449] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:24:07 2022] DELETE /identity/v3/users/f8d95e1ddc2e49f88e893cc9b9f89cb9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:24:07.336435 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094df90-869c-4b39-ba5c-56f6414fcb29 service placement] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:24:07.355758 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094df90-869c-4b39-ba5c-56f6414fcb29 service placement] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:24:07.433785 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df670f1-8efc-4f75-8431-bc78ce9d167f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:24:07.434831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df670f1-8efc-4f75-8431-bc78ce9d167f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:24:07.435248 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df670f1-8efc-4f75-8431-bc78ce9d167f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:24:07.435526 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df670f1-8efc-4f75-8431-bc78ce9d167f admin admin] PATH_INFO: `/v3/projects/c9d8080731d14bae93040f25170364cc` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:24:07.436673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df670f1-8efc-4f75-8431-bc78ce9d167f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d8080731d14bae93040f25170364cc)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:24:07.438611 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df670f1-8efc-4f75-8431-bc78ce9d167f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:24:07.447827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:24:07.490383 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9df670f1-8efc-4f75-8431-bc78ce9d167f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d8080731d14bae93040f25170364cc', 'request_id': 'req-9df670f1-8efc-4f75-8431-bc78ce9d167f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:24:07.496498 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9df670f1-8efc-4f75-8431-bc78ce9d167f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d8080731d14bae93040f25170364cc', 'request_id': 'req-9df670f1-8efc-4f75-8431-bc78ce9d167f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:24:07.502682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9df670f1-8efc-4f75-8431-bc78ce9d167f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d8080731d14bae93040f25170364cc', 'request_id': 'req-9df670f1-8efc-4f75-8431-bc78ce9d167f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:24:07.516562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9df670f1-8efc-4f75-8431-bc78ce9d167f admin admin] The token cache is being invalidate because project c9d8080731d14bae93040f25170364cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:24:07.516856 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9df670f1-8efc-4f75-8431-bc78ce9d167f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:24:07.517495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9df670f1-8efc-4f75-8431-bc78ce9d167f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:24:07.519286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1219/2450] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:24:07 2022] DELETE /identity/v3/projects/c9d8080731d14bae93040f25170364cc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:24:17.146154 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=44,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:24:17.513200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:24:29.540437 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78e549-5c88-407a-9dbe-4fb6547fa6c4 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:24:29.540943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78e549-5c88-407a-9dbe-4fb6547fa6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:24:29.541048 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78e549-5c88-407a-9dbe-4fb6547fa6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:24:29.561877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-cf78e549-5c88-407a-9dbe-4fb6547fa6c4 None None] MFA Rules not processed for user `71c7a54c598642a4b9219ae21c34f0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:24:29.563121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-cf78e549-5c88-407a-9dbe-4fb6547fa6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:24:29.616809 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1232/2451] 10.222.0.48 () {58 vars in 967 bytes} [Tue Sep 27 04:24:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:24:29.629816 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df670f1-8efc-4f75-8431-bc78ce9d167f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:24:29.631228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9df670f1-8efc-4f75-8431-bc78ce9d167f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:24:29.698259 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df670f1-8efc-4f75-8431-bc78ce9d167f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:24:29.703165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d0cb3-c2ba-4eeb-858e-0ade24280c55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c295a3063c3b45be96b406f586180142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:24:29.703759 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d0cb3-c2ba-4eeb-858e-0ade24280c55 service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:24:29.704039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d0cb3-c2ba-4eeb-858e-0ade24280c55 service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:24:29.704316 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d0cb3-c2ba-4eeb-858e-0ade24280c55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:24:29.712792 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d0cb3-c2ba-4eeb-858e-0ade24280c55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:24:29.714412 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d0cb3-c2ba-4eeb-858e-0ade24280c55 service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:24:29.723227 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1220/2452] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 27 04:24:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:24:39.610293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=25 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:24:39.719560 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=32 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:25:01.757414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167b6ee-ff3f-4eaf-bcdc-02a737a05370 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:25:01.757941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167b6ee-ff3f-4eaf-bcdc-02a737a05370 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:25:01.757941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167b6ee-ff3f-4eaf-bcdc-02a737a05370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:25:01.776973 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d167b6ee-ff3f-4eaf-bcdc-02a737a05370 None None] MFA Rules not processed for user `84c92ec374504550aa3c2bbc8bf3eb8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:25:01.778159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d167b6ee-ff3f-4eaf-bcdc-02a737a05370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:01.831366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1233/2453] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:25:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:25:11.824781 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=25 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:25:18.087597 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d0cb3-c2ba-4eeb-858e-0ade24280c55 service swift] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:25:18.090830 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-700d0cb3-c2ba-4eeb-858e-0ade24280c55 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:18.163097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d0cb3-c2ba-4eeb-858e-0ade24280c55 service swift] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:25:18.168473 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9522dc-966b-43ac-aee3-4cca232791bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:25:18.169076 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9522dc-966b-43ac-aee3-4cca232791bb service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:25:18.169361 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9522dc-966b-43ac-aee3-4cca232791bb service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:25:18.169639 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9522dc-966b-43ac-aee3-4cca232791bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:25:18.171384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ec9522dc-966b-43ac-aee3-4cca232791bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:18.227791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9522dc-966b-43ac-aee3-4cca232791bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:25:18.229375 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9522dc-966b-43ac-aee3-4cca232791bb service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:25:18.238873 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1221/2454] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:25:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:25:18.340463 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167b6ee-ff3f-4eaf-bcdc-02a737a05370 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:25:18.341863 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d167b6ee-ff3f-4eaf-bcdc-02a737a05370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:18.403254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167b6ee-ff3f-4eaf-bcdc-02a737a05370 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:25:18.406446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4aab5-4879-4c37-be08-dc51b67c4198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:25:18.407088 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4aab5-4879-4c37-be08-dc51b67c4198 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:25:18.407368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4aab5-4879-4c37-be08-dc51b67c4198 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:25:18.407672 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4aab5-4879-4c37-be08-dc51b67c4198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:25:18.409389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6ab4aab5-4879-4c37-be08-dc51b67c4198 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:18.422663 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4aab5-4879-4c37-be08-dc51b67c4198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:25:18.424120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4aab5-4879-4c37-be08-dc51b67c4198 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:25:18.435260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1234/2455] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:25:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:25:19.852213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9522dc-966b-43ac-aee3-4cca232791bb service nova] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:25:19.853656 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ec9522dc-966b-43ac-aee3-4cca232791bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:19.910234 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9522dc-966b-43ac-aee3-4cca232791bb service nova] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:25:19.913804 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71271bd0-4e5f-4c8a-84e8-bbed5c165680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:25:19.914406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71271bd0-4e5f-4c8a-84e8-bbed5c165680 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:25:19.914690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71271bd0-4e5f-4c8a-84e8-bbed5c165680 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:25:19.914995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71271bd0-4e5f-4c8a-84e8-bbed5c165680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:25:19.916686 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-71271bd0-4e5f-4c8a-84e8-bbed5c165680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:19.930546 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71271bd0-4e5f-4c8a-84e8-bbed5c165680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:25:19.932014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71271bd0-4e5f-4c8a-84e8-bbed5c165680 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:25:19.943342 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1222/2456] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:25:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:25:28.430563 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=26 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:25:29.937991 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=82 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:25:31.270798 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294a74-74ae-4310-9192-40da4b5d8ce9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:25:31.271293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294a74-74ae-4310-9192-40da4b5d8ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:25:31.271389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294a74-74ae-4310-9192-40da4b5d8ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:25:31.290168 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-6a294a74-74ae-4310-9192-40da4b5d8ce9 None None] MFA Rules not processed for user `8e03bcebeee44978afe2ce5040ddf122`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:25:31.291408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6a294a74-74ae-4310-9192-40da4b5d8ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:31.298263 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1235/2457] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:25:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:25:31.608385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71271bd0-4e5f-4c8a-84e8-bbed5c165680 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:25:31.610167 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-71271bd0-4e5f-4c8a-84e8-bbed5c165680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:31.621332 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71271bd0-4e5f-4c8a-84e8-bbed5c165680 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:25:31.625007 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7fdc4-488c-483d-b241-e0b4024f1ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:25:31.625627 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7fdc4-488c-483d-b241-e0b4024f1ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:25:31.625910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7fdc4-488c-483d-b241-e0b4024f1ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:25:31.626182 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7fdc4-488c-483d-b241-e0b4024f1ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:25:31.627857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-15f7fdc4-488c-483d-b241-e0b4024f1ee3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:31.637743 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7fdc4-488c-483d-b241-e0b4024f1ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:25:31.639214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7fdc4-488c-483d-b241-e0b4024f1ee3 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:25:31.647227 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1223/2458] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:25:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:25:31.982192 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a294a74-74ae-4310-9192-40da4b5d8ce9 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:25:31.983704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6a294a74-74ae-4310-9192-40da4b5d8ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:32.053389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a294a74-74ae-4310-9192-40da4b5d8ce9 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:25:32.058246 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288d8ea-f8c7-4e8e-bcf2-e5b5f7e34d66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efd209a50a994b7c8485f2996697218b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:25:32.058873 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288d8ea-f8c7-4e8e-bcf2-e5b5f7e34d66 service placement] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:25:32.059154 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288d8ea-f8c7-4e8e-bcf2-e5b5f7e34d66 service placement] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:25:32.059423 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288d8ea-f8c7-4e8e-bcf2-e5b5f7e34d66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:25:32.061157 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8288d8ea-f8c7-4e8e-bcf2-e5b5f7e34d66 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:32.072136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288d8ea-f8c7-4e8e-bcf2-e5b5f7e34d66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:25:32.073697 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288d8ea-f8c7-4e8e-bcf2-e5b5f7e34d66 service placement] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:25:32.083252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1236/2459] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:25:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:25:33.908621 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7fdc4-488c-483d-b241-e0b4024f1ee3 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:25:33.917937 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7fdc4-488c-483d-b241-e0b4024f1ee3 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:25:33.921585 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc7783-d12c-4768-952f-3f1cc1b727a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:25:33.922186 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc7783-d12c-4768-952f-3f1cc1b727a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:25:33.922465 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc7783-d12c-4768-952f-3f1cc1b727a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:25:33.922764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc7783-d12c-4768-952f-3f1cc1b727a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:25:33.924514 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-54bc7783-d12c-4768-952f-3f1cc1b727a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:33.934569 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc7783-d12c-4768-952f-3f1cc1b727a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:25:33.936047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc7783-d12c-4768-952f-3f1cc1b727a3 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:25:33.944369 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1224/2460] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:25:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:25:37.578273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288d8ea-f8c7-4e8e-bcf2-e5b5f7e34d66 service placement] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:25:37.591177 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288d8ea-f8c7-4e8e-bcf2-e5b5f7e34d66 service placement] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:25:37.596555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b5930-932f-4c9b-b287-314b2dd66349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:25:37.597160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b5930-932f-4c9b-b287-314b2dd66349 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:25:37.597439 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b5930-932f-4c9b-b287-314b2dd66349 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:25:37.597717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b5930-932f-4c9b-b287-314b2dd66349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:25:37.599496 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-778b5930-932f-4c9b-b287-314b2dd66349 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:37.660975 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b5930-932f-4c9b-b287-314b2dd66349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:25:37.664326 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b5930-932f-4c9b-b287-314b2dd66349 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:25:37.677376 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1237/2461] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:25:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:25:43.140480 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc7783-d12c-4768-952f-3f1cc1b727a3 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:25:43.152025 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-54bc7783-d12c-4768-952f-3f1cc1b727a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:43.172941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc7783-d12c-4768-952f-3f1cc1b727a3 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:25:43.179632 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce96ded-30e6-4ab5-aa13-aa3688d5444e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:25:43.180415 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce96ded-30e6-4ab5-aa13-aa3688d5444e service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:25:43.180741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce96ded-30e6-4ab5-aa13-aa3688d5444e service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:25:43.181095 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce96ded-30e6-4ab5-aa13-aa3688d5444e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:25:43.183054 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8ce96ded-30e6-4ab5-aa13-aa3688d5444e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:43.197306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce96ded-30e6-4ab5-aa13-aa3688d5444e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:25:43.199107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce96ded-30e6-4ab5-aa13-aa3688d5444e service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:25:43.211647 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1225/2462] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:25:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:25:45.113759 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b5930-932f-4c9b-b287-314b2dd66349 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:25:45.126603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b5930-932f-4c9b-b287-314b2dd66349 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:25:45.132836 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e5d64-bc20-42bb-b8d8-05d7a7397864 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:25:45.133444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e5d64-bc20-42bb-b8d8-05d7a7397864 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:25:45.133717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e5d64-bc20-42bb-b8d8-05d7a7397864 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:25:45.134172 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e5d64-bc20-42bb-b8d8-05d7a7397864 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:25:45.136104 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ac7e5d64-bc20-42bb-b8d8-05d7a7397864 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:45.148852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e5d64-bc20-42bb-b8d8-05d7a7397864 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:25:45.150680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e5d64-bc20-42bb-b8d8-05d7a7397864 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:25:45.161677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1238/2463] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:25:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:25:46.268010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc9815-5989-41eb-a949-c4f8fac88291 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:25:46.268520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc9815-5989-41eb-a949-c4f8fac88291 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:25:46.268625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc9815-5989-41eb-a949-c4f8fac88291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:25:46.287804 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-13fc9815-5989-41eb-a949-c4f8fac88291 None None] MFA Rules not processed for user `36c0cb5c49fc4756930a9af1244e60a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:25:46.289033 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-13fc9815-5989-41eb-a949-c4f8fac88291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:46.295812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1226/2464] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:25:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:25:46.598509 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e5d64-bc20-42bb-b8d8-05d7a7397864 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:25:46.607751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e5d64-bc20-42bb-b8d8-05d7a7397864 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:25:46.611574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59881d50-3cab-41ac-95fb-0b1b9a4dd85e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:25:46.612160 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59881d50-3cab-41ac-95fb-0b1b9a4dd85e service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:25:46.612440 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59881d50-3cab-41ac-95fb-0b1b9a4dd85e service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:25:46.612710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59881d50-3cab-41ac-95fb-0b1b9a4dd85e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:25:46.615008 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-59881d50-3cab-41ac-95fb-0b1b9a4dd85e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:25:46.624205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59881d50-3cab-41ac-95fb-0b1b9a4dd85e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:25:46.625625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59881d50-3cab-41ac-95fb-0b1b9a4dd85e service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:25:46.633978 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1239/2465] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:25:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:25:56.283040 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=21 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:25:56.629948 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=75 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:13.223059 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc9815-5989-41eb-a949-c4f8fac88291 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:13.224960 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-13fc9815-5989-41eb-a949-c4f8fac88291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:13.237088 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc9815-5989-41eb-a949-c4f8fac88291 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:13.241227 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fc4b8-022e-4ad7-8949-c83b3eb5897a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:13.241828 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fc4b8-022e-4ad7-8949-c83b3eb5897a service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:13.242114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fc4b8-022e-4ad7-8949-c83b3eb5897a service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:13.242393 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fc4b8-022e-4ad7-8949-c83b3eb5897a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:13.244136 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a86fc4b8-022e-4ad7-8949-c83b3eb5897a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:13.254920 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fc4b8-022e-4ad7-8949-c83b3eb5897a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:13.256352 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fc4b8-022e-4ad7-8949-c83b3eb5897a service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:13.265979 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1227/2466] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:26:13 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:26:23.261778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=6 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:30.914069 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59881d50-3cab-41ac-95fb-0b1b9a4dd85e service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:30.922818 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59881d50-3cab-41ac-95fb-0b1b9a4dd85e service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:30.926415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba2cec-89f8-48e1-a69f-45074618c533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:30.927584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba2cec-89f8-48e1-a69f-45074618c533 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:30.927869 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba2cec-89f8-48e1-a69f-45074618c533 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:30.928139 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba2cec-89f8-48e1-a69f-45074618c533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:30.929820 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e2ba2cec-89f8-48e1-a69f-45074618c533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:30.991829 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba2cec-89f8-48e1-a69f-45074618c533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:30.993267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba2cec-89f8-48e1-a69f-45074618c533 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:31.002967 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1240/2467] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:26:34.101573 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fc4b8-022e-4ad7-8949-c83b3eb5897a service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:34.103250 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a86fc4b8-022e-4ad7-8949-c83b3eb5897a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:34.123168 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fc4b8-022e-4ad7-8949-c83b3eb5897a service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:34.129470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee88e7-029d-4566-bc43-16cba15457a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:34.130658 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee88e7-029d-4566-bc43-16cba15457a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:34.131048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee88e7-029d-4566-bc43-16cba15457a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:34.131389 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee88e7-029d-4566-bc43-16cba15457a2 admin admin] PATH_INFO: `/v3/users/84c92ec374504550aa3c2bbc8bf3eb8a` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:34.132500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee88e7-029d-4566-bc43-16cba15457a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c92ec374504550aa3c2bbc8bf3eb8a)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:34.134478 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee88e7-029d-4566-bc43-16cba15457a2 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:34.181923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a9ee88e7-029d-4566-bc43-16cba15457a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c92ec374504550aa3c2bbc8bf3eb8a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:34.188798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a9ee88e7-029d-4566-bc43-16cba15457a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c92ec374504550aa3c2bbc8bf3eb8a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:34.189462 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a9ee88e7-029d-4566-bc43-16cba15457a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c92ec374504550aa3c2bbc8bf3eb8a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:34.200915 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a9ee88e7-029d-4566-bc43-16cba15457a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c92ec374504550aa3c2bbc8bf3eb8a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:34.208258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a9ee88e7-029d-4566-bc43-16cba15457a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c92ec374504550aa3c2bbc8bf3eb8a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:34.214464 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1228/2468] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:26:34 2022] DELETE /identity/v3/users/84c92ec374504550aa3c2bbc8bf3eb8a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:34.382760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba2cec-89f8-48e1-a69f-45074618c533 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:34.393050 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba2cec-89f8-48e1-a69f-45074618c533 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:34.454811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a5475-eaad-492e-b248-ae3551c74bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:34.455441 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a5475-eaad-492e-b248-ae3551c74bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:34.455723 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a5475-eaad-492e-b248-ae3551c74bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:34.455998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a5475-eaad-492e-b248-ae3551c74bca admin admin] PATH_INFO: `/v3/projects/5fd41bf6be394ef3889a7e2f7bfd57b9` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:34.457112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a5475-eaad-492e-b248-ae3551c74bca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fd41bf6be394ef3889a7e2f7bfd57b9)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:34.459191 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a5475-eaad-492e-b248-ae3551c74bca admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:34.503863 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6c1a5475-eaad-492e-b248-ae3551c74bca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fd41bf6be394ef3889a7e2f7bfd57b9', 'request_id': 'req-6c1a5475-eaad-492e-b248-ae3551c74bca'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:34.509795 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6c1a5475-eaad-492e-b248-ae3551c74bca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fd41bf6be394ef3889a7e2f7bfd57b9', 'request_id': 'req-6c1a5475-eaad-492e-b248-ae3551c74bca'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:34.517227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6c1a5475-eaad-492e-b248-ae3551c74bca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fd41bf6be394ef3889a7e2f7bfd57b9', 'request_id': 'req-6c1a5475-eaad-492e-b248-ae3551c74bca'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:34.528021 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6c1a5475-eaad-492e-b248-ae3551c74bca admin admin] The token cache is being invalidate because project 5fd41bf6be394ef3889a7e2f7bfd57b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:26:34.528311 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6c1a5475-eaad-492e-b248-ae3551c74bca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:34.528928 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6c1a5475-eaad-492e-b248-ae3551c74bca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:34.530381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1241/2469] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:26:34 2022] DELETE /identity/v3/projects/5fd41bf6be394ef3889a7e2f7bfd57b9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:34.535460 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c32d0-4eb1-4ca7-928a-0482d7a19a57 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:34.535807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c32d0-4eb1-4ca7-928a-0482d7a19a57 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:34.536088 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c32d0-4eb1-4ca7-928a-0482d7a19a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:34.555652 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-300c32d0-4eb1-4ca7-928a-0482d7a19a57 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:34.556841 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-300c32d0-4eb1-4ca7-928a-0482d7a19a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:34.614254 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1229/2470] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:34.622036 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecce1ac-b1fb-40d3-b0de-b781ddf050de None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:34.622323 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecce1ac-b1fb-40d3-b0de-b781ddf050de None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:34.622629 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecce1ac-b1fb-40d3-b0de-b781ddf050de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:34.641899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-4ecce1ac-b1fb-40d3-b0de-b781ddf050de None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:34.643053 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4ecce1ac-b1fb-40d3-b0de-b781ddf050de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:34.651358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1242/2471] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:34.655402 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c32d0-4eb1-4ca7-928a-0482d7a19a57 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:34.665556 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c32d0-4eb1-4ca7-928a-0482d7a19a57 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:34.670090 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473681d8-b2a3-43b2-8494-54e5d710e49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:34.670682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473681d8-b2a3-43b2-8494-54e5d710e49e admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:34.671001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473681d8-b2a3-43b2-8494-54e5d710e49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:34.671276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473681d8-b2a3-43b2-8494-54e5d710e49e admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:34.671925 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473681d8-b2a3-43b2-8494-54e5d710e49e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:26:34.672258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473681d8-b2a3-43b2-8494-54e5d710e49e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:34.673852 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473681d8-b2a3-43b2-8494-54e5d710e49e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:34.685171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1230/2472] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:26:34.689270 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecce1ac-b1fb-40d3-b0de-b781ddf050de None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:34.698389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecce1ac-b1fb-40d3-b0de-b781ddf050de None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:34.703025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7d01b-f7ae-4a91-b33d-860f24fdb1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:34.703606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7d01b-f7ae-4a91-b33d-860f24fdb1a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:34.703885 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7d01b-f7ae-4a91-b33d-860f24fdb1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:34.704156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7d01b-f7ae-4a91-b33d-860f24fdb1a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:34.704787 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7d01b-f7ae-4a91-b33d-860f24fdb1a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:34.706743 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7d01b-f7ae-4a91-b33d-860f24fdb1a9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:34.722534 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:34.736703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1243/2473] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:26:34 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:26:34.740810 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473681d8-b2a3-43b2-8494-54e5d710e49e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:34.750858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473681d8-b2a3-43b2-8494-54e5d710e49e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:34.806779 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d8d25-c750-4a2c-9ad5-1f1dc18af56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:34.807424 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d8d25-c750-4a2c-9ad5-1f1dc18af56d admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:34.807704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d8d25-c750-4a2c-9ad5-1f1dc18af56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:34.807976 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d8d25-c750-4a2c-9ad5-1f1dc18af56d admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:34.808588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d8d25-c750-4a2c-9ad5-1f1dc18af56d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:34.810513 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d8d25-c750-4a2c-9ad5-1f1dc18af56d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:34.818512 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:34.838219 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1231/2474] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:26:34 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:26:34.842584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7d01b-f7ae-4a91-b33d-860f24fdb1a9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:34.853809 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7d01b-f7ae-4a91-b33d-860f24fdb1a9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:34.858453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ee59e-c0e0-4ae7-a4a8-d1bb845ea5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:34.859104 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ee59e-c0e0-4ae7-a4a8-d1bb845ea5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:34.859375 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ee59e-c0e0-4ae7-a4a8-d1bb845ea5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:34.859651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ee59e-c0e0-4ae7-a4a8-d1bb845ea5f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:34.860292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ee59e-c0e0-4ae7-a4a8-d1bb845ea5f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:34.862357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ee59e-c0e0-4ae7-a4a8-d1bb845ea5f2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:34.876524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1244/2475] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:26:34.877700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d8d25-c750-4a2c-9ad5-1f1dc18af56d admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:34.887658 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d8d25-c750-4a2c-9ad5-1f1dc18af56d admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:34.892468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c16d20-43ef-483c-8428-b2130318d0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:34.893050 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c16d20-43ef-483c-8428-b2130318d0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:34.893277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c16d20-43ef-483c-8428-b2130318d0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:34.893544 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c16d20-43ef-483c-8428-b2130318d0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:34.894242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c16d20-43ef-483c-8428-b2130318d0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:34.896714 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c16d20-43ef-483c-8428-b2130318d0c1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:34.908772 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1232/2476] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:26:34.913574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ee59e-c0e0-4ae7-a4a8-d1bb845ea5f2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:34.925952 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ee59e-c0e0-4ae7-a4a8-d1bb845ea5f2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:34.930898 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28333cc8-1361-4834-af6d-539a9b61170e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:34.931505 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28333cc8-1361-4834-af6d-539a9b61170e admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:34.931792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28333cc8-1361-4834-af6d-539a9b61170e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:34.932094 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28333cc8-1361-4834-af6d-539a9b61170e admin admin] PATH_INFO: `/v3/projects/0ca08ceceecd4aa1a49e1d105b509829/users/5612e428f35449e6ad3179ea2190bef1/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:34.948390 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28333cc8-1361-4834-af6d-539a9b61170e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca08ceceecd4aa1a49e1d105b509829, user_id=5612e428f35449e6ad3179ea2190bef1, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:34.951095 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28333cc8-1361-4834-af6d-539a9b61170e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:34.964383 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1245/2477] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:26:34 2022] PUT /identity/v3/projects/0ca08ceceecd4aa1a49e1d105b509829/users/5612e428f35449e6ad3179ea2190bef1/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:34.974483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a3303-4186-493f-8856-4a4a3c2b00ed None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:34.974799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a3303-4186-493f-8856-4a4a3c2b00ed None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:34.975102 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a3303-4186-493f-8856-4a4a3c2b00ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:35.002113 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c03a3303-4186-493f-8856-4a4a3c2b00ed None None] MFA Rules not processed for user `5612e428f35449e6ad3179ea2190bef1`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:35.003353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c03a3303-4186-493f-8856-4a4a3c2b00ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:35.065143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1233/2478] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:35.077075 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28333cc8-1361-4834-af6d-539a9b61170e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:35.078882 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-28333cc8-1361-4834-af6d-539a9b61170e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:35.151294 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28333cc8-1361-4834-af6d-539a9b61170e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:35.156627 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04217140-3574-4969-912a-32a8ad029814 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:35.157220 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04217140-3574-4969-912a-32a8ad029814 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:35.157498 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04217140-3574-4969-912a-32a8ad029814 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:35.157769 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04217140-3574-4969-912a-32a8ad029814 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:35.166425 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04217140-3574-4969-912a-32a8ad029814 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:35.168047 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04217140-3574-4969-912a-32a8ad029814 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:35.176641 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1246/2479] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:26:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:26:37.840175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a3303-4186-493f-8856-4a4a3c2b00ed None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:37.900851 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a3303-4186-493f-8856-4a4a3c2b00ed None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:37.905289 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56fdb2-5b93-44ef-b277-3a50097a4a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:37.905930 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56fdb2-5b93-44ef-b277-3a50097a4a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:37.906210 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56fdb2-5b93-44ef-b277-3a50097a4a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:37.906480 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56fdb2-5b93-44ef-b277-3a50097a4a0a admin admin] PATH_INFO: `/v3/users/5612e428f35449e6ad3179ea2190bef1` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:37.907698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56fdb2-5b93-44ef-b277-3a50097a4a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5612e428f35449e6ad3179ea2190bef1)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:37.909602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56fdb2-5b93-44ef-b277-3a50097a4a0a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:37.956050 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ca56fdb2-5b93-44ef-b277-3a50097a4a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5612e428f35449e6ad3179ea2190bef1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:37.963676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ca56fdb2-5b93-44ef-b277-3a50097a4a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5612e428f35449e6ad3179ea2190bef1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:37.964336 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ca56fdb2-5b93-44ef-b277-3a50097a4a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5612e428f35449e6ad3179ea2190bef1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:37.974336 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:37.976982 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ca56fdb2-5b93-44ef-b277-3a50097a4a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5612e428f35449e6ad3179ea2190bef1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:37.984902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ca56fdb2-5b93-44ef-b277-3a50097a4a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5612e428f35449e6ad3179ea2190bef1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:37.991135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1234/2480] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:26:37 2022] DELETE /identity/v3/users/5612e428f35449e6ad3179ea2190bef1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:37.995591 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79c463-dcc1-44a3-8308-433d28effb9e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:37.996066 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79c463-dcc1-44a3-8308-433d28effb9e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:37.996162 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79c463-dcc1-44a3-8308-433d28effb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:38.016379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-6d79c463-dcc1-44a3-8308-433d28effb9e None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:38.017574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6d79c463-dcc1-44a3-8308-433d28effb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:38.075072 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1247/2481] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:38.085367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56fdb2-5b93-44ef-b277-3a50097a4a0a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:38.086789 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ca56fdb2-5b93-44ef-b277-3a50097a4a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:38.142998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56fdb2-5b93-44ef-b277-3a50097a4a0a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:38.147168 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2450e-37e3-418d-b1bd-1d093d31eb07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:38.147774 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2450e-37e3-418d-b1bd-1d093d31eb07 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:38.148102 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2450e-37e3-418d-b1bd-1d093d31eb07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:38.148362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2450e-37e3-418d-b1bd-1d093d31eb07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:38.157181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2450e-37e3-418d-b1bd-1d093d31eb07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:38.158619 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2450e-37e3-418d-b1bd-1d093d31eb07 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:38.167965 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1235/2482] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:26:38.430569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79c463-dcc1-44a3-8308-433d28effb9e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:38.432046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6d79c463-dcc1-44a3-8308-433d28effb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:38.444768 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79c463-dcc1-44a3-8308-433d28effb9e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:38.449367 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0976c-0c3d-454c-914a-bbf7fb7c79be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:38.450009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0976c-0c3d-454c-914a-bbf7fb7c79be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:38.450288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0976c-0c3d-454c-914a-bbf7fb7c79be admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:38.450560 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0976c-0c3d-454c-914a-bbf7fb7c79be admin admin] PATH_INFO: `/v3/projects/0ca08ceceecd4aa1a49e1d105b509829` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:38.451709 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0976c-0c3d-454c-914a-bbf7fb7c79be admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca08ceceecd4aa1a49e1d105b509829)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:38.453628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0976c-0c3d-454c-914a-bbf7fb7c79be admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:38.493953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:38.501180 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-37e0976c-0c3d-454c-914a-bbf7fb7c79be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca08ceceecd4aa1a49e1d105b509829', 'request_id': 'req-37e0976c-0c3d-454c-914a-bbf7fb7c79be'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:38.508282 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-37e0976c-0c3d-454c-914a-bbf7fb7c79be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca08ceceecd4aa1a49e1d105b509829', 'request_id': 'req-37e0976c-0c3d-454c-914a-bbf7fb7c79be'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:38.515391 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-37e0976c-0c3d-454c-914a-bbf7fb7c79be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca08ceceecd4aa1a49e1d105b509829', 'request_id': 'req-37e0976c-0c3d-454c-914a-bbf7fb7c79be'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:38.525531 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-37e0976c-0c3d-454c-914a-bbf7fb7c79be admin admin] The token cache is being invalidate because project 0ca08ceceecd4aa1a49e1d105b509829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:26:38.525817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-37e0976c-0c3d-454c-914a-bbf7fb7c79be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:38.526431 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-37e0976c-0c3d-454c-914a-bbf7fb7c79be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:38.527900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1248/2483] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:26:38 2022] DELETE /identity/v3/projects/0ca08ceceecd4aa1a49e1d105b509829 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:38.532822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be4681-d1cc-4937-83d6-0b1121bb9bd7 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:38.533115 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be4681-d1cc-4937-83d6-0b1121bb9bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:38.533423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be4681-d1cc-4937-83d6-0b1121bb9bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:38.554021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-07be4681-d1cc-4937-83d6-0b1121bb9bd7 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:38.555272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-07be4681-d1cc-4937-83d6-0b1121bb9bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:38.612296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1236/2484] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:38.620475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e13bc-c798-4d04-9de8-bbd5e498b575 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:38.620760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e13bc-c798-4d04-9de8-bbd5e498b575 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:38.621036 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e13bc-c798-4d04-9de8-bbd5e498b575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:38.640799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5c6e13bc-c798-4d04-9de8-bbd5e498b575 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:38.641993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5c6e13bc-c798-4d04-9de8-bbd5e498b575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:38.649903 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1249/2485] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:38.654046 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be4681-d1cc-4937-83d6-0b1121bb9bd7 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:38.664086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be4681-d1cc-4937-83d6-0b1121bb9bd7 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:38.668654 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939e4ec-f18e-4bcb-baa9-36f4f01ef087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:38.669249 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939e4ec-f18e-4bcb-baa9-36f4f01ef087 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:38.669529 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939e4ec-f18e-4bcb-baa9-36f4f01ef087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:38.669927 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939e4ec-f18e-4bcb-baa9-36f4f01ef087 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:38.670685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939e4ec-f18e-4bcb-baa9-36f4f01ef087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:26:38.671013 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939e4ec-f18e-4bcb-baa9-36f4f01ef087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:38.672604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939e4ec-f18e-4bcb-baa9-36f4f01ef087 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:38.684772 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1237/2486] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:26:38.689090 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e13bc-c798-4d04-9de8-bbd5e498b575 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:38.698523 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e13bc-c798-4d04-9de8-bbd5e498b575 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:38.703252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5427dd-89a8-4a9f-ac2d-27161c94d880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:38.703917 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5427dd-89a8-4a9f-ac2d-27161c94d880 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:38.704199 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5427dd-89a8-4a9f-ac2d-27161c94d880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:38.704473 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5427dd-89a8-4a9f-ac2d-27161c94d880 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:38.705119 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5427dd-89a8-4a9f-ac2d-27161c94d880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:38.707086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5427dd-89a8-4a9f-ac2d-27161c94d880 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:38.734700 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1250/2487] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:26:38 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:26:38.740182 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939e4ec-f18e-4bcb-baa9-36f4f01ef087 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:38.750386 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939e4ec-f18e-4bcb-baa9-36f4f01ef087 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:38.806272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788a938-b183-4f07-be16-642986400449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:38.806914 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788a938-b183-4f07-be16-642986400449 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:38.807201 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788a938-b183-4f07-be16-642986400449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:38.807478 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788a938-b183-4f07-be16-642986400449 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:38.808118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788a938-b183-4f07-be16-642986400449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:38.810058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788a938-b183-4f07-be16-642986400449 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:38.831280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1238/2488] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:26:38 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:26:38.835577 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5427dd-89a8-4a9f-ac2d-27161c94d880 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:38.845971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5427dd-89a8-4a9f-ac2d-27161c94d880 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:38.851210 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00af00-c7f1-47de-bfee-57504d090789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:38.851808 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00af00-c7f1-47de-bfee-57504d090789 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:38.852090 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00af00-c7f1-47de-bfee-57504d090789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:38.852368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00af00-c7f1-47de-bfee-57504d090789 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:38.853010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00af00-c7f1-47de-bfee-57504d090789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:38.854609 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00af00-c7f1-47de-bfee-57504d090789 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:38.865428 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1251/2489] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:26:38.869215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788a938-b183-4f07-be16-642986400449 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:38.879051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788a938-b183-4f07-be16-642986400449 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:38.883655 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230d687-776b-4581-ab40-d57771df2347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:38.884272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230d687-776b-4581-ab40-d57771df2347 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:38.884553 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230d687-776b-4581-ab40-d57771df2347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:38.884826 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230d687-776b-4581-ab40-d57771df2347 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:38.885473 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230d687-776b-4581-ab40-d57771df2347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:38.887104 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230d687-776b-4581-ab40-d57771df2347 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:38.888331 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:38.899776 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1239/2490] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:26:38.903658 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00af00-c7f1-47de-bfee-57504d090789 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:38.914210 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00af00-c7f1-47de-bfee-57504d090789 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:38.919025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4c957-c6ab-4392-8f93-3e913e60d174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:38.919674 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4c957-c6ab-4392-8f93-3e913e60d174 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:38.919956 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4c957-c6ab-4392-8f93-3e913e60d174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:38.920233 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4c957-c6ab-4392-8f93-3e913e60d174 admin admin] PATH_INFO: `/v3/projects/263b0799531c4df5a6b3e8b7534e9489/users/06b7a8c774c8425882558eb95f2d6dfd/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:38.935095 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4c957-c6ab-4392-8f93-3e913e60d174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=263b0799531c4df5a6b3e8b7534e9489, user_id=06b7a8c774c8425882558eb95f2d6dfd, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:38.938747 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4c957-c6ab-4392-8f93-3e913e60d174 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:38.950860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1252/2491] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:26:38 2022] PUT /identity/v3/projects/263b0799531c4df5a6b3e8b7534e9489/users/06b7a8c774c8425882558eb95f2d6dfd/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:38.961128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de785f-c557-4319-94f7-4426259b5c0c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:38.961418 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de785f-c557-4319-94f7-4426259b5c0c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:38.961694 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de785f-c557-4319-94f7-4426259b5c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:38.990257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e6de785f-c557-4319-94f7-4426259b5c0c None None] MFA Rules not processed for user `06b7a8c774c8425882558eb95f2d6dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:38.991567 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e6de785f-c557-4319-94f7-4426259b5c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:39.053256 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1240/2492] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:39.057787 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4c957-c6ab-4392-8f93-3e913e60d174 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:39.117398 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4c957-c6ab-4392-8f93-3e913e60d174 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:39.121874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78540a0-7db8-4018-85d1-69157ef6986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:39.122465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78540a0-7db8-4018-85d1-69157ef6986f admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:39.122767 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78540a0-7db8-4018-85d1-69157ef6986f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:39.123042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78540a0-7db8-4018-85d1-69157ef6986f admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:39.123664 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78540a0-7db8-4018-85d1-69157ef6986f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:39.125559 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78540a0-7db8-4018-85d1-69157ef6986f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:39.156407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1253/2493] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:26:39 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:26:39.160430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de785f-c557-4319-94f7-4426259b5c0c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:39.171756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de785f-c557-4319-94f7-4426259b5c0c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:39.227014 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7cff5-5f36-4b34-82eb-4bb36111f0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:39.227622 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7cff5-5f36-4b34-82eb-4bb36111f0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:39.227901 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7cff5-5f36-4b34-82eb-4bb36111f0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:39.228175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7cff5-5f36-4b34-82eb-4bb36111f0b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:39.228817 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7cff5-5f36-4b34-82eb-4bb36111f0b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:39.230754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7cff5-5f36-4b34-82eb-4bb36111f0b4 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:39.251664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1241/2494] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:26:39 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:26:39.255716 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78540a0-7db8-4018-85d1-69157ef6986f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:39.265877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78540a0-7db8-4018-85d1-69157ef6986f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:39.270390 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af5216-edcc-44fa-92b3-f5d656ed5f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:39.271542 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af5216-edcc-44fa-92b3-f5d656ed5f9d admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:39.271819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af5216-edcc-44fa-92b3-f5d656ed5f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:39.272093 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af5216-edcc-44fa-92b3-f5d656ed5f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:39.272729 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af5216-edcc-44fa-92b3-f5d656ed5f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:39.274316 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af5216-edcc-44fa-92b3-f5d656ed5f9d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:39.284705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1254/2495] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:26:39.289238 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7cff5-5f36-4b34-82eb-4bb36111f0b4 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:39.299050 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7cff5-5f36-4b34-82eb-4bb36111f0b4 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:39.303613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b9700-c0c1-4016-b1f8-6aa3869d40ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:39.304256 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b9700-c0c1-4016-b1f8-6aa3869d40ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:39.304567 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b9700-c0c1-4016-b1f8-6aa3869d40ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:39.304845 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b9700-c0c1-4016-b1f8-6aa3869d40ba admin admin] PATH_INFO: `/v3/projects/2a0dbd84449c4ec08bb3d2b74126238c/users/fe597f67f14c45038c90348d2db1ef60/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:39.319095 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b9700-c0c1-4016-b1f8-6aa3869d40ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0dbd84449c4ec08bb3d2b74126238c, user_id=fe597f67f14c45038c90348d2db1ef60, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:39.321745 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b9700-c0c1-4016-b1f8-6aa3869d40ba admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:39.334910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1242/2496] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:26:39 2022] PUT /identity/v3/projects/2a0dbd84449c4ec08bb3d2b74126238c/users/fe597f67f14c45038c90348d2db1ef60/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:39.338979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af5216-edcc-44fa-92b3-f5d656ed5f9d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:39.349768 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af5216-edcc-44fa-92b3-f5d656ed5f9d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:39.387183 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:39.410200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ec3bc-6915-4dd0-8a7e-3c23ffdf0046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:39.410855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ec3bc-6915-4dd0-8a7e-3c23ffdf0046 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:39.411235 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ec3bc-6915-4dd0-8a7e-3c23ffdf0046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:39.411960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ec3bc-6915-4dd0-8a7e-3c23ffdf0046 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:39.412606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ec3bc-6915-4dd0-8a7e-3c23ffdf0046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:39.414278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ec3bc-6915-4dd0-8a7e-3c23ffdf0046 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:39.424068 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1255/2497] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:26:39.428309 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b9700-c0c1-4016-b1f8-6aa3869d40ba admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:39.438476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b9700-c0c1-4016-b1f8-6aa3869d40ba admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:39.443614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5433063-aa3c-4cb1-957d-2b76a6829024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:39.444253 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5433063-aa3c-4cb1-957d-2b76a6829024 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:39.444537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5433063-aa3c-4cb1-957d-2b76a6829024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:39.444811 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5433063-aa3c-4cb1-957d-2b76a6829024 admin admin] PATH_INFO: `/v3/projects/2a0dbd84449c4ec08bb3d2b74126238c/users/fe597f67f14c45038c90348d2db1ef60/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:39.446764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5433063-aa3c-4cb1-957d-2b76a6829024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0dbd84449c4ec08bb3d2b74126238c, user_id=fe597f67f14c45038c90348d2db1ef60, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:39.449425 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5433063-aa3c-4cb1-957d-2b76a6829024 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:39.460052 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1243/2498] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:26:39 2022] PUT /identity/v3/projects/2a0dbd84449c4ec08bb3d2b74126238c/users/fe597f67f14c45038c90348d2db1ef60/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:39.471133 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fba5d-41c4-4790-8d2c-f51de1525bfd None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:39.471424 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fba5d-41c4-4790-8d2c-f51de1525bfd None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:39.471701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fba5d-41c4-4790-8d2c-f51de1525bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:39.499080 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b87fba5d-41c4-4790-8d2c-f51de1525bfd None None] MFA Rules not processed for user `fe597f67f14c45038c90348d2db1ef60`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:39.500289 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b87fba5d-41c4-4790-8d2c-f51de1525bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:39.566235 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1256/2499] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:39.578157 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5433063-aa3c-4cb1-957d-2b76a6829024 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:39.579887 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e5433063-aa3c-4cb1-957d-2b76a6829024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:39.620971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:39.637432 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5433063-aa3c-4cb1-957d-2b76a6829024 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:39.640980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581dfce-296d-415b-a09f-0314581bce9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:39.641574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581dfce-296d-415b-a09f-0314581bce9d service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:39.641857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581dfce-296d-415b-a09f-0314581bce9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:39.642133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581dfce-296d-415b-a09f-0314581bce9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:39.697766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581dfce-296d-415b-a09f-0314581bce9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:39.699255 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581dfce-296d-415b-a09f-0314581bce9d service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:39.708002 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1244/2500] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:26:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:26:41.055621 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fba5d-41c4-4790-8d2c-f51de1525bfd None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:41.057052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b87fba5d-41c4-4790-8d2c-f51de1525bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:41.069450 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fba5d-41c4-4790-8d2c-f51de1525bfd None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:41.072943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960dd0f1-380f-421a-92af-bc66735cc274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:41.073563 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dd0f1-380f-421a-92af-bc66735cc274 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:41.073846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dd0f1-380f-421a-92af-bc66735cc274 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:41.074120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dd0f1-380f-421a-92af-bc66735cc274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:41.083832 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960dd0f1-380f-421a-92af-bc66735cc274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:41.085290 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960dd0f1-380f-421a-92af-bc66735cc274 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:41.094586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1257/2501] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:26:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:26:44.860292 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581dfce-296d-415b-a09f-0314581bce9d service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:44.924325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581dfce-296d-415b-a09f-0314581bce9d service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:44.928789 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456681f-a9f5-4edb-8fa3-069a49b08202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:44.929404 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456681f-a9f5-4edb-8fa3-069a49b08202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:44.929682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456681f-a9f5-4edb-8fa3-069a49b08202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:44.929952 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456681f-a9f5-4edb-8fa3-069a49b08202 admin admin] PATH_INFO: `/v3/users/06b7a8c774c8425882558eb95f2d6dfd` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:44.931087 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456681f-a9f5-4edb-8fa3-069a49b08202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b7a8c774c8425882558eb95f2d6dfd)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:44.932996 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456681f-a9f5-4edb-8fa3-069a49b08202 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:44.978073 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f456681f-a9f5-4edb-8fa3-069a49b08202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b7a8c774c8425882558eb95f2d6dfd'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:44.985732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f456681f-a9f5-4edb-8fa3-069a49b08202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b7a8c774c8425882558eb95f2d6dfd'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:44.986636 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f456681f-a9f5-4edb-8fa3-069a49b08202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b7a8c774c8425882558eb95f2d6dfd'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:44.998149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f456681f-a9f5-4edb-8fa3-069a49b08202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b7a8c774c8425882558eb95f2d6dfd'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:45.005936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f456681f-a9f5-4edb-8fa3-069a49b08202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b7a8c774c8425882558eb95f2d6dfd'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:45.011734 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1245/2502] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:26:44 2022] DELETE /identity/v3/users/06b7a8c774c8425882558eb95f2d6dfd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:45.016246 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60ee4-36a5-422c-9d84-3994d1f9b06e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:45.016745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60ee4-36a5-422c-9d84-3994d1f9b06e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:45.016846 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60ee4-36a5-422c-9d84-3994d1f9b06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:45.035809 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-dcd60ee4-36a5-422c-9d84-3994d1f9b06e None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:45.037012 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-dcd60ee4-36a5-422c-9d84-3994d1f9b06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:45.095805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1258/2503] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:45.105939 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456681f-a9f5-4edb-8fa3-069a49b08202 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:45.107375 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f456681f-a9f5-4edb-8fa3-069a49b08202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:45.121340 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:45.170168 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456681f-a9f5-4edb-8fa3-069a49b08202 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:45.173863 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fb04a-bfb7-4e7c-b1fb-e113296150d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:45.174473 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fb04a-bfb7-4e7c-b1fb-e113296150d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:45.174777 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fb04a-bfb7-4e7c-b1fb-e113296150d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:45.175058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fb04a-bfb7-4e7c-b1fb-e113296150d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:45.184409 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fb04a-bfb7-4e7c-b1fb-e113296150d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:45.185847 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fb04a-bfb7-4e7c-b1fb-e113296150d5 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:45.195754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1246/2504] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:26:45.470693 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd60ee4-36a5-422c-9d84-3994d1f9b06e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:45.472134 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-dcd60ee4-36a5-422c-9d84-3994d1f9b06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:45.484500 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd60ee4-36a5-422c-9d84-3994d1f9b06e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:45.490124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90356b-8398-473c-97a1-23324b913385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:45.490817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90356b-8398-473c-97a1-23324b913385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:45.491099 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90356b-8398-473c-97a1-23324b913385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:45.491373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90356b-8398-473c-97a1-23324b913385 admin admin] PATH_INFO: `/v3/projects/263b0799531c4df5a6b3e8b7534e9489` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:45.492525 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90356b-8398-473c-97a1-23324b913385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=263b0799531c4df5a6b3e8b7534e9489)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:45.494579 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90356b-8398-473c-97a1-23324b913385 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:45.538340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:45.542332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4a90356b-8398-473c-97a1-23324b913385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '263b0799531c4df5a6b3e8b7534e9489', 'request_id': 'req-4a90356b-8398-473c-97a1-23324b913385'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:45.549472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4a90356b-8398-473c-97a1-23324b913385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '263b0799531c4df5a6b3e8b7534e9489', 'request_id': 'req-4a90356b-8398-473c-97a1-23324b913385'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:45.557108 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4a90356b-8398-473c-97a1-23324b913385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '263b0799531c4df5a6b3e8b7534e9489', 'request_id': 'req-4a90356b-8398-473c-97a1-23324b913385'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:45.567686 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4a90356b-8398-473c-97a1-23324b913385 admin admin] The token cache is being invalidate because project 263b0799531c4df5a6b3e8b7534e9489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:26:45.567974 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4a90356b-8398-473c-97a1-23324b913385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:45.568600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4a90356b-8398-473c-97a1-23324b913385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:45.570078 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1259/2505] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:26:45 2022] DELETE /identity/v3/projects/263b0799531c4df5a6b3e8b7534e9489 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:26:45.574253 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fb04a-bfb7-4e7c-b1fb-e113296150d5 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:45.583882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fb04a-bfb7-4e7c-b1fb-e113296150d5 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:45.638546 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ccf30-5ccf-4348-b25d-804292c82e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:45.639130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ccf30-5ccf-4348-b25d-804292c82e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:45.639413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ccf30-5ccf-4348-b25d-804292c82e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:45.639691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ccf30-5ccf-4348-b25d-804292c82e0f admin admin] PATH_INFO: `/v3/users/fe597f67f14c45038c90348d2db1ef60` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:45.640802 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ccf30-5ccf-4348-b25d-804292c82e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe597f67f14c45038c90348d2db1ef60)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:45.642743 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ccf30-5ccf-4348-b25d-804292c82e0f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:45.686523 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0f7ccf30-5ccf-4348-b25d-804292c82e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe597f67f14c45038c90348d2db1ef60'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:45.693647 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0f7ccf30-5ccf-4348-b25d-804292c82e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe597f67f14c45038c90348d2db1ef60'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:45.694369 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0f7ccf30-5ccf-4348-b25d-804292c82e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe597f67f14c45038c90348d2db1ef60'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:45.706294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0f7ccf30-5ccf-4348-b25d-804292c82e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe597f67f14c45038c90348d2db1ef60'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:45.713370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0f7ccf30-5ccf-4348-b25d-804292c82e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe597f67f14c45038c90348d2db1ef60'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:45.719267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1247/2506] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:26:45 2022] DELETE /identity/v3/users/fe597f67f14c45038c90348d2db1ef60 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:45.986241 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90356b-8398-473c-97a1-23324b913385 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:45.987694 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4a90356b-8398-473c-97a1-23324b913385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:46.001084 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90356b-8398-473c-97a1-23324b913385 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:46.057952 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0af5f-abc9-4578-9781-6ffbbb064604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:46.058590 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0af5f-abc9-4578-9781-6ffbbb064604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:46.058883 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0af5f-abc9-4578-9781-6ffbbb064604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:46.059163 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0af5f-abc9-4578-9781-6ffbbb064604 admin admin] PATH_INFO: `/v3/projects/2a0dbd84449c4ec08bb3d2b74126238c` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:46.060270 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0af5f-abc9-4578-9781-6ffbbb064604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a0dbd84449c4ec08bb3d2b74126238c)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:46.062190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0af5f-abc9-4578-9781-6ffbbb064604 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:46.107019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7ca0af5f-abc9-4578-9781-6ffbbb064604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a0dbd84449c4ec08bb3d2b74126238c', 'request_id': 'req-7ca0af5f-abc9-4578-9781-6ffbbb064604'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:46.113188 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7ca0af5f-abc9-4578-9781-6ffbbb064604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a0dbd84449c4ec08bb3d2b74126238c', 'request_id': 'req-7ca0af5f-abc9-4578-9781-6ffbbb064604'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:46.120144 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7ca0af5f-abc9-4578-9781-6ffbbb064604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a0dbd84449c4ec08bb3d2b74126238c', 'request_id': 'req-7ca0af5f-abc9-4578-9781-6ffbbb064604'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:46.130127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7ca0af5f-abc9-4578-9781-6ffbbb064604 admin admin] The token cache is being invalidate because project 2a0dbd84449c4ec08bb3d2b74126238c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:26:46.130418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7ca0af5f-abc9-4578-9781-6ffbbb064604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:46.131076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7ca0af5f-abc9-4578-9781-6ffbbb064604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:46.132539 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1260/2507] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:26:45 2022] DELETE /identity/v3/projects/2a0dbd84449c4ec08bb3d2b74126238c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:46.138116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdf3d5-532b-4a13-b691-cb473b0fc331 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:46.138601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdf3d5-532b-4a13-b691-cb473b0fc331 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:46.138707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdf3d5-532b-4a13-b691-cb473b0fc331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:46.158949 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b7bdf3d5-532b-4a13-b691-cb473b0fc331 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:46.160162 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b7bdf3d5-532b-4a13-b691-cb473b0fc331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:46.188988 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:46.222237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1248/2508] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:46.230117 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6b0bb-2cea-4b7d-9737-3d913364a74c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:46.230400 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6b0bb-2cea-4b7d-9737-3d913364a74c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:46.230682 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6b0bb-2cea-4b7d-9737-3d913364a74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:46.249932 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-94e6b0bb-2cea-4b7d-9737-3d913364a74c None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:46.251150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-94e6b0bb-2cea-4b7d-9737-3d913364a74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:46.259433 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1261/2509] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:46.263478 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdf3d5-532b-4a13-b691-cb473b0fc331 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:46.274040 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdf3d5-532b-4a13-b691-cb473b0fc331 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:46.278755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6efec-8a1a-4bd6-a8bf-c75636170c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:46.279364 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6efec-8a1a-4bd6-a8bf-c75636170c3e admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:46.279647 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6efec-8a1a-4bd6-a8bf-c75636170c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:46.279948 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6efec-8a1a-4bd6-a8bf-c75636170c3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:46.280605 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6efec-8a1a-4bd6-a8bf-c75636170c3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:26:46.280912 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6efec-8a1a-4bd6-a8bf-c75636170c3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:46.282531 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6efec-8a1a-4bd6-a8bf-c75636170c3e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:46.293986 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1249/2510] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:26:46.298146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6b0bb-2cea-4b7d-9737-3d913364a74c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:46.307395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6b0bb-2cea-4b7d-9737-3d913364a74c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:46.311955 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0ae4d-8b20-4874-ae71-d778bc191f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:46.312540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0ae4d-8b20-4874-ae71-d778bc191f26 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:46.312817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0ae4d-8b20-4874-ae71-d778bc191f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:46.313090 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0ae4d-8b20-4874-ae71-d778bc191f26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:46.313724 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0ae4d-8b20-4874-ae71-d778bc191f26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:46.315652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0ae4d-8b20-4874-ae71-d778bc191f26 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:46.344036 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1262/2511] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:26:46 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:26:46.348121 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6efec-8a1a-4bd6-a8bf-c75636170c3e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:46.357940 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6efec-8a1a-4bd6-a8bf-c75636170c3e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:46.417890 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401752d-4085-4b61-962a-47dd2052fb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:46.418495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401752d-4085-4b61-962a-47dd2052fb9e admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:46.418827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401752d-4085-4b61-962a-47dd2052fb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:46.419105 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401752d-4085-4b61-962a-47dd2052fb9e admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:46.419749 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401752d-4085-4b61-962a-47dd2052fb9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:46.421660 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401752d-4085-4b61-962a-47dd2052fb9e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:46.443029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1250/2512] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:26:46 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:26:46.447363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0ae4d-8b20-4874-ae71-d778bc191f26 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:46.457373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0ae4d-8b20-4874-ae71-d778bc191f26 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:46.462547 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a45cf-2251-4bcc-ae82-2886aa4d735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:46.463175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a45cf-2251-4bcc-ae82-2886aa4d735a admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:46.463455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a45cf-2251-4bcc-ae82-2886aa4d735a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:46.463729 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a45cf-2251-4bcc-ae82-2886aa4d735a admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:46.464362 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a45cf-2251-4bcc-ae82-2886aa4d735a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:46.465953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a45cf-2251-4bcc-ae82-2886aa4d735a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:46.475695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1263/2513] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:26:46.479394 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401752d-4085-4b61-962a-47dd2052fb9e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:46.489227 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401752d-4085-4b61-962a-47dd2052fb9e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:46.493752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84675b9-e56e-4456-bf4e-8fa305c18df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:46.494339 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84675b9-e56e-4456-bf4e-8fa305c18df1 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:46.494619 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84675b9-e56e-4456-bf4e-8fa305c18df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:46.494922 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84675b9-e56e-4456-bf4e-8fa305c18df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:46.495558 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84675b9-e56e-4456-bf4e-8fa305c18df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:46.497135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84675b9-e56e-4456-bf4e-8fa305c18df1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:46.507922 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1251/2514] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:26:46.512139 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a45cf-2251-4bcc-ae82-2886aa4d735a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:46.524073 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a45cf-2251-4bcc-ae82-2886aa4d735a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:46.528951 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d39b4-715a-4b8c-869f-642ffe55df8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:46.529600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d39b4-715a-4b8c-869f-642ffe55df8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:46.529878 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d39b4-715a-4b8c-869f-642ffe55df8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:46.530153 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d39b4-715a-4b8c-869f-642ffe55df8c admin admin] PATH_INFO: `/v3/projects/445aed5d507544929a34f667302d9947/users/399bc64e74ca4ed9a9301d4d5a3c726a/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:46.544906 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d39b4-715a-4b8c-869f-642ffe55df8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=445aed5d507544929a34f667302d9947, user_id=399bc64e74ca4ed9a9301d4d5a3c726a, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:46.547700 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d39b4-715a-4b8c-869f-642ffe55df8c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:46.556122 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:46.562362 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1264/2515] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:26:46 2022] PUT /identity/v3/projects/445aed5d507544929a34f667302d9947/users/399bc64e74ca4ed9a9301d4d5a3c726a/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:46.573112 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c4ec1-4947-4f25-8018-1c816952259d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:46.573396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c4ec1-4947-4f25-8018-1c816952259d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:46.573669 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c4ec1-4947-4f25-8018-1c816952259d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:46.600257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b41c4ec1-4947-4f25-8018-1c816952259d None None] MFA Rules not processed for user `399bc64e74ca4ed9a9301d4d5a3c726a`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:46.601453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b41c4ec1-4947-4f25-8018-1c816952259d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:46.663360 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1252/2516] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:46.667858 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d39b4-715a-4b8c-869f-642ffe55df8c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:46.728487 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d39b4-715a-4b8c-869f-642ffe55df8c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:46.732983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849b8b7-93dc-458d-be70-2eca000194ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:46.733574 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849b8b7-93dc-458d-be70-2eca000194ad admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:46.733852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849b8b7-93dc-458d-be70-2eca000194ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:46.734125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849b8b7-93dc-458d-be70-2eca000194ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:46.734780 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849b8b7-93dc-458d-be70-2eca000194ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:46.736937 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849b8b7-93dc-458d-be70-2eca000194ad admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:46.763339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1265/2517] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:26:46 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:26:46.767400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c4ec1-4947-4f25-8018-1c816952259d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:46.777820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c4ec1-4947-4f25-8018-1c816952259d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:46.802955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:46.833148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a5db3-b6cc-4643-afb2-a5c290bc91c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:46.833747 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a5db3-b6cc-4643-afb2-a5c290bc91c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:46.834027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a5db3-b6cc-4643-afb2-a5c290bc91c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:46.834305 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a5db3-b6cc-4643-afb2-a5c290bc91c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:46.834965 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a5db3-b6cc-4643-afb2-a5c290bc91c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:46.836879 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a5db3-b6cc-4643-afb2-a5c290bc91c9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:46.858976 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1253/2518] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:26:46 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:26:46.863409 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849b8b7-93dc-458d-be70-2eca000194ad admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:46.874444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849b8b7-93dc-458d-be70-2eca000194ad admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:46.879120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e69c41-ff14-4e18-94b3-08db58af4fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:46.879717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e69c41-ff14-4e18-94b3-08db58af4fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:46.880541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e69c41-ff14-4e18-94b3-08db58af4fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:46.880821 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e69c41-ff14-4e18-94b3-08db58af4fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:46.881499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e69c41-ff14-4e18-94b3-08db58af4fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:46.883124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e69c41-ff14-4e18-94b3-08db58af4fc8 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:46.893385 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1266/2519] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:26:46.897624 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a5db3-b6cc-4643-afb2-a5c290bc91c9 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:46.907520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a5db3-b6cc-4643-afb2-a5c290bc91c9 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:46.912598 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83000dd-957b-4c89-9ef6-270bf10d0930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:46.913242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83000dd-957b-4c89-9ef6-270bf10d0930 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:46.913526 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83000dd-957b-4c89-9ef6-270bf10d0930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:46.913803 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83000dd-957b-4c89-9ef6-270bf10d0930 admin admin] PATH_INFO: `/v3/projects/615eed2c46804229988ddb607cf78c08/users/43273461f9b345d0a16ac46ce34df26b/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:46.928719 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83000dd-957b-4c89-9ef6-270bf10d0930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=615eed2c46804229988ddb607cf78c08, user_id=43273461f9b345d0a16ac46ce34df26b, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:46.931442 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83000dd-957b-4c89-9ef6-270bf10d0930 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:46.944364 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1254/2520] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:26:46 2022] PUT /identity/v3/projects/615eed2c46804229988ddb607cf78c08/users/43273461f9b345d0a16ac46ce34df26b/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:46.948764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e69c41-ff14-4e18-94b3-08db58af4fc8 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:46.958868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e69c41-ff14-4e18-94b3-08db58af4fc8 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:47.014475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b10d57-c8b2-46e6-af0b-446111e5b998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:47.015039 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b10d57-c8b2-46e6-af0b-446111e5b998 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:47.015326 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b10d57-c8b2-46e6-af0b-446111e5b998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:47.015604 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b10d57-c8b2-46e6-af0b-446111e5b998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:47.016243 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b10d57-c8b2-46e6-af0b-446111e5b998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:47.017842 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b10d57-c8b2-46e6-af0b-446111e5b998 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:47.027248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1267/2521] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:26:47.031370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83000dd-957b-4c89-9ef6-270bf10d0930 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:47.041986 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83000dd-957b-4c89-9ef6-270bf10d0930 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:47.046572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfe6a8-0e72-482c-9336-50d2b9326d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:47.047246 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfe6a8-0e72-482c-9336-50d2b9326d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:47.047528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfe6a8-0e72-482c-9336-50d2b9326d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:47.047804 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfe6a8-0e72-482c-9336-50d2b9326d97 admin admin] PATH_INFO: `/v3/projects/615eed2c46804229988ddb607cf78c08/users/43273461f9b345d0a16ac46ce34df26b/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:47.049739 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfe6a8-0e72-482c-9336-50d2b9326d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=615eed2c46804229988ddb607cf78c08, user_id=43273461f9b345d0a16ac46ce34df26b, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:47.053042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfe6a8-0e72-482c-9336-50d2b9326d97 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:47.063159 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1255/2522] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:26:47 2022] PUT /identity/v3/projects/615eed2c46804229988ddb607cf78c08/users/43273461f9b345d0a16ac46ce34df26b/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:47.074385 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712107b-e7aa-46f3-979f-2a914292db34 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:47.074918 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712107b-e7aa-46f3-979f-2a914292db34 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:47.075017 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712107b-e7aa-46f3-979f-2a914292db34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:47.102920 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e712107b-e7aa-46f3-979f-2a914292db34 None None] MFA Rules not processed for user `43273461f9b345d0a16ac46ce34df26b`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:47.104173 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e712107b-e7aa-46f3-979f-2a914292db34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:47.161860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:47.173060 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1268/2523] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:47 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:47.184203 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfe6a8-0e72-482c-9336-50d2b9326d97 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:47.185977 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-10bfe6a8-0e72-482c-9336-50d2b9326d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:47.243425 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfe6a8-0e72-482c-9336-50d2b9326d97 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:47.247117 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4eef0-fcbf-4eb3-ae98-008a1a19341c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:47.247716 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4eef0-fcbf-4eb3-ae98-008a1a19341c service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:47.248002 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4eef0-fcbf-4eb3-ae98-008a1a19341c service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:47.248282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4eef0-fcbf-4eb3-ae98-008a1a19341c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:47.257475 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d4eef0-fcbf-4eb3-ae98-008a1a19341c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:47.258975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d4eef0-fcbf-4eb3-ae98-008a1a19341c service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:47.268309 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1256/2524] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:26:47 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:26:47.401336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712107b-e7aa-46f3-979f-2a914292db34 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:47.462669 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712107b-e7aa-46f3-979f-2a914292db34 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:47.467213 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cf6bb-0ceb-4be2-b417-5bb809a5616f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:47.467833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cf6bb-0ceb-4be2-b417-5bb809a5616f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:47.468113 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cf6bb-0ceb-4be2-b417-5bb809a5616f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:47.468388 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cf6bb-0ceb-4be2-b417-5bb809a5616f admin admin] PATH_INFO: `/v3/users/399bc64e74ca4ed9a9301d4d5a3c726a` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:47.469499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cf6bb-0ceb-4be2-b417-5bb809a5616f admin admin] RBAC: Authorizing `identity:delete_user(user_id=399bc64e74ca4ed9a9301d4d5a3c726a)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:47.471469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cf6bb-0ceb-4be2-b417-5bb809a5616f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:47.516391 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-cc3cf6bb-0ceb-4be2-b417-5bb809a5616f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '399bc64e74ca4ed9a9301d4d5a3c726a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:47.524027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-cc3cf6bb-0ceb-4be2-b417-5bb809a5616f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '399bc64e74ca4ed9a9301d4d5a3c726a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:47.535434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-cc3cf6bb-0ceb-4be2-b417-5bb809a5616f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '399bc64e74ca4ed9a9301d4d5a3c726a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:47.536672 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-cc3cf6bb-0ceb-4be2-b417-5bb809a5616f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '399bc64e74ca4ed9a9301d4d5a3c726a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:47.544078 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-cc3cf6bb-0ceb-4be2-b417-5bb809a5616f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '399bc64e74ca4ed9a9301d4d5a3c726a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:47.550534 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1269/2525] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:26:47 2022] DELETE /identity/v3/users/399bc64e74ca4ed9a9301d4d5a3c726a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:47.555134 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16705a61-b0b9-4f0a-ac72-77685cb42d77 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:47.555428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16705a61-b0b9-4f0a-ac72-77685cb42d77 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:47.555709 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16705a61-b0b9-4f0a-ac72-77685cb42d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:47.574375 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-16705a61-b0b9-4f0a-ac72-77685cb42d77 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:47.575617 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-16705a61-b0b9-4f0a-ac72-77685cb42d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:47.633268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1257/2526] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:47.643211 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cf6bb-0ceb-4be2-b417-5bb809a5616f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:47.644637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-cc3cf6bb-0ceb-4be2-b417-5bb809a5616f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:47.700739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cf6bb-0ceb-4be2-b417-5bb809a5616f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:47.704372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7cf19-f3a5-4413-9e98-3089aa655ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:47.704944 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7cf19-f3a5-4413-9e98-3089aa655ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:47.705216 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7cf19-f3a5-4413-9e98-3089aa655ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:47.705482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7cf19-f3a5-4413-9e98-3089aa655ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:47.714908 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7cf19-f3a5-4413-9e98-3089aa655ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:47.716337 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7cf19-f3a5-4413-9e98-3089aa655ac3 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:47.725520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1270/2527] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:26:47.994203 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16705a61-b0b9-4f0a-ac72-77685cb42d77 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:47.995660 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-16705a61-b0b9-4f0a-ac72-77685cb42d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:48.012606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16705a61-b0b9-4f0a-ac72-77685cb42d77 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:48.018574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e86a95-22d6-473a-a6ba-bb62d89f1469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:48.019158 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e86a95-22d6-473a-a6ba-bb62d89f1469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:48.019546 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e86a95-22d6-473a-a6ba-bb62d89f1469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:48.019701 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e86a95-22d6-473a-a6ba-bb62d89f1469 admin admin] PATH_INFO: `/v3/projects/445aed5d507544929a34f667302d9947` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:48.021380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e86a95-22d6-473a-a6ba-bb62d89f1469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=445aed5d507544929a34f667302d9947)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:48.023325 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e86a95-22d6-473a-a6ba-bb62d89f1469 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:48.044087 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:48.070199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c2e86a95-22d6-473a-a6ba-bb62d89f1469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '445aed5d507544929a34f667302d9947', 'request_id': 'req-c2e86a95-22d6-473a-a6ba-bb62d89f1469'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:48.075626 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c2e86a95-22d6-473a-a6ba-bb62d89f1469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '445aed5d507544929a34f667302d9947', 'request_id': 'req-c2e86a95-22d6-473a-a6ba-bb62d89f1469'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:48.081579 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c2e86a95-22d6-473a-a6ba-bb62d89f1469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '445aed5d507544929a34f667302d9947', 'request_id': 'req-c2e86a95-22d6-473a-a6ba-bb62d89f1469'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:48.094410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c2e86a95-22d6-473a-a6ba-bb62d89f1469 admin admin] The token cache is being invalidate because project 445aed5d507544929a34f667302d9947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:26:48.094704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c2e86a95-22d6-473a-a6ba-bb62d89f1469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:48.095341 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c2e86a95-22d6-473a-a6ba-bb62d89f1469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:48.096786 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1258/2528] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:26:47 2022] DELETE /identity/v3/projects/445aed5d507544929a34f667302d9947 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:48.100938 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7cf19-f3a5-4413-9e98-3089aa655ac3 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:48.110480 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7cf19-f3a5-4413-9e98-3089aa655ac3 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:48.122320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:48.168280 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db65885-95ba-4ea5-af93-8bd381c3d032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:48.168930 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db65885-95ba-4ea5-af93-8bd381c3d032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:48.169211 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db65885-95ba-4ea5-af93-8bd381c3d032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:48.169506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db65885-95ba-4ea5-af93-8bd381c3d032 admin admin] PATH_INFO: `/v3/users/43273461f9b345d0a16ac46ce34df26b` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:48.170600 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db65885-95ba-4ea5-af93-8bd381c3d032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43273461f9b345d0a16ac46ce34df26b)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:48.172554 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db65885-95ba-4ea5-af93-8bd381c3d032 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:48.220667 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5db65885-95ba-4ea5-af93-8bd381c3d032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43273461f9b345d0a16ac46ce34df26b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:48.230884 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5db65885-95ba-4ea5-af93-8bd381c3d032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43273461f9b345d0a16ac46ce34df26b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:48.248334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5db65885-95ba-4ea5-af93-8bd381c3d032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43273461f9b345d0a16ac46ce34df26b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:48.249318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5db65885-95ba-4ea5-af93-8bd381c3d032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43273461f9b345d0a16ac46ce34df26b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:48.258766 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5db65885-95ba-4ea5-af93-8bd381c3d032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43273461f9b345d0a16ac46ce34df26b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:48.266918 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1271/2529] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:26:48 2022] DELETE /identity/v3/users/43273461f9b345d0a16ac46ce34df26b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:48.539467 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e86a95-22d6-473a-a6ba-bb62d89f1469 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:48.541075 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c2e86a95-22d6-473a-a6ba-bb62d89f1469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:48.556645 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e86a95-22d6-473a-a6ba-bb62d89f1469 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:48.620246 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c5a91-9713-4fd6-a3e2-14af8343242d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:48.620788 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c5a91-9713-4fd6-a3e2-14af8343242d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:48.621073 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c5a91-9713-4fd6-a3e2-14af8343242d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:48.621352 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c5a91-9713-4fd6-a3e2-14af8343242d admin admin] PATH_INFO: `/v3/projects/615eed2c46804229988ddb607cf78c08` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:48.622486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c5a91-9713-4fd6-a3e2-14af8343242d admin admin] RBAC: Authorizing `identity:delete_project(project_id=615eed2c46804229988ddb607cf78c08)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:48.624431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c5a91-9713-4fd6-a3e2-14af8343242d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:48.670375 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-525c5a91-9713-4fd6-a3e2-14af8343242d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '615eed2c46804229988ddb607cf78c08', 'request_id': 'req-525c5a91-9713-4fd6-a3e2-14af8343242d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:48.676147 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-525c5a91-9713-4fd6-a3e2-14af8343242d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '615eed2c46804229988ddb607cf78c08', 'request_id': 'req-525c5a91-9713-4fd6-a3e2-14af8343242d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:48.683115 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-525c5a91-9713-4fd6-a3e2-14af8343242d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '615eed2c46804229988ddb607cf78c08', 'request_id': 'req-525c5a91-9713-4fd6-a3e2-14af8343242d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:48.695352 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-525c5a91-9713-4fd6-a3e2-14af8343242d admin admin] The token cache is being invalidate because project 615eed2c46804229988ddb607cf78c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:26:48.695645 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-525c5a91-9713-4fd6-a3e2-14af8343242d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:48.696292 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-525c5a91-9713-4fd6-a3e2-14af8343242d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:26:48.697752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1259/2530] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:26:48 2022] DELETE /identity/v3/projects/615eed2c46804229988ddb607cf78c08 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:48.702556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639947b7-af69-43ab-b6f4-d74232e7e654 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:48.702874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639947b7-af69-43ab-b6f4-d74232e7e654 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:48.703156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639947b7-af69-43ab-b6f4-d74232e7e654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:48.722045 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-639947b7-af69-43ab-b6f4-d74232e7e654 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:48.723279 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-639947b7-af69-43ab-b6f4-d74232e7e654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:48.782343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1272/2531] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:48.790686 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad7f12-aec4-4009-8c08-77ed9ef38db2 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:48.791001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad7f12-aec4-4009-8c08-77ed9ef38db2 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:48.791279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad7f12-aec4-4009-8c08-77ed9ef38db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:48.810482 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-57ad7f12-aec4-4009-8c08-77ed9ef38db2 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:48.811739 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-57ad7f12-aec4-4009-8c08-77ed9ef38db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:48.820952 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1260/2532] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:48.825216 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639947b7-af69-43ab-b6f4-d74232e7e654 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:48.835449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639947b7-af69-43ab-b6f4-d74232e7e654 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:48.839979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd594639-2f44-4433-9406-43bab254ab2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:48.840569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd594639-2f44-4433-9406-43bab254ab2f admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:48.840851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd594639-2f44-4433-9406-43bab254ab2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:48.841127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd594639-2f44-4433-9406-43bab254ab2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:48.841796 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd594639-2f44-4433-9406-43bab254ab2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:26:48.842106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd594639-2f44-4433-9406-43bab254ab2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:48.843763 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd594639-2f44-4433-9406-43bab254ab2f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:48.855658 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1273/2533] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:26:48.859870 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad7f12-aec4-4009-8c08-77ed9ef38db2 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:48.869399 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad7f12-aec4-4009-8c08-77ed9ef38db2 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:48.874075 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcbf1c-40e4-4bae-af5a-56d6e79a9989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:48.874637 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcbf1c-40e4-4bae-af5a-56d6e79a9989 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:48.874962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcbf1c-40e4-4bae-af5a-56d6e79a9989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:48.875242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcbf1c-40e4-4bae-af5a-56d6e79a9989 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:48.875875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcbf1c-40e4-4bae-af5a-56d6e79a9989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:48.877819 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcbf1c-40e4-4bae-af5a-56d6e79a9989 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:48.904916 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1261/2534] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:26:48 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:26:48.909119 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd594639-2f44-4433-9406-43bab254ab2f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:48.920223 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd594639-2f44-4433-9406-43bab254ab2f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:48.942186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:48.981706 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87886b4-3f16-4e85-a906-e46fe190a977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:48.982317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87886b4-3f16-4e85-a906-e46fe190a977 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:48.982602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87886b4-3f16-4e85-a906-e46fe190a977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:48.982919 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87886b4-3f16-4e85-a906-e46fe190a977 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:48.983584 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87886b4-3f16-4e85-a906-e46fe190a977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:48.985522 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87886b4-3f16-4e85-a906-e46fe190a977 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:49.006469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1274/2535] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:26:48 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:26:49.010563 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcbf1c-40e4-4bae-af5a-56d6e79a9989 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:49.021465 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcbf1c-40e4-4bae-af5a-56d6e79a9989 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:49.026117 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd86ed-de81-4a7f-8191-607f78c0c102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:49.026739 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd86ed-de81-4a7f-8191-607f78c0c102 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:49.027028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd86ed-de81-4a7f-8191-607f78c0c102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:49.027308 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd86ed-de81-4a7f-8191-607f78c0c102 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:49.027957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd86ed-de81-4a7f-8191-607f78c0c102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:49.029564 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd86ed-de81-4a7f-8191-607f78c0c102 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:49.031616 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:49.041550 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1262/2536] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:26:49.045350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87886b4-3f16-4e85-a906-e46fe190a977 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:49.055636 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87886b4-3f16-4e85-a906-e46fe190a977 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:49.060491 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717eb38b-51ac-4344-a595-4a5a945bc13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:49.061077 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eb38b-51ac-4344-a595-4a5a945bc13b admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:49.061357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eb38b-51ac-4344-a595-4a5a945bc13b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:49.061631 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eb38b-51ac-4344-a595-4a5a945bc13b admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:49.062261 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717eb38b-51ac-4344-a595-4a5a945bc13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:49.063882 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717eb38b-51ac-4344-a595-4a5a945bc13b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:49.074189 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1275/2537] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:26:49.078130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd86ed-de81-4a7f-8191-607f78c0c102 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:49.088422 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd86ed-de81-4a7f-8191-607f78c0c102 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:49.092899 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eac9a4-4fec-491d-acdb-fb77a92686ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:49.093547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eac9a4-4fec-491d-acdb-fb77a92686ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:49.093816 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eac9a4-4fec-491d-acdb-fb77a92686ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:49.094094 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eac9a4-4fec-491d-acdb-fb77a92686ef admin admin] PATH_INFO: `/v3/projects/b7cca8bc579645a1bded785e6a7f380d/users/8f210c98b3514538ad4b1cfe5675c975/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:49.108653 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eac9a4-4fec-491d-acdb-fb77a92686ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7cca8bc579645a1bded785e6a7f380d, user_id=8f210c98b3514538ad4b1cfe5675c975, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:49.111577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eac9a4-4fec-491d-acdb-fb77a92686ef admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:49.123709 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1263/2538] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:26:49 2022] PUT /identity/v3/projects/b7cca8bc579645a1bded785e6a7f380d/users/8f210c98b3514538ad4b1cfe5675c975/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:49.128848 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1f73a-cf67-4121-9c86-ce954e3cad34 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:49.129353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1f73a-cf67-4121-9c86-ce954e3cad34 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:49.129353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1f73a-cf67-4121-9c86-ce954e3cad34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:49.148050 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d9d1f73a-cf67-4121-9c86-ce954e3cad34 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:49.149228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d9d1f73a-cf67-4121-9c86-ce954e3cad34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:49.208598 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1276/2539] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:49.218132 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eac9a4-4fec-491d-acdb-fb77a92686ef admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:49.219916 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-02eac9a4-4fec-491d-acdb-fb77a92686ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:49.282962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eac9a4-4fec-491d-acdb-fb77a92686ef admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:49.286915 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b102a8-22e6-492a-9584-5fb25914323f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:49.287518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b102a8-22e6-492a-9584-5fb25914323f service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:49.287798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b102a8-22e6-492a-9584-5fb25914323f service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:49.288070 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b102a8-22e6-492a-9584-5fb25914323f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:49.296933 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b102a8-22e6-492a-9584-5fb25914323f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:49.298361 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b102a8-22e6-492a-9584-5fb25914323f service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:49.307912 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1264/2540] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:26:49.947884 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6a68-b1be-4dba-afb3-273f2a623757 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:49.948179 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6a68-b1be-4dba-afb3-273f2a623757 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:49.948467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6a68-b1be-4dba-afb3-273f2a623757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:49.977513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-6eae6a68-b1be-4dba-afb3-273f2a623757 None None] MFA Rules not processed for user `8f210c98b3514538ad4b1cfe5675c975`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:49.978834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6eae6a68-b1be-4dba-afb3-273f2a623757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:50.046110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1277/2541] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:50.050642 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b102a8-22e6-492a-9584-5fb25914323f service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:50.060708 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b102a8-22e6-492a-9584-5fb25914323f service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:50.065192 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c68aa-30f8-485d-87f7-20547ddd119b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:50.065779 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c68aa-30f8-485d-87f7-20547ddd119b admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:50.066060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c68aa-30f8-485d-87f7-20547ddd119b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:50.066332 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c68aa-30f8-485d-87f7-20547ddd119b admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:50.067015 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c68aa-30f8-485d-87f7-20547ddd119b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:50.069025 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c68aa-30f8-485d-87f7-20547ddd119b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:50.095000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1265/2542] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:26:50 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:26:50.099390 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae6a68-b1be-4dba-afb3-273f2a623757 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:50.110885 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae6a68-b1be-4dba-afb3-273f2a623757 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:50.139659 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:50.169543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009bddc-9505-4805-8b0a-0c0659020ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:50.170148 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009bddc-9505-4805-8b0a-0c0659020ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:50.170428 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009bddc-9505-4805-8b0a-0c0659020ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:50.170705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009bddc-9505-4805-8b0a-0c0659020ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:50.171360 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009bddc-9505-4805-8b0a-0c0659020ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:50.173281 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009bddc-9505-4805-8b0a-0c0659020ce3 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:50.193852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1278/2543] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:26:50 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:26:50.197857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c68aa-30f8-485d-87f7-20547ddd119b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:50.208829 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c68aa-30f8-485d-87f7-20547ddd119b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:50.213508 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428367ab-2acc-45ff-a8af-fb4a79129f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:50.214111 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428367ab-2acc-45ff-a8af-fb4a79129f8c admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:50.214396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428367ab-2acc-45ff-a8af-fb4a79129f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:50.214673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428367ab-2acc-45ff-a8af-fb4a79129f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:50.215355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428367ab-2acc-45ff-a8af-fb4a79129f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:50.216958 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428367ab-2acc-45ff-a8af-fb4a79129f8c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:50.227880 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1266/2544] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:26:50.232035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009bddc-9505-4805-8b0a-0c0659020ce3 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:50.242704 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009bddc-9505-4805-8b0a-0c0659020ce3 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:50.247389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bebdfd-c385-434c-801e-3f1f3b128a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:50.248030 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bebdfd-c385-434c-801e-3f1f3b128a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:50.248367 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bebdfd-c385-434c-801e-3f1f3b128a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:50.248662 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bebdfd-c385-434c-801e-3f1f3b128a66 admin admin] PATH_INFO: `/v3/projects/0669e36a33394c6d93cd17d17066059d/users/49be201c809e4cdd8989bf3f0e81a831/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:50.262888 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bebdfd-c385-434c-801e-3f1f3b128a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0669e36a33394c6d93cd17d17066059d, user_id=49be201c809e4cdd8989bf3f0e81a831, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:50.265554 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bebdfd-c385-434c-801e-3f1f3b128a66 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:50.278030 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1279/2545] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:26:50 2022] PUT /identity/v3/projects/0669e36a33394c6d93cd17d17066059d/users/49be201c809e4cdd8989bf3f0e81a831/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:26:50.281853 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428367ab-2acc-45ff-a8af-fb4a79129f8c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:50.292437 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428367ab-2acc-45ff-a8af-fb4a79129f8c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:50.346599 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9dd11-a0d2-4a45-a5e4-d464b3145720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:50.347228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9dd11-a0d2-4a45-a5e4-d464b3145720 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:50.347510 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9dd11-a0d2-4a45-a5e4-d464b3145720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:50.347805 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9dd11-a0d2-4a45-a5e4-d464b3145720 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:50.349043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9dd11-a0d2-4a45-a5e4-d464b3145720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:50.350676 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9dd11-a0d2-4a45-a5e4-d464b3145720 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:50.360169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1267/2546] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:26:50.364432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bebdfd-c385-434c-801e-3f1f3b128a66 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:50.374606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bebdfd-c385-434c-801e-3f1f3b128a66 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:50.379141 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16594a54-1652-43c1-829e-7f7904352802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:50.379776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16594a54-1652-43c1-829e-7f7904352802 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:50.380053 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16594a54-1652-43c1-829e-7f7904352802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:50.380326 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16594a54-1652-43c1-829e-7f7904352802 admin admin] PATH_INFO: `/v3/projects/0669e36a33394c6d93cd17d17066059d/users/49be201c809e4cdd8989bf3f0e81a831/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:50.382223 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16594a54-1652-43c1-829e-7f7904352802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0669e36a33394c6d93cd17d17066059d, user_id=49be201c809e4cdd8989bf3f0e81a831, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:50.384857 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16594a54-1652-43c1-829e-7f7904352802 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:50.397612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1280/2547] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:26:50 2022] PUT /identity/v3/projects/0669e36a33394c6d93cd17d17066059d/users/49be201c809e4cdd8989bf3f0e81a831/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:26:51.223004 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332eb6b-ef4b-4e7d-a4da-7c84547b610a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:51.223594 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332eb6b-ef4b-4e7d-a4da-7c84547b610a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:51.223594 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332eb6b-ef4b-4e7d-a4da-7c84547b610a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:51.252233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c332eb6b-ef4b-4e7d-a4da-7c84547b610a None None] MFA Rules not processed for user `49be201c809e4cdd8989bf3f0e81a831`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:51.253475 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c332eb6b-ef4b-4e7d-a4da-7c84547b610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:51.285648 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:26:51.333842 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1268/2548] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:51.344174 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c1df3-7bcb-4d41-81eb-e89094b53e61 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:51.344680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c1df3-7bcb-4d41-81eb-e89094b53e61 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:51.344779 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c1df3-7bcb-4d41-81eb-e89094b53e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:51.363741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-3d8c1df3-7bcb-4d41-81eb-e89094b53e61 None None] MFA Rules not processed for user `8f210c98b3514538ad4b1cfe5675c975`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:26:51.365339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3d8c1df3-7bcb-4d41-81eb-e89094b53e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:51.426579 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1281/2549] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:26:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:26:51.442371 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332eb6b-ef4b-4e7d-a4da-7c84547b610a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:26:51.443913 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c332eb6b-ef4b-4e7d-a4da-7c84547b610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:26:51.516793 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332eb6b-ef4b-4e7d-a4da-7c84547b610a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:26:51.522443 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfe035-2738-4233-b78f-cdff7d9e819a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:26:51.523092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfe035-2738-4233-b78f-cdff7d9e819a service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:26:51.523379 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfe035-2738-4233-b78f-cdff7d9e819a service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:26:51.523659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfe035-2738-4233-b78f-cdff7d9e819a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:26:51.533515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfe035-2738-4233-b78f-cdff7d9e819a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:26:51.535158 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfe035-2738-4233-b78f-cdff7d9e819a service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:26:51.545970 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1269/2550] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:26:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:27:00.264497 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c1df3-7bcb-4d41-81eb-e89094b53e61 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:00.283305 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c1df3-7bcb-4d41-81eb-e89094b53e61 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:00.289448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c96a9f-dc9d-4b9d-bb4c-fef079ee884d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:00.290053 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c96a9f-dc9d-4b9d-bb4c-fef079ee884d service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:00.290332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c96a9f-dc9d-4b9d-bb4c-fef079ee884d service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:00.290608 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c96a9f-dc9d-4b9d-bb4c-fef079ee884d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:00.292466 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b7c96a9f-dc9d-4b9d-bb4c-fef079ee884d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:00.304661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c96a9f-dc9d-4b9d-bb4c-fef079ee884d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:00.306242 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c96a9f-dc9d-4b9d-bb4c-fef079ee884d service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:00.317298 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1282/2551] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:27:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:27:01.541865 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=50 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:27:05.465555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfe035-2738-4233-b78f-cdff7d9e819a service nova] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:05.467020 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-48bfe035-2738-4233-b78f-cdff7d9e819a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:05.522232 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfe035-2738-4233-b78f-cdff7d9e819a service nova] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:05.525854 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a585f7-d9d9-46a3-8b89-e533497f369f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:05.526447 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a585f7-d9d9-46a3-8b89-e533497f369f service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:05.526750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a585f7-d9d9-46a3-8b89-e533497f369f service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:05.527040 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a585f7-d9d9-46a3-8b89-e533497f369f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:05.536114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a585f7-d9d9-46a3-8b89-e533497f369f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:05.537541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a585f7-d9d9-46a3-8b89-e533497f369f service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:05.546781 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1270/2552] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:27:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:27:10.313209 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=61,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:27:13.090174 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96bd00-da10-40f2-815a-839352a2df1d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:13.090813 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96bd00-da10-40f2-815a-839352a2df1d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:13.090813 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96bd00-da10-40f2-815a-839352a2df1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:13.109402 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-fe96bd00-da10-40f2-815a-839352a2df1d None None] MFA Rules not processed for user `8e03bcebeee44978afe2ce5040ddf122`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:27:13.110607 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fe96bd00-da10-40f2-815a-839352a2df1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:13.164843 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1283/2553] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:27:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:27:15.542673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=26 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:27:23.157677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=25 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:27:25.986335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a585f7-d9d9-46a3-8b89-e533497f369f service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:25.988177 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f7a585f7-d9d9-46a3-8b89-e533497f369f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:26.068034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a585f7-d9d9-46a3-8b89-e533497f369f service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:26.075764 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0e5c7-91af-449d-a3f2-5d6fcf10f337 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efd209a50a994b7c8485f2996697218b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:26.076453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0e5c7-91af-449d-a3f2-5d6fcf10f337 service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:26.076840 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0e5c7-91af-449d-a3f2-5d6fcf10f337 service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:26.077178 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0e5c7-91af-449d-a3f2-5d6fcf10f337 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:26.079054 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-10f0e5c7-91af-449d-a3f2-5d6fcf10f337 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:26.091864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0e5c7-91af-449d-a3f2-5d6fcf10f337 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:26.093586 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0e5c7-91af-449d-a3f2-5d6fcf10f337 service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:26.104118 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1271/2554] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:27:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:27:26.557353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96bd00-da10-40f2-815a-839352a2df1d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:26.621171 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96bd00-da10-40f2-815a-839352a2df1d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:26.625695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239983c-a02d-4e3f-b13c-ac129cc699c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:26.626321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239983c-a02d-4e3f-b13c-ac129cc699c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:26.626599 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239983c-a02d-4e3f-b13c-ac129cc699c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:26.626902 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239983c-a02d-4e3f-b13c-ac129cc699c2 admin admin] PATH_INFO: `/v3/users/8f210c98b3514538ad4b1cfe5675c975` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:26.628044 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239983c-a02d-4e3f-b13c-ac129cc699c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f210c98b3514538ad4b1cfe5675c975)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:26.629965 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239983c-a02d-4e3f-b13c-ac129cc699c2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:26.677261 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e239983c-a02d-4e3f-b13c-ac129cc699c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f210c98b3514538ad4b1cfe5675c975'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:26.684598 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e239983c-a02d-4e3f-b13c-ac129cc699c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f210c98b3514538ad4b1cfe5675c975'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:26.697422 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e239983c-a02d-4e3f-b13c-ac129cc699c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f210c98b3514538ad4b1cfe5675c975'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:26.698066 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e239983c-a02d-4e3f-b13c-ac129cc699c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f210c98b3514538ad4b1cfe5675c975'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:26.707142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e239983c-a02d-4e3f-b13c-ac129cc699c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f210c98b3514538ad4b1cfe5675c975'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:26.713829 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1284/2555] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:27:26 2022] DELETE /identity/v3/users/8f210c98b3514538ad4b1cfe5675c975 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:27:26.991778 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0e5c7-91af-449d-a3f2-5d6fcf10f337 service placement] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:27.002511 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0e5c7-91af-449d-a3f2-5d6fcf10f337 service placement] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:27.067825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83665d90-e947-4437-9ff6-af9cb4e1b3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:27.068452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83665d90-e947-4437-9ff6-af9cb4e1b3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:27.068724 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83665d90-e947-4437-9ff6-af9cb4e1b3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:27.069131 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83665d90-e947-4437-9ff6-af9cb4e1b3ab admin admin] PATH_INFO: `/v3/projects/b7cca8bc579645a1bded785e6a7f380d` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:27.071126 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83665d90-e947-4437-9ff6-af9cb4e1b3ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7cca8bc579645a1bded785e6a7f380d)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:27.074971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83665d90-e947-4437-9ff6-af9cb4e1b3ab admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:27.134603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-83665d90-e947-4437-9ff6-af9cb4e1b3ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7cca8bc579645a1bded785e6a7f380d', 'request_id': 'req-83665d90-e947-4437-9ff6-af9cb4e1b3ab'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:27.140683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-83665d90-e947-4437-9ff6-af9cb4e1b3ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7cca8bc579645a1bded785e6a7f380d', 'request_id': 'req-83665d90-e947-4437-9ff6-af9cb4e1b3ab'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:27.147536 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-83665d90-e947-4437-9ff6-af9cb4e1b3ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7cca8bc579645a1bded785e6a7f380d', 'request_id': 'req-83665d90-e947-4437-9ff6-af9cb4e1b3ab'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:27.161155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-83665d90-e947-4437-9ff6-af9cb4e1b3ab admin admin] The token cache is being invalidate because project b7cca8bc579645a1bded785e6a7f380d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:27:27.161446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-83665d90-e947-4437-9ff6-af9cb4e1b3ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:27.162066 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-83665d90-e947-4437-9ff6-af9cb4e1b3ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:27.163823 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1272/2556] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:27:26 2022] DELETE /identity/v3/projects/b7cca8bc579645a1bded785e6a7f380d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:27:27.167686 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239983c-a02d-4e3f-b13c-ac129cc699c2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:27.169389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e239983c-a02d-4e3f-b13c-ac129cc699c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:27.183597 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239983c-a02d-4e3f-b13c-ac129cc699c2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:27.242210 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400f0fb-ec29-47c0-be1a-c50ea6ce1f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:27.242781 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400f0fb-ec29-47c0-be1a-c50ea6ce1f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:27.243061 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400f0fb-ec29-47c0-be1a-c50ea6ce1f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:27.243333 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400f0fb-ec29-47c0-be1a-c50ea6ce1f82 admin admin] PATH_INFO: `/v3/users/49be201c809e4cdd8989bf3f0e81a831` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:27.244455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400f0fb-ec29-47c0-be1a-c50ea6ce1f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49be201c809e4cdd8989bf3f0e81a831)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:27.246401 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400f0fb-ec29-47c0-be1a-c50ea6ce1f82 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:27.268829 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:27:27.308710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a400f0fb-ec29-47c0-be1a-c50ea6ce1f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49be201c809e4cdd8989bf3f0e81a831'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:27.317879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a400f0fb-ec29-47c0-be1a-c50ea6ce1f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49be201c809e4cdd8989bf3f0e81a831'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:27.334275 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a400f0fb-ec29-47c0-be1a-c50ea6ce1f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49be201c809e4cdd8989bf3f0e81a831'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:27.335161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a400f0fb-ec29-47c0-be1a-c50ea6ce1f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49be201c809e4cdd8989bf3f0e81a831'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:27.345953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a400f0fb-ec29-47c0-be1a-c50ea6ce1f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49be201c809e4cdd8989bf3f0e81a831'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:27.355592 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1285/2557] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:27:27 2022] DELETE /identity/v3/users/49be201c809e4cdd8989bf3f0e81a831 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:27:27.558666 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83665d90-e947-4437-9ff6-af9cb4e1b3ab admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:27.560497 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-83665d90-e947-4437-9ff6-af9cb4e1b3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:27.585923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83665d90-e947-4437-9ff6-af9cb4e1b3ab admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:27.608322 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:27:27.660170 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2237ae-67ff-4659-b649-f1525265692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:27.661373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2237ae-67ff-4659-b649-f1525265692e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:27.661656 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2237ae-67ff-4659-b649-f1525265692e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:27.661929 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2237ae-67ff-4659-b649-f1525265692e admin admin] PATH_INFO: `/v3/projects/0669e36a33394c6d93cd17d17066059d` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:27.663096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2237ae-67ff-4659-b649-f1525265692e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0669e36a33394c6d93cd17d17066059d)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:27.665021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2237ae-67ff-4659-b649-f1525265692e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:27.714700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cd2237ae-67ff-4659-b649-f1525265692e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0669e36a33394c6d93cd17d17066059d', 'request_id': 'req-cd2237ae-67ff-4659-b649-f1525265692e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:27.721126 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cd2237ae-67ff-4659-b649-f1525265692e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0669e36a33394c6d93cd17d17066059d', 'request_id': 'req-cd2237ae-67ff-4659-b649-f1525265692e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:27.728417 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cd2237ae-67ff-4659-b649-f1525265692e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0669e36a33394c6d93cd17d17066059d', 'request_id': 'req-cd2237ae-67ff-4659-b649-f1525265692e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:27.742205 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cd2237ae-67ff-4659-b649-f1525265692e admin admin] The token cache is being invalidate because project 0669e36a33394c6d93cd17d17066059d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:27:27.742584 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cd2237ae-67ff-4659-b649-f1525265692e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:27.743792 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cd2237ae-67ff-4659-b649-f1525265692e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:27.745303 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1273/2558] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:27:27 2022] DELETE /identity/v3/projects/0669e36a33394c6d93cd17d17066059d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:27:27.750186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dfa34-a54f-4656-b6d4-d5789283e3ba None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:27.750651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dfa34-a54f-4656-b6d4-d5789283e3ba None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:27.750789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dfa34-a54f-4656-b6d4-d5789283e3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:27.770968 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0d6dfa34-a54f-4656-b6d4-d5789283e3ba None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:27:27.772082 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0d6dfa34-a54f-4656-b6d4-d5789283e3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:27.847672 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1286/2559] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:27:27.847816 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44182776-febb-41de-a91c-46dd466676c4 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:27.847816 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44182776-febb-41de-a91c-46dd466676c4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:27.847816 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44182776-febb-41de-a91c-46dd466676c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:27.864223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-44182776-febb-41de-a91c-46dd466676c4 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:27:27.865449 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-44182776-febb-41de-a91c-46dd466676c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:27.873437 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1274/2560] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:27:27.877746 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dfa34-a54f-4656-b6d4-d5789283e3ba None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:27.888943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dfa34-a54f-4656-b6d4-d5789283e3ba None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:27.893637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e074dc-401d-4a2c-80c2-9d1bd5ea277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:27.894241 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e074dc-401d-4a2c-80c2-9d1bd5ea277b admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:27.894520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e074dc-401d-4a2c-80c2-9d1bd5ea277b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:27.894828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e074dc-401d-4a2c-80c2-9d1bd5ea277b admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:27.896059 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e074dc-401d-4a2c-80c2-9d1bd5ea277b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:27:27.896364 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e074dc-401d-4a2c-80c2-9d1bd5ea277b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:27.897964 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e074dc-401d-4a2c-80c2-9d1bd5ea277b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:27.909768 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1287/2561] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:27:27.913997 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44182776-febb-41de-a91c-46dd466676c4 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:27.923490 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44182776-febb-41de-a91c-46dd466676c4 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:27.928133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a734b68-3efc-4676-a209-173fde6ed743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:27.928730 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a734b68-3efc-4676-a209-173fde6ed743 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:27.929008 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a734b68-3efc-4676-a209-173fde6ed743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:27.929283 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a734b68-3efc-4676-a209-173fde6ed743 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:27.929954 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a734b68-3efc-4676-a209-173fde6ed743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:27.931952 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a734b68-3efc-4676-a209-173fde6ed743 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:27.960516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1275/2562] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:27:27 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:27:27.964602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e074dc-401d-4a2c-80c2-9d1bd5ea277b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:27.974386 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e074dc-401d-4a2c-80c2-9d1bd5ea277b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:28.032601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ec39d-7057-4855-b636-0787acb02d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:28.033116 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ec39d-7057-4855-b636-0787acb02d39 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:28.033417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ec39d-7057-4855-b636-0787acb02d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:28.033691 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ec39d-7057-4855-b636-0787acb02d39 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:28.034337 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ec39d-7057-4855-b636-0787acb02d39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:28.036352 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ec39d-7057-4855-b636-0787acb02d39 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:28.057990 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1288/2563] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:27:27 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:27:28.062167 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a734b68-3efc-4676-a209-173fde6ed743 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:28.073588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a734b68-3efc-4676-a209-173fde6ed743 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:28.079165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfca6a-b680-41c7-93ad-8e8072b48e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:28.079844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfca6a-b680-41c7-93ad-8e8072b48e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:28.080133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfca6a-b680-41c7-93ad-8e8072b48e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:28.080422 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfca6a-b680-41c7-93ad-8e8072b48e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:28.081060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfca6a-b680-41c7-93ad-8e8072b48e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:28.083248 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfca6a-b680-41c7-93ad-8e8072b48e16 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:28.097935 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1276/2564] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:27:28.098900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ec39d-7057-4855-b636-0787acb02d39 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:28.116622 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ec39d-7057-4855-b636-0787acb02d39 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:28.128887 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2db582-2321-4f8e-a9ae-72bc3ef06b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:28.128887 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2db582-2321-4f8e-a9ae-72bc3ef06b8a admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:28.128887 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2db582-2321-4f8e-a9ae-72bc3ef06b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:28.128887 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2db582-2321-4f8e-a9ae-72bc3ef06b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:28.129317 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2db582-2321-4f8e-a9ae-72bc3ef06b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:28.131201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2db582-2321-4f8e-a9ae-72bc3ef06b8a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:28.148472 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1289/2565] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:27:28.152287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfca6a-b680-41c7-93ad-8e8072b48e16 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:28.163752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfca6a-b680-41c7-93ad-8e8072b48e16 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:28.170538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8336c14-3612-4aa6-b2ea-7eeb7ec7dda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:28.179294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8336c14-3612-4aa6-b2ea-7eeb7ec7dda4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:28.179759 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8336c14-3612-4aa6-b2ea-7eeb7ec7dda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:28.180217 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8336c14-3612-4aa6-b2ea-7eeb7ec7dda4 admin admin] PATH_INFO: `/v3/projects/8d3a367253584388a72d8ae7018cd9af/users/73f9d5ee4ab34dfda38e5b51809507c5/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:28.197991 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8336c14-3612-4aa6-b2ea-7eeb7ec7dda4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3a367253584388a72d8ae7018cd9af, user_id=73f9d5ee4ab34dfda38e5b51809507c5, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:28.200809 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8336c14-3612-4aa6-b2ea-7eeb7ec7dda4 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:28.230813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1277/2566] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:27:28 2022] PUT /identity/v3/projects/8d3a367253584388a72d8ae7018cd9af/users/73f9d5ee4ab34dfda38e5b51809507c5/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:27:28.235332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2a563-3a3d-403c-81ff-94ea81ceb8d8 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:28.235735 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2a563-3a3d-403c-81ff-94ea81ceb8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:28.236393 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2a563-3a3d-403c-81ff-94ea81ceb8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:28.246786 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:27:28.272196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ecf2a563-3a3d-403c-81ff-94ea81ceb8d8 None None] MFA Rules not processed for user `73f9d5ee4ab34dfda38e5b51809507c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:27:28.273900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ecf2a563-3a3d-403c-81ff-94ea81ceb8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:28.345648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1290/2567] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:27:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:27:28.356754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8336c14-3612-4aa6-b2ea-7eeb7ec7dda4 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:28.358957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b8336c14-3612-4aa6-b2ea-7eeb7ec7dda4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:28.422389 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:27:28.430663 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8336c14-3612-4aa6-b2ea-7eeb7ec7dda4 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:28.436366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0478b3-5dea-4d27-a4cb-b9b57f606342 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '405499a1b5dc4fb6ac7af73910c3d992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:28.437451 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0478b3-5dea-4d27-a4cb-b9b57f606342 service glance] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:28.437840 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0478b3-5dea-4d27-a4cb-b9b57f606342 service glance] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:28.438230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0478b3-5dea-4d27-a4cb-b9b57f606342 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:28.448231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0478b3-5dea-4d27-a4cb-b9b57f606342 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:28.450003 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0478b3-5dea-4d27-a4cb-b9b57f606342 service glance] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:28.461896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1278/2568] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:27:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:27:38.342239 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=30 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:27:38.455857 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:27:46.158040 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d40ed7-a0c3-48e6-9ce5-bd9a4cd02658 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:46.158572 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d40ed7-a0c3-48e6-9ce5-bd9a4cd02658 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:46.158840 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d40ed7-a0c3-48e6-9ce5-bd9a4cd02658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:46.178581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-62d40ed7-a0c3-48e6-9ce5-bd9a4cd02658 None None] MFA Rules not processed for user `71c7a54c598642a4b9219ae21c34f0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:27:46.179827 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-62d40ed7-a0c3-48e6-9ce5-bd9a4cd02658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:46.233745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1291/2569] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 27 04:27:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:27:46.281860 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0478b3-5dea-4d27-a4cb-b9b57f606342 service glance] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:46.283452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ef0478b3-5dea-4d27-a4cb-b9b57f606342 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:46.351833 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0478b3-5dea-4d27-a4cb-b9b57f606342 service glance] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:46.356717 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf663a-b1a3-41d2-963e-d23f5bba9c1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c295a3063c3b45be96b406f586180142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:46.357319 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf663a-b1a3-41d2-963e-d23f5bba9c1d service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:46.357605 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf663a-b1a3-41d2-963e-d23f5bba9c1d service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:46.357881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf663a-b1a3-41d2-963e-d23f5bba9c1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:46.366541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf663a-b1a3-41d2-963e-d23f5bba9c1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:46.368178 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf663a-b1a3-41d2-963e-d23f5bba9c1d service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:46.376076 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1279/2570] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 27 04:27:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:27:49.446849 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d40ed7-a0c3-48e6-9ce5-bd9a4cd02658 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:49.519385 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d40ed7-a0c3-48e6-9ce5-bd9a4cd02658 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:49.524601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e47347-4bda-4d0f-9f80-15f7ac709451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:49.525374 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e47347-4bda-4d0f-9f80-15f7ac709451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:49.525664 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e47347-4bda-4d0f-9f80-15f7ac709451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:49.525943 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e47347-4bda-4d0f-9f80-15f7ac709451 admin admin] PATH_INFO: `/v3/users/73f9d5ee4ab34dfda38e5b51809507c5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:49.532946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e47347-4bda-4d0f-9f80-15f7ac709451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f9d5ee4ab34dfda38e5b51809507c5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:49.535815 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e47347-4bda-4d0f-9f80-15f7ac709451 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:49.595853 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e4e47347-4bda-4d0f-9f80-15f7ac709451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f9d5ee4ab34dfda38e5b51809507c5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:49.607225 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e4e47347-4bda-4d0f-9f80-15f7ac709451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f9d5ee4ab34dfda38e5b51809507c5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:49.622077 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e4e47347-4bda-4d0f-9f80-15f7ac709451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f9d5ee4ab34dfda38e5b51809507c5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:49.622912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e4e47347-4bda-4d0f-9f80-15f7ac709451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f9d5ee4ab34dfda38e5b51809507c5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:49.635490 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e4e47347-4bda-4d0f-9f80-15f7ac709451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f9d5ee4ab34dfda38e5b51809507c5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:49.642904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1292/2571] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:27:49 2022] DELETE /identity/v3/users/73f9d5ee4ab34dfda38e5b51809507c5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:27:49.647784 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef50f5d-d0fc-4b2e-9a8c-6d449063adbe None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:49.648279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef50f5d-d0fc-4b2e-9a8c-6d449063adbe None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:49.648375 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef50f5d-d0fc-4b2e-9a8c-6d449063adbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:49.670754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5ef50f5d-d0fc-4b2e-9a8c-6d449063adbe None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:27:49.672128 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5ef50f5d-d0fc-4b2e-9a8c-6d449063adbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:49.746893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1280/2572] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:27:49.757234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e47347-4bda-4d0f-9f80-15f7ac709451 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:49.758733 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e4e47347-4bda-4d0f-9f80-15f7ac709451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:49.789088 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:27:49.822260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e47347-4bda-4d0f-9f80-15f7ac709451 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:49.826070 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39261d35-134c-45a6-9de3-1cb0e471390b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:49.826683 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39261d35-134c-45a6-9de3-1cb0e471390b service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:49.826993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39261d35-134c-45a6-9de3-1cb0e471390b service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:49.827268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39261d35-134c-45a6-9de3-1cb0e471390b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:49.837422 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39261d35-134c-45a6-9de3-1cb0e471390b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:49.838915 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39261d35-134c-45a6-9de3-1cb0e471390b service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:49.850892 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1293/2573] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:27:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:27:50.172911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef50f5d-d0fc-4b2e-9a8c-6d449063adbe None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:50.174938 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5ef50f5d-d0fc-4b2e-9a8c-6d449063adbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:50.203439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef50f5d-d0fc-4b2e-9a8c-6d449063adbe None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:50.213701 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cfa1c-ae7c-4cfe-8ccc-2edf83ffd943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:50.214749 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cfa1c-ae7c-4cfe-8ccc-2edf83ffd943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:50.215041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cfa1c-ae7c-4cfe-8ccc-2edf83ffd943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:50.215406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cfa1c-ae7c-4cfe-8ccc-2edf83ffd943 admin admin] PATH_INFO: `/v3/projects/8d3a367253584388a72d8ae7018cd9af` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:50.217169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cfa1c-ae7c-4cfe-8ccc-2edf83ffd943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d3a367253584388a72d8ae7018cd9af)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:50.218881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cfa1c-ae7c-4cfe-8ccc-2edf83ffd943 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:50.284531 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4f8cfa1c-ae7c-4cfe-8ccc-2edf83ffd943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d3a367253584388a72d8ae7018cd9af', 'request_id': 'req-4f8cfa1c-ae7c-4cfe-8ccc-2edf83ffd943'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:50.293605 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4f8cfa1c-ae7c-4cfe-8ccc-2edf83ffd943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d3a367253584388a72d8ae7018cd9af', 'request_id': 'req-4f8cfa1c-ae7c-4cfe-8ccc-2edf83ffd943'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:50.302928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4f8cfa1c-ae7c-4cfe-8ccc-2edf83ffd943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d3a367253584388a72d8ae7018cd9af', 'request_id': 'req-4f8cfa1c-ae7c-4cfe-8ccc-2edf83ffd943'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:50.322086 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4f8cfa1c-ae7c-4cfe-8ccc-2edf83ffd943 admin admin] The token cache is being invalidate because project 8d3a367253584388a72d8ae7018cd9af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:27:50.322513 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4f8cfa1c-ae7c-4cfe-8ccc-2edf83ffd943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:50.323365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4f8cfa1c-ae7c-4cfe-8ccc-2edf83ffd943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:50.329207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1281/2574] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:27:50 2022] DELETE /identity/v3/projects/8d3a367253584388a72d8ae7018cd9af => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:27:50.335839 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6710052-1a22-4130-aacf-1c6cc7f6d931 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:50.336151 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6710052-1a22-4130-aacf-1c6cc7f6d931 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:50.336402 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6710052-1a22-4130-aacf-1c6cc7f6d931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:50.363296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f6710052-1a22-4130-aacf-1c6cc7f6d931 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:27:50.366078 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f6710052-1a22-4130-aacf-1c6cc7f6d931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:50.457200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1294/2575] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:27:50.522982 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d06461-a3d9-4da4-bb98-a24cd2966d21 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:50.523270 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d06461-a3d9-4da4-bb98-a24cd2966d21 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:50.523608 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d06461-a3d9-4da4-bb98-a24cd2966d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:50.548354 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-46d06461-a3d9-4da4-bb98-a24cd2966d21 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:27:50.549603 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-46d06461-a3d9-4da4-bb98-a24cd2966d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:50.558521 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1282/2576] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:27:50.562981 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6710052-1a22-4130-aacf-1c6cc7f6d931 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:50.573177 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6710052-1a22-4130-aacf-1c6cc7f6d931 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:50.577852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14935ed2-3dae-471d-ac1d-63d9d3872e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:50.578444 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14935ed2-3dae-471d-ac1d-63d9d3872e5d admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:50.578745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14935ed2-3dae-471d-ac1d-63d9d3872e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:50.579041 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14935ed2-3dae-471d-ac1d-63d9d3872e5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:50.582556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14935ed2-3dae-471d-ac1d-63d9d3872e5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:27:50.582818 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14935ed2-3dae-471d-ac1d-63d9d3872e5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:50.584471 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14935ed2-3dae-471d-ac1d-63d9d3872e5d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:50.598645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1295/2577] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:27:50.602738 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d06461-a3d9-4da4-bb98-a24cd2966d21 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:50.614119 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d06461-a3d9-4da4-bb98-a24cd2966d21 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:50.621050 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb9c56-9d51-4277-a581-a748580745aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:50.621659 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb9c56-9d51-4277-a581-a748580745aa admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:50.621939 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb9c56-9d51-4277-a581-a748580745aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:50.622227 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb9c56-9d51-4277-a581-a748580745aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:50.622888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb9c56-9d51-4277-a581-a748580745aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:50.624795 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb9c56-9d51-4277-a581-a748580745aa admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:50.632264 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:27:50.659335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1283/2578] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:27:50 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:27:50.663677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14935ed2-3dae-471d-ac1d-63d9d3872e5d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:50.674558 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14935ed2-3dae-471d-ac1d-63d9d3872e5d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:50.741711 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973365a-5b94-411f-8170-1647c48ecdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:50.742258 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973365a-5b94-411f-8170-1647c48ecdda admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:50.742540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973365a-5b94-411f-8170-1647c48ecdda admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:50.742855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973365a-5b94-411f-8170-1647c48ecdda admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:50.743506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973365a-5b94-411f-8170-1647c48ecdda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:50.748507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973365a-5b94-411f-8170-1647c48ecdda admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:50.778752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1296/2579] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:27:50 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:27:50.780370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb9c56-9d51-4277-a581-a748580745aa admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:50.791927 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb9c56-9d51-4277-a581-a748580745aa admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:50.796722 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634215a-914f-454a-9645-f3536c21cf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:50.797339 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634215a-914f-454a-9645-f3536c21cf76 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:50.797625 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634215a-914f-454a-9645-f3536c21cf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:50.797903 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634215a-914f-454a-9645-f3536c21cf76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:50.798587 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634215a-914f-454a-9645-f3536c21cf76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:50.800637 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634215a-914f-454a-9645-f3536c21cf76 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:50.811700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1284/2580] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:27:50.815923 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973365a-5b94-411f-8170-1647c48ecdda admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:50.826337 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973365a-5b94-411f-8170-1647c48ecdda admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:50.831228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495da51-e3ff-4a32-b75a-b1492b4f74bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:50.831863 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495da51-e3ff-4a32-b75a-b1492b4f74bb admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:50.832669 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495da51-e3ff-4a32-b75a-b1492b4f74bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:50.832952 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495da51-e3ff-4a32-b75a-b1492b4f74bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:50.833597 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495da51-e3ff-4a32-b75a-b1492b4f74bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:50.835240 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495da51-e3ff-4a32-b75a-b1492b4f74bb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:50.849763 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1297/2581] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:27:50.851044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634215a-914f-454a-9645-f3536c21cf76 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:50.862928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634215a-914f-454a-9645-f3536c21cf76 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:50.868307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ca790-5a0c-4c9c-8c77-89e325163b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:50.869037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ca790-5a0c-4c9c-8c77-89e325163b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:50.869327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ca790-5a0c-4c9c-8c77-89e325163b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:50.869605 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ca790-5a0c-4c9c-8c77-89e325163b95 admin admin] PATH_INFO: `/v3/projects/bafc8fd2047a4283a7349a6980cc8d1b/users/108abddd5c2544d3a9a89bfd1dc48781/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:50.885848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ca790-5a0c-4c9c-8c77-89e325163b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bafc8fd2047a4283a7349a6980cc8d1b, user_id=108abddd5c2544d3a9a89bfd1dc48781, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:50.888588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ca790-5a0c-4c9c-8c77-89e325163b95 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:50.904438 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1285/2582] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:27:50 2022] PUT /identity/v3/projects/bafc8fd2047a4283a7349a6980cc8d1b/users/108abddd5c2544d3a9a89bfd1dc48781/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:27:50.914305 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2e29b-3e3a-4cab-8175-e6a2bb983c91 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:50.914597 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2e29b-3e3a-4cab-8175-e6a2bb983c91 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:50.914909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2e29b-3e3a-4cab-8175-e6a2bb983c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:50.950829 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c8a2e29b-3e3a-4cab-8175-e6a2bb983c91 None None] MFA Rules not processed for user `108abddd5c2544d3a9a89bfd1dc48781`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:27:50.953089 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c8a2e29b-3e3a-4cab-8175-e6a2bb983c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:50.983213 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:27:51.040505 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1298/2583] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:27:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:27:51.056308 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ca790-5a0c-4c9c-8c77-89e325163b95 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:51.060130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-644ca790-5a0c-4c9c-8c77-89e325163b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:51.120906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ca790-5a0c-4c9c-8c77-89e325163b95 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:51.125367 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a8bd6-586e-4fcb-a2bd-976312c4147d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:51.126107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a8bd6-586e-4fcb-a2bd-976312c4147d service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:51.126478 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a8bd6-586e-4fcb-a2bd-976312c4147d service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:51.126851 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a8bd6-586e-4fcb-a2bd-976312c4147d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:51.136073 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a8bd6-586e-4fcb-a2bd-976312c4147d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:51.140197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a8bd6-586e-4fcb-a2bd-976312c4147d service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:51.147888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1286/2584] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:27:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:27:54.342675 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2e29b-3e3a-4cab-8175-e6a2bb983c91 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:54.440375 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2e29b-3e3a-4cab-8175-e6a2bb983c91 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:54.445537 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daa060-d85f-4a06-9d87-3beb90849433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:54.446213 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daa060-d85f-4a06-9d87-3beb90849433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:54.446486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daa060-d85f-4a06-9d87-3beb90849433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:54.446891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daa060-d85f-4a06-9d87-3beb90849433 admin admin] PATH_INFO: `/v3/users/108abddd5c2544d3a9a89bfd1dc48781` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:54.448054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7daa060-d85f-4a06-9d87-3beb90849433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=108abddd5c2544d3a9a89bfd1dc48781)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:54.449976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7daa060-d85f-4a06-9d87-3beb90849433 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:54.514515 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e7daa060-d85f-4a06-9d87-3beb90849433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '108abddd5c2544d3a9a89bfd1dc48781'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:54.523262 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e7daa060-d85f-4a06-9d87-3beb90849433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '108abddd5c2544d3a9a89bfd1dc48781'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:54.538037 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e7daa060-d85f-4a06-9d87-3beb90849433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '108abddd5c2544d3a9a89bfd1dc48781'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:54.538879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e7daa060-d85f-4a06-9d87-3beb90849433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '108abddd5c2544d3a9a89bfd1dc48781'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:54.548659 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e7daa060-d85f-4a06-9d87-3beb90849433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '108abddd5c2544d3a9a89bfd1dc48781'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:54.556003 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1299/2585] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:27:54 2022] DELETE /identity/v3/users/108abddd5c2544d3a9a89bfd1dc48781 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:27:54.561309 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68448b5d-28ed-4105-86b3-18242687c19f None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:54.561825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68448b5d-28ed-4105-86b3-18242687c19f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:54.562069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68448b5d-28ed-4105-86b3-18242687c19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:54.587243 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-68448b5d-28ed-4105-86b3-18242687c19f None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:27:54.588800 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-68448b5d-28ed-4105-86b3-18242687c19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:54.658939 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1287/2586] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:27:54.668988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daa060-d85f-4a06-9d87-3beb90849433 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:54.670513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e7daa060-d85f-4a06-9d87-3beb90849433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:54.723963 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:27:54.741941 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daa060-d85f-4a06-9d87-3beb90849433 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:54.745828 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e430e0-dcf2-495f-bfb3-7231cb76b5ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:54.746507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e430e0-dcf2-495f-bfb3-7231cb76b5ff service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:54.746871 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e430e0-dcf2-495f-bfb3-7231cb76b5ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:54.747092 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e430e0-dcf2-495f-bfb3-7231cb76b5ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:54.757184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e430e0-dcf2-495f-bfb3-7231cb76b5ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:54.758739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e430e0-dcf2-495f-bfb3-7231cb76b5ff service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:54.770813 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1300/2587] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:27:55.064282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68448b5d-28ed-4105-86b3-18242687c19f None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:55.065836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-68448b5d-28ed-4105-86b3-18242687c19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:55.079471 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68448b5d-28ed-4105-86b3-18242687c19f None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:55.084976 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648bb3da-6b5c-4c29-a2dd-0e166d5d334a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:55.085682 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bb3da-6b5c-4c29-a2dd-0e166d5d334a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:55.086094 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bb3da-6b5c-4c29-a2dd-0e166d5d334a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:55.086422 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bb3da-6b5c-4c29-a2dd-0e166d5d334a admin admin] PATH_INFO: `/v3/projects/bafc8fd2047a4283a7349a6980cc8d1b` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:55.087668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648bb3da-6b5c-4c29-a2dd-0e166d5d334a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bafc8fd2047a4283a7349a6980cc8d1b)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:55.089816 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648bb3da-6b5c-4c29-a2dd-0e166d5d334a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:55.151908 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:27:55.153490 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-648bb3da-6b5c-4c29-a2dd-0e166d5d334a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bafc8fd2047a4283a7349a6980cc8d1b', 'request_id': 'req-648bb3da-6b5c-4c29-a2dd-0e166d5d334a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:55.179656 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-648bb3da-6b5c-4c29-a2dd-0e166d5d334a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bafc8fd2047a4283a7349a6980cc8d1b', 'request_id': 'req-648bb3da-6b5c-4c29-a2dd-0e166d5d334a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:55.190830 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-648bb3da-6b5c-4c29-a2dd-0e166d5d334a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bafc8fd2047a4283a7349a6980cc8d1b', 'request_id': 'req-648bb3da-6b5c-4c29-a2dd-0e166d5d334a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:55.214649 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-648bb3da-6b5c-4c29-a2dd-0e166d5d334a admin admin] The token cache is being invalidate because project bafc8fd2047a4283a7349a6980cc8d1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:27:55.214913 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-648bb3da-6b5c-4c29-a2dd-0e166d5d334a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:55.215694 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-648bb3da-6b5c-4c29-a2dd-0e166d5d334a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:27:55.217437 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1288/2588] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:27:55 2022] DELETE /identity/v3/projects/bafc8fd2047a4283a7349a6980cc8d1b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:27:55.222231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40945eda-2b14-44e0-96b7-dbe2d9fe2a25 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:55.222556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40945eda-2b14-44e0-96b7-dbe2d9fe2a25 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:55.222892 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40945eda-2b14-44e0-96b7-dbe2d9fe2a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:55.245322 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-40945eda-2b14-44e0-96b7-dbe2d9fe2a25 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:27:55.246912 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-40945eda-2b14-44e0-96b7-dbe2d9fe2a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:55.317570 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1301/2589] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:27:55.325677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d4346-4597-4600-9da9-4e159e2c8800 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:55.326100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d4346-4597-4600-9da9-4e159e2c8800 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:55.326538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d4346-4597-4600-9da9-4e159e2c8800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:55.356017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-931d4346-4597-4600-9da9-4e159e2c8800 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:27:55.357377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-931d4346-4597-4600-9da9-4e159e2c8800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:55.368552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1289/2590] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:27:55.372432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40945eda-2b14-44e0-96b7-dbe2d9fe2a25 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:55.387454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40945eda-2b14-44e0-96b7-dbe2d9fe2a25 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:55.400970 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74d783-a438-4732-b4b9-f21f03063dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:55.401603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74d783-a438-4732-b4b9-f21f03063dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:55.401879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74d783-a438-4732-b4b9-f21f03063dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:55.402151 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74d783-a438-4732-b4b9-f21f03063dd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:55.402834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74d783-a438-4732-b4b9-f21f03063dd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:27:55.403143 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74d783-a438-4732-b4b9-f21f03063dd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:55.404947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74d783-a438-4732-b4b9-f21f03063dd0 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:55.428247 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1302/2591] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:27:55.429849 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d4346-4597-4600-9da9-4e159e2c8800 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:55.444269 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d4346-4597-4600-9da9-4e159e2c8800 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:55.450624 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63678e-47b1-472c-88ce-0046911ad163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:55.451261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63678e-47b1-472c-88ce-0046911ad163 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:55.451543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63678e-47b1-472c-88ce-0046911ad163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:55.451813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63678e-47b1-472c-88ce-0046911ad163 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:55.452446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63678e-47b1-472c-88ce-0046911ad163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:55.454553 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63678e-47b1-472c-88ce-0046911ad163 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:55.488650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1290/2592] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:27:55 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:27:55.492701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74d783-a438-4732-b4b9-f21f03063dd0 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:55.507951 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74d783-a438-4732-b4b9-f21f03063dd0 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:55.573414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9e70a-c530-4be2-9f28-42493bc862c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:55.574192 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9e70a-c530-4be2-9f28-42493bc862c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:55.574573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9e70a-c530-4be2-9f28-42493bc862c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:55.574996 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9e70a-c530-4be2-9f28-42493bc862c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:55.575743 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9e70a-c530-4be2-9f28-42493bc862c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:55.577772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9e70a-c530-4be2-9f28-42493bc862c5 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:55.601639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1303/2593] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:27:55 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:27:55.605850 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63678e-47b1-472c-88ce-0046911ad163 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:55.616789 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63678e-47b1-472c-88ce-0046911ad163 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:55.621964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795b783-ade6-4efc-8ce3-516484da0c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:55.622686 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795b783-ade6-4efc-8ce3-516484da0c4f admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:55.623104 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795b783-ade6-4efc-8ce3-516484da0c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:55.623465 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795b783-ade6-4efc-8ce3-516484da0c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:55.624123 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795b783-ade6-4efc-8ce3-516484da0c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:55.625883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795b783-ade6-4efc-8ce3-516484da0c4f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:55.641181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1291/2594] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:27:55.642513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9e70a-c530-4be2-9f28-42493bc862c5 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:55.653499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9e70a-c530-4be2-9f28-42493bc862c5 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:55.658742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdabce-8b10-4fb3-b486-6d894693bdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:55.658902 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdabce-8b10-4fb3-b486-6d894693bdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:55.659080 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdabce-8b10-4fb3-b486-6d894693bdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:55.659346 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdabce-8b10-4fb3-b486-6d894693bdb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:55.660879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdabce-8b10-4fb3-b486-6d894693bdb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:55.662931 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdabce-8b10-4fb3-b486-6d894693bdb9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:55.674661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1304/2595] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:27:55.679424 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795b783-ade6-4efc-8ce3-516484da0c4f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:55.689831 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795b783-ade6-4efc-8ce3-516484da0c4f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:55.697137 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8def9a8-0cac-4c95-86b3-15db69ae8425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:55.698065 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8def9a8-0cac-4c95-86b3-15db69ae8425 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:55.698197 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8def9a8-0cac-4c95-86b3-15db69ae8425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:55.698421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8def9a8-0cac-4c95-86b3-15db69ae8425 admin admin] PATH_INFO: `/v3/projects/0ad8aa4a278f4535bc1d6d8723761cfa/users/ff2efe4d4aa44c08b20351c467a1b742/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:55.713706 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8def9a8-0cac-4c95-86b3-15db69ae8425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad8aa4a278f4535bc1d6d8723761cfa, user_id=ff2efe4d4aa44c08b20351c467a1b742, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:55.716402 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8def9a8-0cac-4c95-86b3-15db69ae8425 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:55.730377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1292/2596] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:27:55 2022] PUT /identity/v3/projects/0ad8aa4a278f4535bc1d6d8723761cfa/users/ff2efe4d4aa44c08b20351c467a1b742/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:27:55.742467 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee6338-fa99-4605-8f1d-595f210e1b33 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:55.742783 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee6338-fa99-4605-8f1d-595f210e1b33 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:55.743064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee6338-fa99-4605-8f1d-595f210e1b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:55.771463 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c0ee6338-fa99-4605-8f1d-595f210e1b33 None None] MFA Rules not processed for user `ff2efe4d4aa44c08b20351c467a1b742`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:27:55.773474 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c0ee6338-fa99-4605-8f1d-595f210e1b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:55.818374 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:27:55.845113 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1305/2597] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:27:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:27:55.856980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8def9a8-0cac-4c95-86b3-15db69ae8425 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:27:55.858653 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b8def9a8-0cac-4c95-86b3-15db69ae8425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:55.915165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8def9a8-0cac-4c95-86b3-15db69ae8425 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:27:55.918813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa021f-d8d5-4117-9c19-11e065971edf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:27:55.919409 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa021f-d8d5-4117-9c19-11e065971edf service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:55.919691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa021f-d8d5-4117-9c19-11e065971edf service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:55.919963 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa021f-d8d5-4117-9c19-11e065971edf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:55.928670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa021f-d8d5-4117-9c19-11e065971edf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:27:55.930092 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa021f-d8d5-4117-9c19-11e065971edf service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:27:55.938584 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1293/2598] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:27:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:27:57.288879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8753eb5-e275-4b87-88c7-6bd59df5a226 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:27:57.289387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8753eb5-e275-4b87-88c7-6bd59df5a226 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:27:57.289520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8753eb5-e275-4b87-88c7-6bd59df5a226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:27:57.308555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-a8753eb5-e275-4b87-88c7-6bd59df5a226 None None] MFA Rules not processed for user `ff2efe4d4aa44c08b20351c467a1b742`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:27:57.309744 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a8753eb5-e275-4b87-88c7-6bd59df5a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:27:57.316546 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1306/2599] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:27:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:28:05.578201 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b52201-2360-4d59-833e-c42568da738a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:28:05.578673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b52201-2360-4d59-833e-c42568da738a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:28:05.578791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b52201-2360-4d59-833e-c42568da738a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:28:05.617200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f4b52201-2360-4d59-833e-c42568da738a None None] MFA Rules not processed for user `71c7a54c598642a4b9219ae21c34f0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:28:05.618551 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f4b52201-2360-4d59-833e-c42568da738a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:28:05.677636 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:28:05.706202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1294/2600] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 27 04:28:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:28:05.718708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8753eb5-e275-4b87-88c7-6bd59df5a226 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:28:05.720113 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a8753eb5-e275-4b87-88c7-6bd59df5a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:28:05.822772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8753eb5-e275-4b87-88c7-6bd59df5a226 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:28:05.827834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e134815-1998-438c-a059-158a0baebc8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c295a3063c3b45be96b406f586180142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:28:05.828436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e134815-1998-438c-a059-158a0baebc8f service swift] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:28:05.828717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e134815-1998-438c-a059-158a0baebc8f service swift] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:28:05.828994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e134815-1998-438c-a059-158a0baebc8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:28:05.837494 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e134815-1998-438c-a059-158a0baebc8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:28:05.839154 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e134815-1998-438c-a059-158a0baebc8f service swift] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:28:05.846939 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1307/2601] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 27 04:28:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:28:15.704438 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=11 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:28:15.843814 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=59 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:28:22.552492 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b52201-2360-4d59-833e-c42568da738a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:28:22.554200 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f4b52201-2360-4d59-833e-c42568da738a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:28:22.661628 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b52201-2360-4d59-833e-c42568da738a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:28:22.666598 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9bdea-7f41-4e96-9416-24beb9f2c738 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efd209a50a994b7c8485f2996697218b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:28:22.667231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9bdea-7f41-4e96-9416-24beb9f2c738 service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:28:22.667517 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9bdea-7f41-4e96-9416-24beb9f2c738 service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:28:22.667795 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9bdea-7f41-4e96-9416-24beb9f2c738 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:28:22.669528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fcb9bdea-7f41-4e96-9416-24beb9f2c738 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:28:22.681024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9bdea-7f41-4e96-9416-24beb9f2c738 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:28:22.682666 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9bdea-7f41-4e96-9416-24beb9f2c738 service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:28:22.693018 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1295/2602] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:28:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:28:26.429020 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c01e4-b208-450e-88f9-278dd22cbc72 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:28:26.429515 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c01e4-b208-450e-88f9-278dd22cbc72 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:28:26.429625 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c01e4-b208-450e-88f9-278dd22cbc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:28:26.449203 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-3d4c01e4-b208-450e-88f9-278dd22cbc72 None None] MFA Rules not processed for user `71c7a54c598642a4b9219ae21c34f0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:28:26.450403 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3d4c01e4-b208-450e-88f9-278dd22cbc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:28:26.457595 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1308/2603] 10.222.0.48 () {58 vars in 967 bytes} [Tue Sep 27 04:28:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:28:26.470155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9bdea-7f41-4e96-9416-24beb9f2c738 service placement] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:28:26.482079 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9bdea-7f41-4e96-9416-24beb9f2c738 service placement] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:28:26.487259 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee837d6-1823-415b-a408-44caf5b711ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c295a3063c3b45be96b406f586180142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:28:26.488122 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee837d6-1823-415b-a408-44caf5b711ef service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:28:26.488960 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee837d6-1823-415b-a408-44caf5b711ef service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:28:26.489237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee837d6-1823-415b-a408-44caf5b711ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:28:26.497306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee837d6-1823-415b-a408-44caf5b711ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:28:26.498927 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee837d6-1823-415b-a408-44caf5b711ef service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:28:26.506932 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1296/2604] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 27 04:28:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:28:26.891464 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be8f25-0cb2-41e2-ba7c-1658fbafccb4 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:28:26.891753 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be8f25-0cb2-41e2-ba7c-1658fbafccb4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:28:26.892049 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be8f25-0cb2-41e2-ba7c-1658fbafccb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:28:26.912862 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-72be8f25-0cb2-41e2-ba7c-1658fbafccb4 None None] MFA Rules not processed for user `71c7a54c598642a4b9219ae21c34f0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:28:26.914082 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-72be8f25-0cb2-41e2-ba7c-1658fbafccb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:28:26.921518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1309/2605] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 27 04:28:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:28:26.933934 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee837d6-1823-415b-a408-44caf5b711ef service swift] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:28:26.945406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee837d6-1823-415b-a408-44caf5b711ef service swift] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:28:26.950521 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf8184-1a7b-4735-bec4-aeafa49e366a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c295a3063c3b45be96b406f586180142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:28:26.951151 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf8184-1a7b-4735-bec4-aeafa49e366a service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:28:26.951433 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf8184-1a7b-4735-bec4-aeafa49e366a service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:28:26.951707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf8184-1a7b-4735-bec4-aeafa49e366a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:28:26.960188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf8184-1a7b-4735-bec4-aeafa49e366a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:28:26.961770 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf8184-1a7b-4735-bec4-aeafa49e366a service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:28:26.969822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1297/2606] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 27 04:28:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:28:27.486033 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c01dc-1faa-45fb-a237-10a397e8b4c0 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:28:27.486888 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c01dc-1faa-45fb-a237-10a397e8b4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:28:27.487064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c01dc-1faa-45fb-a237-10a397e8b4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:28:27.506513 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-985c01dc-1faa-45fb-a237-10a397e8b4c0 None None] MFA Rules not processed for user `71c7a54c598642a4b9219ae21c34f0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:28:27.507834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-985c01dc-1faa-45fb-a237-10a397e8b4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:28:27.515228 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1310/2607] 10.222.0.48 () {58 vars in 967 bytes} [Tue Sep 27 04:28:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:28:27.529995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf8184-1a7b-4735-bec4-aeafa49e366a service swift] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:28:27.541454 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf8184-1a7b-4735-bec4-aeafa49e366a service swift] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:28:27.546604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1c2d3-a3e0-45b4-970c-b9f15ce9c0da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c295a3063c3b45be96b406f586180142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:28:27.547242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1c2d3-a3e0-45b4-970c-b9f15ce9c0da service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:28:27.547532 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1c2d3-a3e0-45b4-970c-b9f15ce9c0da service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:28:27.547812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1c2d3-a3e0-45b4-970c-b9f15ce9c0da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:28:27.556342 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1c2d3-a3e0-45b4-970c-b9f15ce9c0da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:28:27.557976 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1c2d3-a3e0-45b4-970c-b9f15ce9c0da service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:28:27.566601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1298/2608] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 27 04:28:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:28:27.804885 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8ec32-ade8-49b0-ba8a-9fed60d32f5b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:28:27.805260 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8ec32-ade8-49b0-ba8a-9fed60d32f5b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:28:27.805630 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8ec32-ade8-49b0-ba8a-9fed60d32f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:28:27.825542 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d1a8ec32-ade8-49b0-ba8a-9fed60d32f5b None None] MFA Rules not processed for user `71c7a54c598642a4b9219ae21c34f0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:28:27.826885 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d1a8ec32-ade8-49b0-ba8a-9fed60d32f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:28:27.834748 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1311/2609] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 27 04:28:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:28:27.847095 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1c2d3-a3e0-45b4-970c-b9f15ce9c0da service swift] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:28:27.858094 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1c2d3-a3e0-45b4-970c-b9f15ce9c0da service swift] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:28:27.864483 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a465ee-0eeb-43f8-89f8-2272ab7d0301 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c295a3063c3b45be96b406f586180142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:28:27.865156 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a465ee-0eeb-43f8-89f8-2272ab7d0301 service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:28:27.865476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a465ee-0eeb-43f8-89f8-2272ab7d0301 service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:28:27.865776 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a465ee-0eeb-43f8-89f8-2272ab7d0301 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:28:27.874543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a465ee-0eeb-43f8-89f8-2272ab7d0301 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:28:27.876216 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a465ee-0eeb-43f8-89f8-2272ab7d0301 service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:28:27.886061 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1299/2610] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 27 04:28:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:28:28.236461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb711b52-d6d7-427c-90ec-4153a3978917 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:28:28.236745 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb711b52-d6d7-427c-90ec-4153a3978917 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:28:28.237019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb711b52-d6d7-427c-90ec-4153a3978917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:28:28.260183 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-cb711b52-d6d7-427c-90ec-4153a3978917 None None] MFA Rules not processed for user `71c7a54c598642a4b9219ae21c34f0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:28:28.261414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-cb711b52-d6d7-427c-90ec-4153a3978917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:28:28.268686 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1312/2611] 10.222.0.48 () {58 vars in 967 bytes} [Tue Sep 27 04:28:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:28:28.280939 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a465ee-0eeb-43f8-89f8-2272ab7d0301 service swift] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:28:28.291385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a465ee-0eeb-43f8-89f8-2272ab7d0301 service swift] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:28:28.296239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8fa6c-385d-44cb-a2dd-9f9e98169ca3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c295a3063c3b45be96b406f586180142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:28:28.296829 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8fa6c-385d-44cb-a2dd-9f9e98169ca3 service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:28:28.297107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8fa6c-385d-44cb-a2dd-9f9e98169ca3 service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:28:28.297378 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8fa6c-385d-44cb-a2dd-9f9e98169ca3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:28:28.306107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8fa6c-385d-44cb-a2dd-9f9e98169ca3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:28:28.307706 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8fa6c-385d-44cb-a2dd-9f9e98169ca3 service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:28:28.315668 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1300/2612] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 27 04:28:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:28:30.424635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb711b52-d6d7-427c-90ec-4153a3978917 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:28:30.509097 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb711b52-d6d7-427c-90ec-4153a3978917 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:28:30.513535 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbe309-3263-454e-9819-1c4f3470ba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:28:30.514155 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbe309-3263-454e-9819-1c4f3470ba8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:28:30.514432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbe309-3263-454e-9819-1c4f3470ba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:28:30.514705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbe309-3263-454e-9819-1c4f3470ba8b admin admin] PATH_INFO: `/v3/users/ff2efe4d4aa44c08b20351c467a1b742` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:28:30.515872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccbe309-3263-454e-9819-1c4f3470ba8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff2efe4d4aa44c08b20351c467a1b742)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:28:30.517786 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccbe309-3263-454e-9819-1c4f3470ba8b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:28:30.562412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-eccbe309-3263-454e-9819-1c4f3470ba8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff2efe4d4aa44c08b20351c467a1b742'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:28:30.569842 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-eccbe309-3263-454e-9819-1c4f3470ba8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff2efe4d4aa44c08b20351c467a1b742'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:28:30.582197 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-eccbe309-3263-454e-9819-1c4f3470ba8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff2efe4d4aa44c08b20351c467a1b742'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:28:30.582935 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-eccbe309-3263-454e-9819-1c4f3470ba8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff2efe4d4aa44c08b20351c467a1b742'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:28:30.590643 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-eccbe309-3263-454e-9819-1c4f3470ba8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff2efe4d4aa44c08b20351c467a1b742'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:28:30.596984 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1313/2613] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:28:30 2022] DELETE /identity/v3/users/ff2efe4d4aa44c08b20351c467a1b742 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:28:30.601515 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b5c28-2d03-457d-a640-a60ac672cadd None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:28:30.601971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b5c28-2d03-457d-a640-a60ac672cadd None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:28:30.602066 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b5c28-2d03-457d-a640-a60ac672cadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:28:30.644633 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-676b5c28-2d03-457d-a640-a60ac672cadd None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:28:30.645922 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-676b5c28-2d03-457d-a640-a60ac672cadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:28:30.687458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:28:30.705918 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1301/2614] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:28:30.715764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbe309-3263-454e-9819-1c4f3470ba8b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:28:30.717190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-eccbe309-3263-454e-9819-1c4f3470ba8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:28:30.751165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:28:30.799712 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbe309-3263-454e-9819-1c4f3470ba8b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:28:30.803986 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2af18-be82-4903-b7cc-716b242e1810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:28:30.804595 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2af18-be82-4903-b7cc-716b242e1810 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:28:30.804875 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2af18-be82-4903-b7cc-716b242e1810 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:28:30.805152 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2af18-be82-4903-b7cc-716b242e1810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:28:30.814509 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2af18-be82-4903-b7cc-716b242e1810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:28:30.815999 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2af18-be82-4903-b7cc-716b242e1810 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:28:30.825747 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1314/2615] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:28:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:28:30.999966 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b5c28-2d03-457d-a640-a60ac672cadd None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:28:31.001433 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-676b5c28-2d03-457d-a640-a60ac672cadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:28:31.013579 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b5c28-2d03-457d-a640-a60ac672cadd None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:28:31.018149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41c2da-4910-41e6-babf-f29cadbd0414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:28:31.018792 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41c2da-4910-41e6-babf-f29cadbd0414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:28:31.019079 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41c2da-4910-41e6-babf-f29cadbd0414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:28:31.019361 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41c2da-4910-41e6-babf-f29cadbd0414 admin admin] PATH_INFO: `/v3/projects/0ad8aa4a278f4535bc1d6d8723761cfa` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:28:31.020496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41c2da-4910-41e6-babf-f29cadbd0414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ad8aa4a278f4535bc1d6d8723761cfa)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:28:31.022435 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41c2da-4910-41e6-babf-f29cadbd0414 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:28:31.070562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-df41c2da-4910-41e6-babf-f29cadbd0414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad8aa4a278f4535bc1d6d8723761cfa', 'request_id': 'req-df41c2da-4910-41e6-babf-f29cadbd0414'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:28:31.076434 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-df41c2da-4910-41e6-babf-f29cadbd0414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad8aa4a278f4535bc1d6d8723761cfa', 'request_id': 'req-df41c2da-4910-41e6-babf-f29cadbd0414'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:28:31.082644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-df41c2da-4910-41e6-babf-f29cadbd0414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad8aa4a278f4535bc1d6d8723761cfa', 'request_id': 'req-df41c2da-4910-41e6-babf-f29cadbd0414'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:28:31.095280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-df41c2da-4910-41e6-babf-f29cadbd0414 admin admin] The token cache is being invalidate because project 0ad8aa4a278f4535bc1d6d8723761cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:28:31.095564 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-df41c2da-4910-41e6-babf-f29cadbd0414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:28:31.096186 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-df41c2da-4910-41e6-babf-f29cadbd0414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:28:31.098195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1302/2616] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:28:30 2022] DELETE /identity/v3/projects/0ad8aa4a278f4535bc1d6d8723761cfa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:28:40.821393 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=22 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:28:41.092195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:28:59.850465 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2af18-be82-4903-b7cc-716b242e1810 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:28:59.851886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fda2af18-be82-4903-b7cc-716b242e1810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:28:59.863758 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2af18-be82-4903-b7cc-716b242e1810 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:28:59.912823 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c330d20-0434-425f-b7e8-0be400b4c82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:28:59.913489 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c330d20-0434-425f-b7e8-0be400b4c82d service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:28:59.913788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c330d20-0434-425f-b7e8-0be400b4c82d service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:28:59.914078 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c330d20-0434-425f-b7e8-0be400b4c82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:28:59.915959 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6c330d20-0434-425f-b7e8-0be400b4c82d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:28:59.979962 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c330d20-0434-425f-b7e8-0be400b4c82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:28:59.982021 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c330d20-0434-425f-b7e8-0be400b4c82d service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:28:59.991919 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1315/2617] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:29:03.642191 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41c2da-4910-41e6-babf-f29cadbd0414 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:03.643645 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-df41c2da-4910-41e6-babf-f29cadbd0414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:03.659623 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41c2da-4910-41e6-babf-f29cadbd0414 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:03.664285 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300a929-eec3-4b05-b385-e30f8e3f20f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:03.664920 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a929-eec3-4b05-b385-e30f8e3f20f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:03.665211 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a929-eec3-4b05-b385-e30f8e3f20f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:03.665499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a929-eec3-4b05-b385-e30f8e3f20f6 admin admin] PATH_INFO: `/v3/users/8e03bcebeee44978afe2ce5040ddf122` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:03.666634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300a929-eec3-4b05-b385-e30f8e3f20f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e03bcebeee44978afe2ce5040ddf122)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:03.669275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300a929-eec3-4b05-b385-e30f8e3f20f6 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:03.721224 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a300a929-eec3-4b05-b385-e30f8e3f20f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e03bcebeee44978afe2ce5040ddf122'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:03.728847 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a300a929-eec3-4b05-b385-e30f8e3f20f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e03bcebeee44978afe2ce5040ddf122'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:03.729637 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a300a929-eec3-4b05-b385-e30f8e3f20f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e03bcebeee44978afe2ce5040ddf122'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:03.743575 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a300a929-eec3-4b05-b385-e30f8e3f20f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e03bcebeee44978afe2ce5040ddf122'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:03.751442 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a300a929-eec3-4b05-b385-e30f8e3f20f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e03bcebeee44978afe2ce5040ddf122'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:03.757593 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1303/2618] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:29:03 2022] DELETE /identity/v3/users/8e03bcebeee44978afe2ce5040ddf122 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:03.928124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c330d20-0434-425f-b7e8-0be400b4c82d service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:03.938645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c330d20-0434-425f-b7e8-0be400b4c82d service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:04.000309 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2062976-d20c-4e51-aeb3-8d2138a295e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:04.000924 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2062976-d20c-4e51-aeb3-8d2138a295e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:04.001341 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2062976-d20c-4e51-aeb3-8d2138a295e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:04.001488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2062976-d20c-4e51-aeb3-8d2138a295e3 admin admin] PATH_INFO: `/v3/projects/000077de90324331a9527e8c45def22e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:04.002606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2062976-d20c-4e51-aeb3-8d2138a295e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=000077de90324331a9527e8c45def22e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:04.004558 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2062976-d20c-4e51-aeb3-8d2138a295e3 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:04.052792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e2062976-d20c-4e51-aeb3-8d2138a295e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000077de90324331a9527e8c45def22e', 'request_id': 'req-e2062976-d20c-4e51-aeb3-8d2138a295e3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:04.054611 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:04.059188 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e2062976-d20c-4e51-aeb3-8d2138a295e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000077de90324331a9527e8c45def22e', 'request_id': 'req-e2062976-d20c-4e51-aeb3-8d2138a295e3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:04.067322 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e2062976-d20c-4e51-aeb3-8d2138a295e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000077de90324331a9527e8c45def22e', 'request_id': 'req-e2062976-d20c-4e51-aeb3-8d2138a295e3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:04.078454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e2062976-d20c-4e51-aeb3-8d2138a295e3 admin admin] The token cache is being invalidate because project 000077de90324331a9527e8c45def22e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:29:04.078764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e2062976-d20c-4e51-aeb3-8d2138a295e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:04.079384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e2062976-d20c-4e51-aeb3-8d2138a295e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:04.080843 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1316/2619] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:29:03 2022] DELETE /identity/v3/projects/000077de90324331a9527e8c45def22e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:04.086169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8e07b-33a8-4543-8e8f-288434ca90c6 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:04.086555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8e07b-33a8-4543-8e8f-288434ca90c6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:04.086935 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8e07b-33a8-4543-8e8f-288434ca90c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:04.136000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-7eb8e07b-33a8-4543-8e8f-288434ca90c6 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:04.137650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7eb8e07b-33a8-4543-8e8f-288434ca90c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:04.194784 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1304/2620] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:04.203056 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d66ce9-5c09-4e4c-b332-7cb1ea94ea9a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:04.203346 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d66ce9-5c09-4e4c-b332-7cb1ea94ea9a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:04.203621 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d66ce9-5c09-4e4c-b332-7cb1ea94ea9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:04.224550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-74d66ce9-5c09-4e4c-b332-7cb1ea94ea9a None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:04.225777 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-74d66ce9-5c09-4e4c-b332-7cb1ea94ea9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:04.233827 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1317/2621] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:04.238108 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8e07b-33a8-4543-8e8f-288434ca90c6 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:04.248135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8e07b-33a8-4543-8e8f-288434ca90c6 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:04.252801 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b388d3-95cd-4815-8cd4-26335a9924e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:04.253400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b388d3-95cd-4815-8cd4-26335a9924e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:04.253686 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b388d3-95cd-4815-8cd4-26335a9924e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:04.253963 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b388d3-95cd-4815-8cd4-26335a9924e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:04.254619 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b388d3-95cd-4815-8cd4-26335a9924e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:29:04.254964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b388d3-95cd-4815-8cd4-26335a9924e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:04.256578 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b388d3-95cd-4815-8cd4-26335a9924e9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:04.268453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1305/2622] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:29:04.272806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d66ce9-5c09-4e4c-b332-7cb1ea94ea9a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:04.282886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d66ce9-5c09-4e4c-b332-7cb1ea94ea9a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:04.287628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e869244-85eb-4b25-887c-4ad76a031502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:04.288226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e869244-85eb-4b25-887c-4ad76a031502 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:04.288509 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e869244-85eb-4b25-887c-4ad76a031502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:04.288784 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e869244-85eb-4b25-887c-4ad76a031502 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:04.289428 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e869244-85eb-4b25-887c-4ad76a031502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:04.291382 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e869244-85eb-4b25-887c-4ad76a031502 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:04.319028 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1318/2623] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:29:04 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:29:04.323218 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b388d3-95cd-4815-8cd4-26335a9924e9 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:04.333738 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b388d3-95cd-4815-8cd4-26335a9924e9 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:04.367462 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:04.398547 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d8d2b-3df6-47bb-8bad-2e86571f856a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:04.399100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d8d2b-3df6-47bb-8bad-2e86571f856a admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:04.399391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d8d2b-3df6-47bb-8bad-2e86571f856a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:04.399664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d8d2b-3df6-47bb-8bad-2e86571f856a admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:04.400313 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d8d2b-3df6-47bb-8bad-2e86571f856a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:04.402248 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d8d2b-3df6-47bb-8bad-2e86571f856a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:04.424553 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1306/2624] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:29:04 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:29:04.428703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e869244-85eb-4b25-887c-4ad76a031502 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:04.439531 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e869244-85eb-4b25-887c-4ad76a031502 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:04.444201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48bca1-2a07-4de9-a1e1-6051e2fcdb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:04.444797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48bca1-2a07-4de9-a1e1-6051e2fcdb97 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:04.445081 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48bca1-2a07-4de9-a1e1-6051e2fcdb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:04.445356 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48bca1-2a07-4de9-a1e1-6051e2fcdb97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:04.446003 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48bca1-2a07-4de9-a1e1-6051e2fcdb97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:04.447638 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48bca1-2a07-4de9-a1e1-6051e2fcdb97 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:04.458312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1319/2625] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:29:04.462450 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d8d2b-3df6-47bb-8bad-2e86571f856a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:04.473113 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d8d2b-3df6-47bb-8bad-2e86571f856a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:04.477923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be104131-7ab8-4f40-9190-d33125bb7acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:04.478552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be104131-7ab8-4f40-9190-d33125bb7acf admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:04.478897 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be104131-7ab8-4f40-9190-d33125bb7acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:04.479179 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be104131-7ab8-4f40-9190-d33125bb7acf admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:04.479866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be104131-7ab8-4f40-9190-d33125bb7acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:04.481550 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be104131-7ab8-4f40-9190-d33125bb7acf admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:04.492067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1307/2626] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:29:04.496172 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48bca1-2a07-4de9-a1e1-6051e2fcdb97 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:04.506555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48bca1-2a07-4de9-a1e1-6051e2fcdb97 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:04.511339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cca4c-a4dc-4df5-847a-8440fe9efc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:04.512644 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cca4c-a4dc-4df5-847a-8440fe9efc24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:04.512932 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cca4c-a4dc-4df5-847a-8440fe9efc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:04.513211 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cca4c-a4dc-4df5-847a-8440fe9efc24 admin admin] PATH_INFO: `/v3/projects/7dab6e5d62834917967b67a20007855b/users/e5baecad7d934fc986057c8e351a42e4/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:04.527772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cca4c-a4dc-4df5-847a-8440fe9efc24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dab6e5d62834917967b67a20007855b, user_id=e5baecad7d934fc986057c8e351a42e4, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:04.530440 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cca4c-a4dc-4df5-847a-8440fe9efc24 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:04.543925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1320/2627] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:29:04 2022] PUT /identity/v3/projects/7dab6e5d62834917967b67a20007855b/users/e5baecad7d934fc986057c8e351a42e4/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:04.554278 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e8426-049f-4202-9864-89362c9d83b1 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:04.554569 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e8426-049f-4202-9864-89362c9d83b1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:04.554911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e8426-049f-4202-9864-89362c9d83b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:04.584199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-898e8426-049f-4202-9864-89362c9d83b1 None None] MFA Rules not processed for user `e5baecad7d934fc986057c8e351a42e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:04.585424 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-898e8426-049f-4202-9864-89362c9d83b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:04.654057 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1308/2628] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:04.666993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cca4c-a4dc-4df5-847a-8440fe9efc24 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:04.668781 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-973cca4c-a4dc-4df5-847a-8440fe9efc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:04.767506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cca4c-a4dc-4df5-847a-8440fe9efc24 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:04.773812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13728ed5-d92c-462d-83fa-831f9915d052 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:04.774415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13728ed5-d92c-462d-83fa-831f9915d052 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:04.774701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13728ed5-d92c-462d-83fa-831f9915d052 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:04.774992 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13728ed5-d92c-462d-83fa-831f9915d052 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:04.783248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13728ed5-d92c-462d-83fa-831f9915d052 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:04.784837 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13728ed5-d92c-462d-83fa-831f9915d052 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:04.794774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1321/2629] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:29:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:29:05.025323 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e8426-049f-4202-9864-89362c9d83b1 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:05.109007 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e8426-049f-4202-9864-89362c9d83b1 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:05.114244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b826b29-7d77-45c4-b660-c2e2d7eda035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:05.114918 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b826b29-7d77-45c4-b660-c2e2d7eda035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:05.115203 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b826b29-7d77-45c4-b660-c2e2d7eda035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:05.115479 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b826b29-7d77-45c4-b660-c2e2d7eda035 admin admin] PATH_INFO: `/v3/users/e5baecad7d934fc986057c8e351a42e4` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:05.116621 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b826b29-7d77-45c4-b660-c2e2d7eda035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5baecad7d934fc986057c8e351a42e4)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:05.118614 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b826b29-7d77-45c4-b660-c2e2d7eda035 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:05.170819 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2b826b29-7d77-45c4-b660-c2e2d7eda035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5baecad7d934fc986057c8e351a42e4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:05.174279 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:05.179623 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2b826b29-7d77-45c4-b660-c2e2d7eda035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5baecad7d934fc986057c8e351a42e4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:05.180512 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2b826b29-7d77-45c4-b660-c2e2d7eda035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5baecad7d934fc986057c8e351a42e4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:05.194029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2b826b29-7d77-45c4-b660-c2e2d7eda035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5baecad7d934fc986057c8e351a42e4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:05.205498 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2b826b29-7d77-45c4-b660-c2e2d7eda035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5baecad7d934fc986057c8e351a42e4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:05.220794 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1309/2630] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:29:05 2022] DELETE /identity/v3/users/e5baecad7d934fc986057c8e351a42e4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:29:05.225419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482dc8e7-3bdd-4de9-884d-7676e8a3f65e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:05.225944 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482dc8e7-3bdd-4de9-884d-7676e8a3f65e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:05.226052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482dc8e7-3bdd-4de9-884d-7676e8a3f65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:05.245684 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-482dc8e7-3bdd-4de9-884d-7676e8a3f65e None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:05.247012 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-482dc8e7-3bdd-4de9-884d-7676e8a3f65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:05.290589 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:05.316641 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1322/2631] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:05.326817 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b826b29-7d77-45c4-b660-c2e2d7eda035 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:05.328225 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2b826b29-7d77-45c4-b660-c2e2d7eda035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:05.394583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b826b29-7d77-45c4-b660-c2e2d7eda035 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:05.399757 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18cd34-1927-48a7-8547-24b4194691b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:05.400685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18cd34-1927-48a7-8547-24b4194691b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:05.400967 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18cd34-1927-48a7-8547-24b4194691b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:05.401240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18cd34-1927-48a7-8547-24b4194691b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:05.413401 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18cd34-1927-48a7-8547-24b4194691b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:05.414902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18cd34-1927-48a7-8547-24b4194691b6 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:05.425985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1310/2632] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:29:05.723033 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482dc8e7-3bdd-4de9-884d-7676e8a3f65e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:05.724481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-482dc8e7-3bdd-4de9-884d-7676e8a3f65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:05.737885 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482dc8e7-3bdd-4de9-884d-7676e8a3f65e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:05.743940 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90256316-3db3-4b23-9716-4a5744a74d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:05.745104 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90256316-3db3-4b23-9716-4a5744a74d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:05.745248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90256316-3db3-4b23-9716-4a5744a74d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:05.745523 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90256316-3db3-4b23-9716-4a5744a74d69 admin admin] PATH_INFO: `/v3/projects/7dab6e5d62834917967b67a20007855b` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:05.746699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90256316-3db3-4b23-9716-4a5744a74d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dab6e5d62834917967b67a20007855b)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:05.748901 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90256316-3db3-4b23-9716-4a5744a74d69 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:05.798019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-90256316-3db3-4b23-9716-4a5744a74d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dab6e5d62834917967b67a20007855b', 'request_id': 'req-90256316-3db3-4b23-9716-4a5744a74d69'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:05.804546 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-90256316-3db3-4b23-9716-4a5744a74d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dab6e5d62834917967b67a20007855b', 'request_id': 'req-90256316-3db3-4b23-9716-4a5744a74d69'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:05.812440 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-90256316-3db3-4b23-9716-4a5744a74d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dab6e5d62834917967b67a20007855b', 'request_id': 'req-90256316-3db3-4b23-9716-4a5744a74d69'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:05.825320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-90256316-3db3-4b23-9716-4a5744a74d69 admin admin] The token cache is being invalidate because project 7dab6e5d62834917967b67a20007855b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:29:05.825612 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-90256316-3db3-4b23-9716-4a5744a74d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:05.826263 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-90256316-3db3-4b23-9716-4a5744a74d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:05.827800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1323/2633] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:29:05 2022] DELETE /identity/v3/projects/7dab6e5d62834917967b67a20007855b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:05.833147 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a06fa3-42c4-48c7-ae79-ba3628bd9a09 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:05.833666 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a06fa3-42c4-48c7-ae79-ba3628bd9a09 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:05.833797 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a06fa3-42c4-48c7-ae79-ba3628bd9a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:05.854878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-28a06fa3-42c4-48c7-ae79-ba3628bd9a09 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:05.856152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-28a06fa3-42c4-48c7-ae79-ba3628bd9a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:05.916336 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1311/2634] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:05.925867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b0e8e-3003-48e4-9992-fdd265774fd1 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:05.926176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b0e8e-3003-48e4-9992-fdd265774fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:05.926456 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b0e8e-3003-48e4-9992-fdd265774fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:05.947239 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1e6b0e8e-3003-48e4-9992-fdd265774fd1 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:05.948430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1e6b0e8e-3003-48e4-9992-fdd265774fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:05.956816 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1324/2635] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:05.961218 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a06fa3-42c4-48c7-ae79-ba3628bd9a09 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:05.971171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a06fa3-42c4-48c7-ae79-ba3628bd9a09 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:05.975746 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be90d-0686-4a7b-a543-2ad88546816b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:05.976352 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be90d-0686-4a7b-a543-2ad88546816b admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:05.976638 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be90d-0686-4a7b-a543-2ad88546816b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:05.976917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be90d-0686-4a7b-a543-2ad88546816b admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:05.977572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be90d-0686-4a7b-a543-2ad88546816b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:29:05.977878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be90d-0686-4a7b-a543-2ad88546816b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:05.979532 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be90d-0686-4a7b-a543-2ad88546816b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:05.991495 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1312/2636] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:29:05.995976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b0e8e-3003-48e4-9992-fdd265774fd1 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:06.005749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b0e8e-3003-48e4-9992-fdd265774fd1 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:06.010416 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bc88c-d291-4167-8b02-44b6bd53ca7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:06.011037 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bc88c-d291-4167-8b02-44b6bd53ca7e admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:06.011314 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bc88c-d291-4167-8b02-44b6bd53ca7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:06.011666 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bc88c-d291-4167-8b02-44b6bd53ca7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:06.012870 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bc88c-d291-4167-8b02-44b6bd53ca7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:06.014778 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bc88c-d291-4167-8b02-44b6bd53ca7e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:06.042751 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1325/2637] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:29:05 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:29:06.048106 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be90d-0686-4a7b-a543-2ad88546816b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:06.059878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be90d-0686-4a7b-a543-2ad88546816b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:06.111482 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:06.124613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebee110-12e9-44ee-889a-857fd2541acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:06.125292 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebee110-12e9-44ee-889a-857fd2541acd admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:06.125647 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebee110-12e9-44ee-889a-857fd2541acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:06.125990 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebee110-12e9-44ee-889a-857fd2541acd admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:06.126805 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebee110-12e9-44ee-889a-857fd2541acd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:06.129099 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebee110-12e9-44ee-889a-857fd2541acd admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:06.153500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1313/2638] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:29:06 2022] POST /identity/v3/users => generated 282 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:29:06.157839 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bc88c-d291-4167-8b02-44b6bd53ca7e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:06.168402 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bc88c-d291-4167-8b02-44b6bd53ca7e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:06.173065 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23cac8-1625-4354-84c9-7ba2c41412e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:06.173665 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23cac8-1625-4354-84c9-7ba2c41412e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:06.173953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23cac8-1625-4354-84c9-7ba2c41412e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:06.174226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23cac8-1625-4354-84c9-7ba2c41412e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:06.174910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23cac8-1625-4354-84c9-7ba2c41412e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:06.176478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23cac8-1625-4354-84c9-7ba2c41412e0 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:06.186916 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1326/2639] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:29:06.192006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebee110-12e9-44ee-889a-857fd2541acd admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:06.203613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebee110-12e9-44ee-889a-857fd2541acd admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:06.209411 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f85e8d-cc8c-4a48-84b2-2860fadb3ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:06.210179 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85e8d-cc8c-4a48-84b2-2860fadb3ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:06.210540 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85e8d-cc8c-4a48-84b2-2860fadb3ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:06.210965 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85e8d-cc8c-4a48-84b2-2860fadb3ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:06.211837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f85e8d-cc8c-4a48-84b2-2860fadb3ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:06.213666 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f85e8d-cc8c-4a48-84b2-2860fadb3ac0 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:06.227489 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1314/2640] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:29:06.232188 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23cac8-1625-4354-84c9-7ba2c41412e0 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:06.242806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23cac8-1625-4354-84c9-7ba2c41412e0 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:06.248087 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ab9d4-7efb-4610-b3d5-a75dc6bed1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:06.248737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ab9d4-7efb-4610-b3d5-a75dc6bed1c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:06.249020 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ab9d4-7efb-4610-b3d5-a75dc6bed1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:06.249300 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ab9d4-7efb-4610-b3d5-a75dc6bed1c2 admin admin] PATH_INFO: `/v3/projects/450fc24a39ae466a9fa66178dc0c3dfc/users/64b65f90886c44ffa4428175a688a49d/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:06.264549 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ab9d4-7efb-4610-b3d5-a75dc6bed1c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=450fc24a39ae466a9fa66178dc0c3dfc, user_id=64b65f90886c44ffa4428175a688a49d, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:06.267259 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ab9d4-7efb-4610-b3d5-a75dc6bed1c2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:06.281429 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1327/2641] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:29:06 2022] PUT /identity/v3/projects/450fc24a39ae466a9fa66178dc0c3dfc/users/64b65f90886c44ffa4428175a688a49d/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:29:06.291855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168db92b-4758-4289-8510-de6a91598ab3 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:06.292152 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168db92b-4758-4289-8510-de6a91598ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:06.292457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168db92b-4758-4289-8510-de6a91598ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:06.321849 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-168db92b-4758-4289-8510-de6a91598ab3 None None] MFA Rules not processed for user `64b65f90886c44ffa4428175a688a49d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:06.323098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-168db92b-4758-4289-8510-de6a91598ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:06.387482 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1315/2642] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:06.392390 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ab9d4-7efb-4610-b3d5-a75dc6bed1c2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:06.459398 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ab9d4-7efb-4610-b3d5-a75dc6bed1c2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:06.464066 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45db8c-7799-4668-b612-9cf5ad8b5593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:06.464666 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45db8c-7799-4668-b612-9cf5ad8b5593 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:06.464947 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45db8c-7799-4668-b612-9cf5ad8b5593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:06.465254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45db8c-7799-4668-b612-9cf5ad8b5593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:06.465887 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45db8c-7799-4668-b612-9cf5ad8b5593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:06.467829 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45db8c-7799-4668-b612-9cf5ad8b5593 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:06.473085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:06.499321 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1328/2643] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:29:06 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:29:06.503398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168db92b-4758-4289-8510-de6a91598ab3 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:06.514454 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168db92b-4758-4289-8510-de6a91598ab3 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:06.572107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb56a83-1a60-4315-862b-6ef5c7c19736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:06.572755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb56a83-1a60-4315-862b-6ef5c7c19736 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:06.573042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb56a83-1a60-4315-862b-6ef5c7c19736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:06.573362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb56a83-1a60-4315-862b-6ef5c7c19736 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:06.574047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb56a83-1a60-4315-862b-6ef5c7c19736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:06.576229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb56a83-1a60-4315-862b-6ef5c7c19736 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:06.597748 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1316/2644] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:29:06 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:29:06.601765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45db8c-7799-4668-b612-9cf5ad8b5593 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:06.612685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45db8c-7799-4668-b612-9cf5ad8b5593 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:06.617532 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f9416-5d8d-45df-9012-c1e66b82cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:06.618128 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f9416-5d8d-45df-9012-c1e66b82cb4a admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:06.618410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f9416-5d8d-45df-9012-c1e66b82cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:06.618687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f9416-5d8d-45df-9012-c1e66b82cb4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:06.619358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f9416-5d8d-45df-9012-c1e66b82cb4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:06.620954 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f9416-5d8d-45df-9012-c1e66b82cb4a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:06.630850 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1329/2645] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:29:06.635098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb56a83-1a60-4315-862b-6ef5c7c19736 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:06.645076 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb56a83-1a60-4315-862b-6ef5c7c19736 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:06.649922 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4e496-c577-4326-bbde-4a828d464859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:06.650584 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4e496-c577-4326-bbde-4a828d464859 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:06.650905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4e496-c577-4326-bbde-4a828d464859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:06.651186 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4e496-c577-4326-bbde-4a828d464859 admin admin] PATH_INFO: `/v3/projects/cfab7ece224e4590b63c7e86c2535eb8/users/8dc6feff3e5842df82a47f06b6b5783e/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:06.666370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4e496-c577-4326-bbde-4a828d464859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfab7ece224e4590b63c7e86c2535eb8, user_id=8dc6feff3e5842df82a47f06b6b5783e, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:06.669690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4e496-c577-4326-bbde-4a828d464859 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:06.683587 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1317/2646] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:29:06 2022] PUT /identity/v3/projects/cfab7ece224e4590b63c7e86c2535eb8/users/8dc6feff3e5842df82a47f06b6b5783e/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:29:06.687553 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f9416-5d8d-45df-9012-c1e66b82cb4a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:06.697886 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f9416-5d8d-45df-9012-c1e66b82cb4a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:06.754435 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f6b0f-eb56-4f4e-a3bf-d7aff2707748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:06.754983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f6b0f-eb56-4f4e-a3bf-d7aff2707748 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:06.755264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f6b0f-eb56-4f4e-a3bf-d7aff2707748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:06.755536 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f6b0f-eb56-4f4e-a3bf-d7aff2707748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:06.756170 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f6b0f-eb56-4f4e-a3bf-d7aff2707748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:06.757766 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f6b0f-eb56-4f4e-a3bf-d7aff2707748 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:06.767393 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1330/2647] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:29:06.771746 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4e496-c577-4326-bbde-4a828d464859 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:06.782644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4e496-c577-4326-bbde-4a828d464859 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:06.787343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c3a71-5cd4-4e18-ad29-b28b2b11aea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:06.787994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c3a71-5cd4-4e18-ad29-b28b2b11aea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:06.788281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c3a71-5cd4-4e18-ad29-b28b2b11aea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:06.788560 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c3a71-5cd4-4e18-ad29-b28b2b11aea0 admin admin] PATH_INFO: `/v3/projects/cfab7ece224e4590b63c7e86c2535eb8/users/8dc6feff3e5842df82a47f06b6b5783e/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:06.790491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c3a71-5cd4-4e18-ad29-b28b2b11aea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfab7ece224e4590b63c7e86c2535eb8, user_id=8dc6feff3e5842df82a47f06b6b5783e, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:06.793813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c3a71-5cd4-4e18-ad29-b28b2b11aea0 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:06.804371 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1318/2648] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:29:06 2022] PUT /identity/v3/projects/cfab7ece224e4590b63c7e86c2535eb8/users/8dc6feff3e5842df82a47f06b6b5783e/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:06.814569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1e215-a535-4953-b222-c0278e220437 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:06.814898 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1e215-a535-4953-b222-c0278e220437 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:06.815176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1e215-a535-4953-b222-c0278e220437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:06.847582 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-cec1e215-a535-4953-b222-c0278e220437 None None] MFA Rules not processed for user `8dc6feff3e5842df82a47f06b6b5783e`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:06.848960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-cec1e215-a535-4953-b222-c0278e220437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:06.921136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1331/2649] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:06.933228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c3a71-5cd4-4e18-ad29-b28b2b11aea0 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:06.934998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d93c3a71-5cd4-4e18-ad29-b28b2b11aea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:06.953249 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:07.016607 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c3a71-5cd4-4e18-ad29-b28b2b11aea0 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:07.020306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291ca11-e5da-4470-96d5-fe566e56840e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:07.020910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291ca11-e5da-4470-96d5-fe566e56840e service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:07.021194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291ca11-e5da-4470-96d5-fe566e56840e service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:07.021494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291ca11-e5da-4470-96d5-fe566e56840e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:07.031081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291ca11-e5da-4470-96d5-fe566e56840e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:07.032531 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291ca11-e5da-4470-96d5-fe566e56840e service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:07.041994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1319/2650] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:29:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:29:07.460276 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1e215-a535-4953-b222-c0278e220437 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:07.520068 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:07.525804 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1e215-a535-4953-b222-c0278e220437 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:07.531207 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f5012-ebe2-42ac-ad6d-d5480a5832a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:07.531850 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f5012-ebe2-42ac-ad6d-d5480a5832a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:07.532165 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f5012-ebe2-42ac-ad6d-d5480a5832a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:07.532445 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f5012-ebe2-42ac-ad6d-d5480a5832a4 admin admin] PATH_INFO: `/v3/users/64b65f90886c44ffa4428175a688a49d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:07.533594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f5012-ebe2-42ac-ad6d-d5480a5832a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b65f90886c44ffa4428175a688a49d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:07.535605 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f5012-ebe2-42ac-ad6d-d5480a5832a4 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:07.588078 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-208f5012-ebe2-42ac-ad6d-d5480a5832a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b65f90886c44ffa4428175a688a49d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:07.601816 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-208f5012-ebe2-42ac-ad6d-d5480a5832a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b65f90886c44ffa4428175a688a49d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:07.614360 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-208f5012-ebe2-42ac-ad6d-d5480a5832a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b65f90886c44ffa4428175a688a49d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:07.615107 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-208f5012-ebe2-42ac-ad6d-d5480a5832a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b65f90886c44ffa4428175a688a49d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:07.623738 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-208f5012-ebe2-42ac-ad6d-d5480a5832a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b65f90886c44ffa4428175a688a49d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:07.629849 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1332/2651] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:29:07 2022] DELETE /identity/v3/users/64b65f90886c44ffa4428175a688a49d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:29:07.634422 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb2385-9658-48c6-9f1b-3d98c0e5ac02 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:07.634746 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb2385-9658-48c6-9f1b-3d98c0e5ac02 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:07.635019 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb2385-9658-48c6-9f1b-3d98c0e5ac02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:07.654467 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-6abb2385-9658-48c6-9f1b-3d98c0e5ac02 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:07.655795 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6abb2385-9658-48c6-9f1b-3d98c0e5ac02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:07.718053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1320/2652] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:29:07.728330 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f5012-ebe2-42ac-ad6d-d5480a5832a4 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:07.729825 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-208f5012-ebe2-42ac-ad6d-d5480a5832a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:07.804917 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f5012-ebe2-42ac-ad6d-d5480a5832a4 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:07.808638 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8db6cb-a59f-466a-bd8d-b3194e92a2cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:07.809897 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8db6cb-a59f-466a-bd8d-b3194e92a2cd service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:07.810251 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8db6cb-a59f-466a-bd8d-b3194e92a2cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:07.810491 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8db6cb-a59f-466a-bd8d-b3194e92a2cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:07.819855 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8db6cb-a59f-466a-bd8d-b3194e92a2cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:07.821403 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8db6cb-a59f-466a-bd8d-b3194e92a2cd service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:07.831391 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1333/2653] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:29:08.110856 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb2385-9658-48c6-9f1b-3d98c0e5ac02 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:08.112406 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6abb2385-9658-48c6-9f1b-3d98c0e5ac02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:08.126654 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb2385-9658-48c6-9f1b-3d98c0e5ac02 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:08.131490 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab996a5a-72a0-4cfa-970a-b7ea610715b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:08.132129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab996a5a-72a0-4cfa-970a-b7ea610715b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:08.132409 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab996a5a-72a0-4cfa-970a-b7ea610715b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:08.132684 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab996a5a-72a0-4cfa-970a-b7ea610715b1 admin admin] PATH_INFO: `/v3/projects/450fc24a39ae466a9fa66178dc0c3dfc` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:08.133956 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab996a5a-72a0-4cfa-970a-b7ea610715b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=450fc24a39ae466a9fa66178dc0c3dfc)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:08.135771 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab996a5a-72a0-4cfa-970a-b7ea610715b1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:08.187040 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ab996a5a-72a0-4cfa-970a-b7ea610715b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '450fc24a39ae466a9fa66178dc0c3dfc', 'request_id': 'req-ab996a5a-72a0-4cfa-970a-b7ea610715b1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:08.193906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ab996a5a-72a0-4cfa-970a-b7ea610715b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '450fc24a39ae466a9fa66178dc0c3dfc', 'request_id': 'req-ab996a5a-72a0-4cfa-970a-b7ea610715b1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:08.201331 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ab996a5a-72a0-4cfa-970a-b7ea610715b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '450fc24a39ae466a9fa66178dc0c3dfc', 'request_id': 'req-ab996a5a-72a0-4cfa-970a-b7ea610715b1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:08.213647 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ab996a5a-72a0-4cfa-970a-b7ea610715b1 admin admin] The token cache is being invalidate because project 450fc24a39ae466a9fa66178dc0c3dfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:29:08.213993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ab996a5a-72a0-4cfa-970a-b7ea610715b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:08.214613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ab996a5a-72a0-4cfa-970a-b7ea610715b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:08.216705 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1321/2654] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:29:08 2022] DELETE /identity/v3/projects/450fc24a39ae466a9fa66178dc0c3dfc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:08.220909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8db6cb-a59f-466a-bd8d-b3194e92a2cd service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:08.232068 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8db6cb-a59f-466a-bd8d-b3194e92a2cd service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:08.294223 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a7c7d-c5fc-469c-a834-22864bfdd0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:08.294895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a7c7d-c5fc-469c-a834-22864bfdd0db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:08.295181 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a7c7d-c5fc-469c-a834-22864bfdd0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:08.295459 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a7c7d-c5fc-469c-a834-22864bfdd0db admin admin] PATH_INFO: `/v3/users/8dc6feff3e5842df82a47f06b6b5783e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:08.296586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a7c7d-c5fc-469c-a834-22864bfdd0db admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dc6feff3e5842df82a47f06b6b5783e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:08.298526 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a7c7d-c5fc-469c-a834-22864bfdd0db admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:08.319669 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:08.350159 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f23a7c7d-c5fc-469c-a834-22864bfdd0db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dc6feff3e5842df82a47f06b6b5783e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:08.358161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f23a7c7d-c5fc-469c-a834-22864bfdd0db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dc6feff3e5842df82a47f06b6b5783e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:08.370262 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f23a7c7d-c5fc-469c-a834-22864bfdd0db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dc6feff3e5842df82a47f06b6b5783e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:08.371062 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f23a7c7d-c5fc-469c-a834-22864bfdd0db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dc6feff3e5842df82a47f06b6b5783e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:08.379053 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f23a7c7d-c5fc-469c-a834-22864bfdd0db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dc6feff3e5842df82a47f06b6b5783e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:08.385279 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1334/2655] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:29:08 2022] DELETE /identity/v3/users/8dc6feff3e5842df82a47f06b6b5783e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:08.672737 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab996a5a-72a0-4cfa-970a-b7ea610715b1 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:08.674205 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ab996a5a-72a0-4cfa-970a-b7ea610715b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:08.689044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab996a5a-72a0-4cfa-970a-b7ea610715b1 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:08.713739 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:08.774876 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1045e3-4ded-44b4-bafc-3e51d4326ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:08.775589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1045e3-4ded-44b4-bafc-3e51d4326ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:08.775879 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1045e3-4ded-44b4-bafc-3e51d4326ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:08.776173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1045e3-4ded-44b4-bafc-3e51d4326ab7 admin admin] PATH_INFO: `/v3/projects/cfab7ece224e4590b63c7e86c2535eb8` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:08.777341 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1045e3-4ded-44b4-bafc-3e51d4326ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfab7ece224e4590b63c7e86c2535eb8)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:08.779962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1045e3-4ded-44b4-bafc-3e51d4326ab7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:08.833356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3a1045e3-4ded-44b4-bafc-3e51d4326ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfab7ece224e4590b63c7e86c2535eb8', 'request_id': 'req-3a1045e3-4ded-44b4-bafc-3e51d4326ab7'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:08.840727 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3a1045e3-4ded-44b4-bafc-3e51d4326ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfab7ece224e4590b63c7e86c2535eb8', 'request_id': 'req-3a1045e3-4ded-44b4-bafc-3e51d4326ab7'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:08.848731 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3a1045e3-4ded-44b4-bafc-3e51d4326ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfab7ece224e4590b63c7e86c2535eb8', 'request_id': 'req-3a1045e3-4ded-44b4-bafc-3e51d4326ab7'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:08.862349 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3a1045e3-4ded-44b4-bafc-3e51d4326ab7 admin admin] The token cache is being invalidate because project cfab7ece224e4590b63c7e86c2535eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:29:08.862644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3a1045e3-4ded-44b4-bafc-3e51d4326ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:08.863902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3a1045e3-4ded-44b4-bafc-3e51d4326ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:08.865535 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1322/2656] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:29:08 2022] DELETE /identity/v3/projects/cfab7ece224e4590b63c7e86c2535eb8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:08.870649 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eb697-e812-4160-bfc6-f4e7c2fcb6cb None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:08.871671 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eb697-e812-4160-bfc6-f4e7c2fcb6cb None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:08.871793 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eb697-e812-4160-bfc6-f4e7c2fcb6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:08.898176 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f54eb697-e812-4160-bfc6-f4e7c2fcb6cb None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:08.899452 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f54eb697-e812-4160-bfc6-f4e7c2fcb6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:08.962681 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1335/2657] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:08.971979 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5be06-3bb4-4920-a336-acfbae5ec0f0 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:08.972266 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5be06-3bb4-4920-a336-acfbae5ec0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:08.972543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5be06-3bb4-4920-a336-acfbae5ec0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:08.992292 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c8d5be06-3bb4-4920-a336-acfbae5ec0f0 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:08.993489 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c8d5be06-3bb4-4920-a336-acfbae5ec0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:09.001750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1323/2658] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:09.006115 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eb697-e812-4160-bfc6-f4e7c2fcb6cb None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:09.016746 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eb697-e812-4160-bfc6-f4e7c2fcb6cb None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:09.021275 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853137e-7887-4c09-850b-4d7ced4ad62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:09.021858 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853137e-7887-4c09-850b-4d7ced4ad62c admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:09.022135 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853137e-7887-4c09-850b-4d7ced4ad62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:09.022406 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853137e-7887-4c09-850b-4d7ced4ad62c admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:09.023088 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853137e-7887-4c09-850b-4d7ced4ad62c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:29:09.023389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853137e-7887-4c09-850b-4d7ced4ad62c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:09.024988 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853137e-7887-4c09-850b-4d7ced4ad62c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:09.036613 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1336/2659] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:29:09.040889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5be06-3bb4-4920-a336-acfbae5ec0f0 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:09.050680 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5be06-3bb4-4920-a336-acfbae5ec0f0 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:09.055766 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd480d51-e188-44ca-8a6c-5e8e0b50175f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:09.056371 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd480d51-e188-44ca-8a6c-5e8e0b50175f admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:09.056653 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd480d51-e188-44ca-8a6c-5e8e0b50175f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:09.057043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd480d51-e188-44ca-8a6c-5e8e0b50175f admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:09.058239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd480d51-e188-44ca-8a6c-5e8e0b50175f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:09.062298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd480d51-e188-44ca-8a6c-5e8e0b50175f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:09.093308 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1324/2660] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:29:09 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:29:09.097469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853137e-7887-4c09-850b-4d7ced4ad62c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:09.107474 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853137e-7887-4c09-850b-4d7ced4ad62c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:09.168593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a045226-f2e9-4816-91ce-f12c2eb02676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:09.169212 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a045226-f2e9-4816-91ce-f12c2eb02676 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:09.169618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a045226-f2e9-4816-91ce-f12c2eb02676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:09.169837 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a045226-f2e9-4816-91ce-f12c2eb02676 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:09.170495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a045226-f2e9-4816-91ce-f12c2eb02676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:09.172543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a045226-f2e9-4816-91ce-f12c2eb02676 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:09.198284 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1337/2661] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:29:09 2022] POST /identity/v3/users => generated 282 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:29:09.203380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd480d51-e188-44ca-8a6c-5e8e0b50175f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:09.216119 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd480d51-e188-44ca-8a6c-5e8e0b50175f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:09.223011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c26505-9b98-42fb-8099-c57ab33aa802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:09.223646 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c26505-9b98-42fb-8099-c57ab33aa802 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:09.223999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c26505-9b98-42fb-8099-c57ab33aa802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:09.224283 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c26505-9b98-42fb-8099-c57ab33aa802 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:09.224941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c26505-9b98-42fb-8099-c57ab33aa802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:09.226986 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c26505-9b98-42fb-8099-c57ab33aa802 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:09.239186 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1325/2662] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:29:09.243555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a045226-f2e9-4816-91ce-f12c2eb02676 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:09.254199 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a045226-f2e9-4816-91ce-f12c2eb02676 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:09.258840 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c15b7-7bb3-4437-b51f-fefe2244e07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:09.259434 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c15b7-7bb3-4437-b51f-fefe2244e07b admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:09.259717 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c15b7-7bb3-4437-b51f-fefe2244e07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:09.259993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c15b7-7bb3-4437-b51f-fefe2244e07b admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:09.260629 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c15b7-7bb3-4437-b51f-fefe2244e07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:09.262236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c15b7-7bb3-4437-b51f-fefe2244e07b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:09.272882 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1338/2663] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:29:09.277535 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c26505-9b98-42fb-8099-c57ab33aa802 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:09.290593 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c26505-9b98-42fb-8099-c57ab33aa802 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:09.297047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523b252-bcb7-43ef-a9d8-6ba1a86bcc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:09.297810 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523b252-bcb7-43ef-a9d8-6ba1a86bcc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:09.298366 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523b252-bcb7-43ef-a9d8-6ba1a86bcc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:09.298690 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523b252-bcb7-43ef-a9d8-6ba1a86bcc1e admin admin] PATH_INFO: `/v3/projects/50c4472d99ac4f76b5b8e218c6ac8204/users/f83aa96d91b04a49b18bca1e3d854bb7/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:09.314450 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523b252-bcb7-43ef-a9d8-6ba1a86bcc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c4472d99ac4f76b5b8e218c6ac8204, user_id=f83aa96d91b04a49b18bca1e3d854bb7, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:09.317126 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523b252-bcb7-43ef-a9d8-6ba1a86bcc1e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:09.330067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1326/2664] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:29:09 2022] PUT /identity/v3/projects/50c4472d99ac4f76b5b8e218c6ac8204/users/f83aa96d91b04a49b18bca1e3d854bb7/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:09.340713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30f4a3-3ddf-4246-af11-71d6b20e02fa None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:09.341004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30f4a3-3ddf-4246-af11-71d6b20e02fa None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:09.341279 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30f4a3-3ddf-4246-af11-71d6b20e02fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:09.349372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:09.370797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-cf30f4a3-3ddf-4246-af11-71d6b20e02fa None None] MFA Rules not processed for user `f83aa96d91b04a49b18bca1e3d854bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:09.372643 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-cf30f4a3-3ddf-4246-af11-71d6b20e02fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:09.448668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1339/2665] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:09.453191 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523b252-bcb7-43ef-a9d8-6ba1a86bcc1e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:09.505852 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:09.521621 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523b252-bcb7-43ef-a9d8-6ba1a86bcc1e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:09.526757 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc6260-b2ea-4c27-a36f-bab55da5dcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:09.527371 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc6260-b2ea-4c27-a36f-bab55da5dcd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:09.527681 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc6260-b2ea-4c27-a36f-bab55da5dcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:09.527958 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc6260-b2ea-4c27-a36f-bab55da5dcd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:09.528664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc6260-b2ea-4c27-a36f-bab55da5dcd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:09.530600 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc6260-b2ea-4c27-a36f-bab55da5dcd4 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:09.561013 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1327/2666] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:29:09 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:29:09.565419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30f4a3-3ddf-4246-af11-71d6b20e02fa None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:09.577029 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30f4a3-3ddf-4246-af11-71d6b20e02fa None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:09.637307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d0c99-6f7f-4178-b5b2-f52cbb710cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:09.637921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d0c99-6f7f-4178-b5b2-f52cbb710cfb admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:09.638210 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d0c99-6f7f-4178-b5b2-f52cbb710cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:09.638484 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d0c99-6f7f-4178-b5b2-f52cbb710cfb admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:09.639158 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d0c99-6f7f-4178-b5b2-f52cbb710cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:09.641088 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d0c99-6f7f-4178-b5b2-f52cbb710cfb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:09.662226 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1340/2667] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:29:09 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:29:09.666401 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc6260-b2ea-4c27-a36f-bab55da5dcd4 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:09.677311 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc6260-b2ea-4c27-a36f-bab55da5dcd4 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:09.681908 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e7558-b345-4a26-9de0-fc6cd32ac822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:09.682511 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e7558-b345-4a26-9de0-fc6cd32ac822 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:09.682837 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e7558-b345-4a26-9de0-fc6cd32ac822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:09.683119 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e7558-b345-4a26-9de0-fc6cd32ac822 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:09.683805 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e7558-b345-4a26-9de0-fc6cd32ac822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:09.685412 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e7558-b345-4a26-9de0-fc6cd32ac822 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:09.696321 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1328/2668] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:29:09.700831 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d0c99-6f7f-4178-b5b2-f52cbb710cfb admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:09.712254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d0c99-6f7f-4178-b5b2-f52cbb710cfb admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:09.717634 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d63ff-6d0c-4ed7-b5ad-dbf7e0a46200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:09.718296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d63ff-6d0c-4ed7-b5ad-dbf7e0a46200 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:09.718578 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d63ff-6d0c-4ed7-b5ad-dbf7e0a46200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:09.718910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d63ff-6d0c-4ed7-b5ad-dbf7e0a46200 admin admin] PATH_INFO: `/v3/projects/d64c59fbce9149b69bed5c13dc6e5ffe/users/405956e0cc4a4e42a1134f7afd066b78/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:09.734948 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d63ff-6d0c-4ed7-b5ad-dbf7e0a46200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64c59fbce9149b69bed5c13dc6e5ffe, user_id=405956e0cc4a4e42a1134f7afd066b78, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:09.737613 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d63ff-6d0c-4ed7-b5ad-dbf7e0a46200 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:09.752648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1341/2669] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:29:09 2022] PUT /identity/v3/projects/d64c59fbce9149b69bed5c13dc6e5ffe/users/405956e0cc4a4e42a1134f7afd066b78/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:09.756822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e7558-b345-4a26-9de0-fc6cd32ac822 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:09.767717 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e7558-b345-4a26-9de0-fc6cd32ac822 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:09.823126 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036eee1-2715-4990-adc3-c7986ed86257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:09.823730 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036eee1-2715-4990-adc3-c7986ed86257 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:09.824026 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036eee1-2715-4990-adc3-c7986ed86257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:09.824309 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036eee1-2715-4990-adc3-c7986ed86257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:09.824953 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036eee1-2715-4990-adc3-c7986ed86257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:09.826631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036eee1-2715-4990-adc3-c7986ed86257 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:09.836691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1329/2670] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:29:09.841375 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d63ff-6d0c-4ed7-b5ad-dbf7e0a46200 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:09.851931 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d63ff-6d0c-4ed7-b5ad-dbf7e0a46200 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:09.857164 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78360e57-880c-4d86-b329-24d22744c7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:09.857812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78360e57-880c-4d86-b329-24d22744c7f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:09.858088 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78360e57-880c-4d86-b329-24d22744c7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:09.858358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78360e57-880c-4d86-b329-24d22744c7f1 admin admin] PATH_INFO: `/v3/projects/d64c59fbce9149b69bed5c13dc6e5ffe/users/405956e0cc4a4e42a1134f7afd066b78/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:09.860297 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78360e57-880c-4d86-b329-24d22744c7f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64c59fbce9149b69bed5c13dc6e5ffe, user_id=405956e0cc4a4e42a1134f7afd066b78, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:09.862981 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78360e57-880c-4d86-b329-24d22744c7f1 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:09.874491 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1342/2671] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:29:09 2022] PUT /identity/v3/projects/d64c59fbce9149b69bed5c13dc6e5ffe/users/405956e0cc4a4e42a1134f7afd066b78/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:09.884660 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ab276-cb7a-4f73-a14a-2b42670967b9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:09.884980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ab276-cb7a-4f73-a14a-2b42670967b9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:09.885264 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ab276-cb7a-4f73-a14a-2b42670967b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:09.914300 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-165ab276-cb7a-4f73-a14a-2b42670967b9 None None] MFA Rules not processed for user `405956e0cc4a4e42a1134f7afd066b78`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:09.915564 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-165ab276-cb7a-4f73-a14a-2b42670967b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:09.984788 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1330/2672] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:09.996298 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78360e57-880c-4d86-b329-24d22744c7f1 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:09.998138 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-78360e57-880c-4d86-b329-24d22744c7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:10.053557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:10.059778 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78360e57-880c-4d86-b329-24d22744c7f1 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:10.063774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d00db-8f37-4ce1-b15c-e50ad1a4f8c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:10.064376 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d00db-8f37-4ce1-b15c-e50ad1a4f8c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:10.064678 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d00db-8f37-4ce1-b15c-e50ad1a4f8c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:10.064948 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d00db-8f37-4ce1-b15c-e50ad1a4f8c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:10.074163 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d00db-8f37-4ce1-b15c-e50ad1a4f8c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:10.076227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d00db-8f37-4ce1-b15c-e50ad1a4f8c3 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:10.085793 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1343/2673] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:29:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:29:10.164737 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ab276-cb7a-4f73-a14a-2b42670967b9 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:10.174496 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ab276-cb7a-4f73-a14a-2b42670967b9 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:10.178089 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487634e-eda2-4637-b408-ca9c1b1d9931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:10.178691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487634e-eda2-4637-b408-ca9c1b1d9931 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:10.179007 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487634e-eda2-4637-b408-ca9c1b1d9931 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:10.179286 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487634e-eda2-4637-b408-ca9c1b1d9931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:10.220994 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:10.239344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487634e-eda2-4637-b408-ca9c1b1d9931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:10.240719 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487634e-eda2-4637-b408-ca9c1b1d9931 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:10.249896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1331/2674] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:29:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:29:17.329119 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d00db-8f37-4ce1-b15c-e50ad1a4f8c3 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:17.389762 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d00db-8f37-4ce1-b15c-e50ad1a4f8c3 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:17.394223 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1e7ab-e132-454c-bb88-ed869021b5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:17.395380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1e7ab-e132-454c-bb88-ed869021b5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:17.395380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1e7ab-e132-454c-bb88-ed869021b5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:17.395619 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1e7ab-e132-454c-bb88-ed869021b5da admin admin] PATH_INFO: `/v3/users/f83aa96d91b04a49b18bca1e3d854bb7` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:17.396575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1e7ab-e132-454c-bb88-ed869021b5da admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83aa96d91b04a49b18bca1e3d854bb7)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:17.398480 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1e7ab-e132-454c-bb88-ed869021b5da admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:17.444733 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d6a1e7ab-e132-454c-bb88-ed869021b5da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83aa96d91b04a49b18bca1e3d854bb7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:17.452319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d6a1e7ab-e132-454c-bb88-ed869021b5da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83aa96d91b04a49b18bca1e3d854bb7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:17.463867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d6a1e7ab-e132-454c-bb88-ed869021b5da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83aa96d91b04a49b18bca1e3d854bb7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:17.464538 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d6a1e7ab-e132-454c-bb88-ed869021b5da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83aa96d91b04a49b18bca1e3d854bb7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:17.471546 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d6a1e7ab-e132-454c-bb88-ed869021b5da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83aa96d91b04a49b18bca1e3d854bb7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:17.477281 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1344/2675] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:29:17 2022] DELETE /identity/v3/users/f83aa96d91b04a49b18bca1e3d854bb7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:17.482278 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f572ae-3114-4388-8370-0ca57f73f5d8 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:17.482794 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f572ae-3114-4388-8370-0ca57f73f5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:17.482903 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f572ae-3114-4388-8370-0ca57f73f5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:17.502392 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d5f572ae-3114-4388-8370-0ca57f73f5d8 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:17.503634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d5f572ae-3114-4388-8370-0ca57f73f5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:17.560652 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1332/2676] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:17.570211 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1e7ab-e132-454c-bb88-ed869021b5da admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:17.571881 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d6a1e7ab-e132-454c-bb88-ed869021b5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:17.628602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1e7ab-e132-454c-bb88-ed869021b5da admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:17.632254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d99cf0-409d-4a54-b595-c039c90fa4f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:17.632856 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d99cf0-409d-4a54-b595-c039c90fa4f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:17.633136 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d99cf0-409d-4a54-b595-c039c90fa4f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:17.633411 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d99cf0-409d-4a54-b595-c039c90fa4f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:17.642876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d99cf0-409d-4a54-b595-c039c90fa4f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:17.644309 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d99cf0-409d-4a54-b595-c039c90fa4f4 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:17.654267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1345/2677] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:29:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:29:17.922569 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f572ae-3114-4388-8370-0ca57f73f5d8 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:17.924307 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d5f572ae-3114-4388-8370-0ca57f73f5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:17.942461 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f572ae-3114-4388-8370-0ca57f73f5d8 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:17.950076 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7cbc4-43cc-4e5d-9459-8c1a08e6d29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:17.951188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7cbc4-43cc-4e5d-9459-8c1a08e6d29a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:17.951685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7cbc4-43cc-4e5d-9459-8c1a08e6d29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:17.952228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7cbc4-43cc-4e5d-9459-8c1a08e6d29a admin admin] PATH_INFO: `/v3/projects/50c4472d99ac4f76b5b8e218c6ac8204` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:17.954080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7cbc4-43cc-4e5d-9459-8c1a08e6d29a admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c4472d99ac4f76b5b8e218c6ac8204)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:17.957791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7cbc4-43cc-4e5d-9459-8c1a08e6d29a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:18.008617 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-43a7cbc4-43cc-4e5d-9459-8c1a08e6d29a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c4472d99ac4f76b5b8e218c6ac8204', 'request_id': 'req-43a7cbc4-43cc-4e5d-9459-8c1a08e6d29a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:18.016127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-43a7cbc4-43cc-4e5d-9459-8c1a08e6d29a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c4472d99ac4f76b5b8e218c6ac8204', 'request_id': 'req-43a7cbc4-43cc-4e5d-9459-8c1a08e6d29a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:18.023233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-43a7cbc4-43cc-4e5d-9459-8c1a08e6d29a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c4472d99ac4f76b5b8e218c6ac8204', 'request_id': 'req-43a7cbc4-43cc-4e5d-9459-8c1a08e6d29a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:18.036574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-43a7cbc4-43cc-4e5d-9459-8c1a08e6d29a admin admin] The token cache is being invalidate because project 50c4472d99ac4f76b5b8e218c6ac8204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:29:18.036862 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-43a7cbc4-43cc-4e5d-9459-8c1a08e6d29a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:18.037473 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-43a7cbc4-43cc-4e5d-9459-8c1a08e6d29a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:18.038983 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1333/2678] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:29:17 2022] DELETE /identity/v3/projects/50c4472d99ac4f76b5b8e218c6ac8204 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:18.043018 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d99cf0-409d-4a54-b595-c039c90fa4f4 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:18.052863 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d99cf0-409d-4a54-b595-c039c90fa4f4 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:18.061090 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:18.110896 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae3181-5e9e-4cd3-9a9e-9efb88f3b7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:18.111429 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae3181-5e9e-4cd3-9a9e-9efb88f3b7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:18.111705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae3181-5e9e-4cd3-9a9e-9efb88f3b7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:18.111976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae3181-5e9e-4cd3-9a9e-9efb88f3b7e2 admin admin] PATH_INFO: `/v3/users/405956e0cc4a4e42a1134f7afd066b78` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:18.113076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae3181-5e9e-4cd3-9a9e-9efb88f3b7e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=405956e0cc4a4e42a1134f7afd066b78)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:18.115314 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae3181-5e9e-4cd3-9a9e-9efb88f3b7e2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:18.160899 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d9ae3181-5e9e-4cd3-9a9e-9efb88f3b7e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '405956e0cc4a4e42a1134f7afd066b78'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:18.167731 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d9ae3181-5e9e-4cd3-9a9e-9efb88f3b7e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '405956e0cc4a4e42a1134f7afd066b78'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:18.179561 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d9ae3181-5e9e-4cd3-9a9e-9efb88f3b7e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '405956e0cc4a4e42a1134f7afd066b78'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:18.180236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d9ae3181-5e9e-4cd3-9a9e-9efb88f3b7e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '405956e0cc4a4e42a1134f7afd066b78'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:18.187532 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d9ae3181-5e9e-4cd3-9a9e-9efb88f3b7e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '405956e0cc4a4e42a1134f7afd066b78'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:18.193438 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1346/2679] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:29:18 2022] DELETE /identity/v3/users/405956e0cc4a4e42a1134f7afd066b78 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:18.475320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7cbc4-43cc-4e5d-9459-8c1a08e6d29a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:18.477204 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-43a7cbc4-43cc-4e5d-9459-8c1a08e6d29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:18.493728 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7cbc4-43cc-4e5d-9459-8c1a08e6d29a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:18.556177 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46bed6-0437-4fa0-a9df-c0a350850f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:18.556833 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46bed6-0437-4fa0-a9df-c0a350850f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:18.557119 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46bed6-0437-4fa0-a9df-c0a350850f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:18.557396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46bed6-0437-4fa0-a9df-c0a350850f66 admin admin] PATH_INFO: `/v3/projects/d64c59fbce9149b69bed5c13dc6e5ffe` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:18.558544 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46bed6-0437-4fa0-a9df-c0a350850f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d64c59fbce9149b69bed5c13dc6e5ffe)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:18.561421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46bed6-0437-4fa0-a9df-c0a350850f66 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:18.567702 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:18.618906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ff46bed6-0437-4fa0-a9df-c0a350850f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd64c59fbce9149b69bed5c13dc6e5ffe', 'request_id': 'req-ff46bed6-0437-4fa0-a9df-c0a350850f66'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:18.624561 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ff46bed6-0437-4fa0-a9df-c0a350850f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd64c59fbce9149b69bed5c13dc6e5ffe', 'request_id': 'req-ff46bed6-0437-4fa0-a9df-c0a350850f66'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:18.631884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ff46bed6-0437-4fa0-a9df-c0a350850f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd64c59fbce9149b69bed5c13dc6e5ffe', 'request_id': 'req-ff46bed6-0437-4fa0-a9df-c0a350850f66'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:18.646295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ff46bed6-0437-4fa0-a9df-c0a350850f66 admin admin] The token cache is being invalidate because project d64c59fbce9149b69bed5c13dc6e5ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:29:18.646588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ff46bed6-0437-4fa0-a9df-c0a350850f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:18.647359 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ff46bed6-0437-4fa0-a9df-c0a350850f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:18.649083 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1334/2680] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:29:18 2022] DELETE /identity/v3/projects/d64c59fbce9149b69bed5c13dc6e5ffe => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:18.654642 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e011c3-04b9-4fae-b08d-f9f0a75693a5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:18.655171 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e011c3-04b9-4fae-b08d-f9f0a75693a5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:18.655286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e011c3-04b9-4fae-b08d-f9f0a75693a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:18.677170 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f1e011c3-04b9-4fae-b08d-f9f0a75693a5 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:18.678626 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f1e011c3-04b9-4fae-b08d-f9f0a75693a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:18.744430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1347/2681] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:18.752477 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d36a70-954e-4c0f-bdb6-b3dfb459e43e None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:18.752768 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d36a70-954e-4c0f-bdb6-b3dfb459e43e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:18.753056 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d36a70-954e-4c0f-bdb6-b3dfb459e43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:18.773501 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-24d36a70-954e-4c0f-bdb6-b3dfb459e43e None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:18.774772 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-24d36a70-954e-4c0f-bdb6-b3dfb459e43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:18.783598 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1335/2682] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:18.787987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e011c3-04b9-4fae-b08d-f9f0a75693a5 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:18.798841 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e011c3-04b9-4fae-b08d-f9f0a75693a5 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:18.803919 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675dd96-9b42-4e54-9b07-946c18d6090a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:18.804543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675dd96-9b42-4e54-9b07-946c18d6090a admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:18.804815 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675dd96-9b42-4e54-9b07-946c18d6090a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:18.805082 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675dd96-9b42-4e54-9b07-946c18d6090a admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:18.805739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675dd96-9b42-4e54-9b07-946c18d6090a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:29:18.806039 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675dd96-9b42-4e54-9b07-946c18d6090a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:18.807692 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675dd96-9b42-4e54-9b07-946c18d6090a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:18.819873 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1348/2683] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:29:18.824408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d36a70-954e-4c0f-bdb6-b3dfb459e43e None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:18.834229 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d36a70-954e-4c0f-bdb6-b3dfb459e43e None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:18.838939 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd228e95-98bf-42eb-9aff-f1af97503fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:18.839543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd228e95-98bf-42eb-9aff-f1af97503fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:18.839827 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd228e95-98bf-42eb-9aff-f1af97503fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:18.840593 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd228e95-98bf-42eb-9aff-f1af97503fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:18.841244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd228e95-98bf-42eb-9aff-f1af97503fc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:18.843185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd228e95-98bf-42eb-9aff-f1af97503fc9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:18.873727 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1336/2684] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:29:18 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:29:18.877877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675dd96-9b42-4e54-9b07-946c18d6090a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:18.888156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675dd96-9b42-4e54-9b07-946c18d6090a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:18.904272 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:18.954514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e5dc1-52f9-4b69-aa7d-3c3837d62203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:18.955164 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e5dc1-52f9-4b69-aa7d-3c3837d62203 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:18.955451 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e5dc1-52f9-4b69-aa7d-3c3837d62203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:18.955727 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e5dc1-52f9-4b69-aa7d-3c3837d62203 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:18.956429 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e5dc1-52f9-4b69-aa7d-3c3837d62203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:18.958382 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e5dc1-52f9-4b69-aa7d-3c3837d62203 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:18.986836 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1349/2685] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:29:18 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:29:18.991311 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd228e95-98bf-42eb-9aff-f1af97503fc9 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:19.001609 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd228e95-98bf-42eb-9aff-f1af97503fc9 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:19.006231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0719609-dcf9-429f-8745-68b5eca93675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:19.006900 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0719609-dcf9-429f-8745-68b5eca93675 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:19.007293 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0719609-dcf9-429f-8745-68b5eca93675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:19.007470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0719609-dcf9-429f-8745-68b5eca93675 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:19.008097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0719609-dcf9-429f-8745-68b5eca93675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:19.009723 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0719609-dcf9-429f-8745-68b5eca93675 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:19.020641 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1337/2686] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:29:19.024858 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e5dc1-52f9-4b69-aa7d-3c3837d62203 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:19.036019 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e5dc1-52f9-4b69-aa7d-3c3837d62203 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:19.041631 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56d895-754d-4668-9e7f-c37cb55b7b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:19.042250 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56d895-754d-4668-9e7f-c37cb55b7b71 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:19.042529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56d895-754d-4668-9e7f-c37cb55b7b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:19.042836 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56d895-754d-4668-9e7f-c37cb55b7b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:19.043521 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56d895-754d-4668-9e7f-c37cb55b7b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:19.045120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56d895-754d-4668-9e7f-c37cb55b7b71 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:19.056146 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1350/2687] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:29:19.061013 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0719609-dcf9-429f-8745-68b5eca93675 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:19.071124 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0719609-dcf9-429f-8745-68b5eca93675 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:19.076327 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4c828-f48e-4ba7-9548-e7dafa4cce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:19.076974 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4c828-f48e-4ba7-9548-e7dafa4cce3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:19.077254 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4c828-f48e-4ba7-9548-e7dafa4cce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:19.077526 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4c828-f48e-4ba7-9548-e7dafa4cce3b admin admin] PATH_INFO: `/v3/projects/5c20bcb3659040f4964a860ccd9f6b29/users/f1bce2ac8d02450b83a89fcbf29d0265/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:19.094175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4c828-f48e-4ba7-9548-e7dafa4cce3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c20bcb3659040f4964a860ccd9f6b29, user_id=f1bce2ac8d02450b83a89fcbf29d0265, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:19.096865 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4c828-f48e-4ba7-9548-e7dafa4cce3b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:19.114244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1338/2688] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:29:19 2022] PUT /identity/v3/projects/5c20bcb3659040f4964a860ccd9f6b29/users/f1bce2ac8d02450b83a89fcbf29d0265/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:19.124851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e038d2-aa23-4279-b2c0-c7170336fe80 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:19.125171 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e038d2-aa23-4279-b2c0-c7170336fe80 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:19.125450 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e038d2-aa23-4279-b2c0-c7170336fe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:19.158006 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f7e038d2-aa23-4279-b2c0-c7170336fe80 None None] MFA Rules not processed for user `f1bce2ac8d02450b83a89fcbf29d0265`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:19.159236 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f7e038d2-aa23-4279-b2c0-c7170336fe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:19.228292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1351/2689] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:19.232911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4c828-f48e-4ba7-9548-e7dafa4cce3b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:19.294959 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4c828-f48e-4ba7-9548-e7dafa4cce3b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:19.299681 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af959ef0-9b03-4c3a-be08-f1b1f9970020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:19.300290 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af959ef0-9b03-4c3a-be08-f1b1f9970020 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:19.300572 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af959ef0-9b03-4c3a-be08-f1b1f9970020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:19.300844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af959ef0-9b03-4c3a-be08-f1b1f9970020 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:19.301493 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af959ef0-9b03-4c3a-be08-f1b1f9970020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:19.303437 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af959ef0-9b03-4c3a-be08-f1b1f9970020 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:19.330289 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1339/2690] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:29:19 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:29:19.334552 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e038d2-aa23-4279-b2c0-c7170336fe80 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:19.346750 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e038d2-aa23-4279-b2c0-c7170336fe80 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:19.418602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc7daf-d1cf-4ffa-b456-7a56394f3e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:19.419247 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc7daf-d1cf-4ffa-b456-7a56394f3e86 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:19.419527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc7daf-d1cf-4ffa-b456-7a56394f3e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:19.419798 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc7daf-d1cf-4ffa-b456-7a56394f3e86 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:19.420442 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc7daf-d1cf-4ffa-b456-7a56394f3e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:19.422353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc7daf-d1cf-4ffa-b456-7a56394f3e86 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:19.445283 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1352/2691] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:29:19 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:29:19.450045 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af959ef0-9b03-4c3a-be08-f1b1f9970020 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:19.460516 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af959ef0-9b03-4c3a-be08-f1b1f9970020 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:19.465119 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1516782-9df0-4b88-9723-f6e538b8cf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:19.465715 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1516782-9df0-4b88-9723-f6e538b8cf7b admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:19.465996 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1516782-9df0-4b88-9723-f6e538b8cf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:19.466272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1516782-9df0-4b88-9723-f6e538b8cf7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:19.466942 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1516782-9df0-4b88-9723-f6e538b8cf7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:19.468556 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1516782-9df0-4b88-9723-f6e538b8cf7b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:19.479297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1340/2692] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:29:19.483585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc7daf-d1cf-4ffa-b456-7a56394f3e86 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:19.493875 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc7daf-d1cf-4ffa-b456-7a56394f3e86 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:19.499205 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68392c37-9e2a-4f5a-9717-c12058ff46a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:19.499860 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68392c37-9e2a-4f5a-9717-c12058ff46a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:19.500137 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68392c37-9e2a-4f5a-9717-c12058ff46a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:19.500410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68392c37-9e2a-4f5a-9717-c12058ff46a9 admin admin] PATH_INFO: `/v3/projects/737dbbb206a34a5791cb47aa8c1b1118/users/8062bd62e39749cca2be1cbd900ffa29/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:19.513287 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:19.516796 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68392c37-9e2a-4f5a-9717-c12058ff46a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=737dbbb206a34a5791cb47aa8c1b1118, user_id=8062bd62e39749cca2be1cbd900ffa29, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:19.520561 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68392c37-9e2a-4f5a-9717-c12058ff46a9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:19.534320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1353/2693] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:29:19 2022] PUT /identity/v3/projects/737dbbb206a34a5791cb47aa8c1b1118/users/8062bd62e39749cca2be1cbd900ffa29/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:19.538420 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1516782-9df0-4b88-9723-f6e538b8cf7b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:19.544820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:19.549087 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1516782-9df0-4b88-9723-f6e538b8cf7b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:19.616275 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3489a-1fd5-49d6-8646-5e2e65d47162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:19.616882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3489a-1fd5-49d6-8646-5e2e65d47162 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:19.617168 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3489a-1fd5-49d6-8646-5e2e65d47162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:19.617446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3489a-1fd5-49d6-8646-5e2e65d47162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:19.618095 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3489a-1fd5-49d6-8646-5e2e65d47162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:19.619738 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3489a-1fd5-49d6-8646-5e2e65d47162 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:19.630345 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1341/2694] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:29:19.634627 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68392c37-9e2a-4f5a-9717-c12058ff46a9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:19.648414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68392c37-9e2a-4f5a-9717-c12058ff46a9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:19.653201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4fd80-a81a-409f-92f4-5baceeb8b280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:19.653867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4fd80-a81a-409f-92f4-5baceeb8b280 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:19.654151 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4fd80-a81a-409f-92f4-5baceeb8b280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:19.654430 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4fd80-a81a-409f-92f4-5baceeb8b280 admin admin] PATH_INFO: `/v3/projects/737dbbb206a34a5791cb47aa8c1b1118/users/8062bd62e39749cca2be1cbd900ffa29/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:19.656433 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4fd80-a81a-409f-92f4-5baceeb8b280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=737dbbb206a34a5791cb47aa8c1b1118, user_id=8062bd62e39749cca2be1cbd900ffa29, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:19.659196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4fd80-a81a-409f-92f4-5baceeb8b280 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:19.670208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1354/2695] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:29:19 2022] PUT /identity/v3/projects/737dbbb206a34a5791cb47aa8c1b1118/users/8062bd62e39749cca2be1cbd900ffa29/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:19.681481 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff4e10-3e6b-4af1-a7d1-2a6eef75f785 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:19.681777 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff4e10-3e6b-4af1-a7d1-2a6eef75f785 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:19.682066 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff4e10-3e6b-4af1-a7d1-2a6eef75f785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:19.712672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-40ff4e10-3e6b-4af1-a7d1-2a6eef75f785 None None] MFA Rules not processed for user `8062bd62e39749cca2be1cbd900ffa29`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:19.713992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-40ff4e10-3e6b-4af1-a7d1-2a6eef75f785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:19.784053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1342/2696] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:19.795628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4fd80-a81a-409f-92f4-5baceeb8b280 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:19.797363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-54d4fd80-a81a-409f-92f4-5baceeb8b280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:19.856051 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4fd80-a81a-409f-92f4-5baceeb8b280 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:19.859657 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e7bbc-8c63-43c8-a357-6956fd8e9e3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:19.860262 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e7bbc-8c63-43c8-a357-6956fd8e9e3c service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:19.860540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e7bbc-8c63-43c8-a357-6956fd8e9e3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:19.860812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e7bbc-8c63-43c8-a357-6956fd8e9e3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:19.870816 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e7bbc-8c63-43c8-a357-6956fd8e9e3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:19.872343 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e7bbc-8c63-43c8-a357-6956fd8e9e3c service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:19.882571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1355/2697] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:29:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:29:20.327215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff4e10-3e6b-4af1-a7d1-2a6eef75f785 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:20.390060 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff4e10-3e6b-4af1-a7d1-2a6eef75f785 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:20.394624 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618db01-8084-40bd-9576-30e7c154441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:20.395298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618db01-8084-40bd-9576-30e7c154441e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:20.395577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618db01-8084-40bd-9576-30e7c154441e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:20.395854 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618db01-8084-40bd-9576-30e7c154441e admin admin] PATH_INFO: `/v3/users/f1bce2ac8d02450b83a89fcbf29d0265` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:20.397084 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618db01-8084-40bd-9576-30e7c154441e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1bce2ac8d02450b83a89fcbf29d0265)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:20.399031 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618db01-8084-40bd-9576-30e7c154441e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:20.431500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:20.453548 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4618db01-8084-40bd-9576-30e7c154441e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1bce2ac8d02450b83a89fcbf29d0265'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:20.461252 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4618db01-8084-40bd-9576-30e7c154441e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1bce2ac8d02450b83a89fcbf29d0265'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:20.461966 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4618db01-8084-40bd-9576-30e7c154441e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1bce2ac8d02450b83a89fcbf29d0265'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:20.474347 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4618db01-8084-40bd-9576-30e7c154441e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1bce2ac8d02450b83a89fcbf29d0265'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:20.482336 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4618db01-8084-40bd-9576-30e7c154441e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1bce2ac8d02450b83a89fcbf29d0265'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:20.488929 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1343/2698] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:29:20 2022] DELETE /identity/v3/users/f1bce2ac8d02450b83a89fcbf29d0265 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:29:20.493453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd1cc6-f5a5-41fa-a8b3-4cc942596246 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:20.493736 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd1cc6-f5a5-41fa-a8b3-4cc942596246 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:20.494014 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd1cc6-f5a5-41fa-a8b3-4cc942596246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:20.513278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-75cd1cc6-f5a5-41fa-a8b3-4cc942596246 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:20.514484 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-75cd1cc6-f5a5-41fa-a8b3-4cc942596246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:20.586123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1356/2699] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:20.597041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618db01-8084-40bd-9576-30e7c154441e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:20.598459 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4618db01-8084-40bd-9576-30e7c154441e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:20.659755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618db01-8084-40bd-9576-30e7c154441e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:20.663579 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99bd8e-a755-40ce-a3d8-868f9711b8e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:20.664221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99bd8e-a755-40ce-a3d8-868f9711b8e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:20.664505 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99bd8e-a755-40ce-a3d8-868f9711b8e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:20.664782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99bd8e-a755-40ce-a3d8-868f9711b8e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:20.674282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99bd8e-a755-40ce-a3d8-868f9711b8e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:20.675834 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99bd8e-a755-40ce-a3d8-868f9711b8e3 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:20.685986 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1344/2700] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:29:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:29:20.976376 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd1cc6-f5a5-41fa-a8b3-4cc942596246 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:20.977920 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-75cd1cc6-f5a5-41fa-a8b3-4cc942596246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:20.990693 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd1cc6-f5a5-41fa-a8b3-4cc942596246 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:20.995542 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4960-302e-4ddf-b5ee-64944a416e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:20.996713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4960-302e-4ddf-b5ee-64944a416e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:20.996998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4960-302e-4ddf-b5ee-64944a416e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:20.997273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4960-302e-4ddf-b5ee-64944a416e2d admin admin] PATH_INFO: `/v3/projects/5c20bcb3659040f4964a860ccd9f6b29` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:20.998427 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe4960-302e-4ddf-b5ee-64944a416e2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c20bcb3659040f4964a860ccd9f6b29)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:21.000385 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe4960-302e-4ddf-b5ee-64944a416e2d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:21.056652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-effe4960-302e-4ddf-b5ee-64944a416e2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c20bcb3659040f4964a860ccd9f6b29', 'request_id': 'req-effe4960-302e-4ddf-b5ee-64944a416e2d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:21.063490 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-effe4960-302e-4ddf-b5ee-64944a416e2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c20bcb3659040f4964a860ccd9f6b29', 'request_id': 'req-effe4960-302e-4ddf-b5ee-64944a416e2d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:21.077906 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-effe4960-302e-4ddf-b5ee-64944a416e2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c20bcb3659040f4964a860ccd9f6b29', 'request_id': 'req-effe4960-302e-4ddf-b5ee-64944a416e2d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:21.093446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-effe4960-302e-4ddf-b5ee-64944a416e2d admin admin] The token cache is being invalidate because project 5c20bcb3659040f4964a860ccd9f6b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:29:21.093735 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-effe4960-302e-4ddf-b5ee-64944a416e2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:21.094400 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-effe4960-302e-4ddf-b5ee-64944a416e2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:21.095909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1357/2701] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:29:20 2022] DELETE /identity/v3/projects/5c20bcb3659040f4964a860ccd9f6b29 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:21.099896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99bd8e-a755-40ce-a3d8-868f9711b8e3 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:21.109746 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99bd8e-a755-40ce-a3d8-868f9711b8e3 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:21.173949 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bdd1b-7657-469a-b146-f39b941e1fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:21.174588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bdd1b-7657-469a-b146-f39b941e1fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:21.174904 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bdd1b-7657-469a-b146-f39b941e1fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:21.175185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bdd1b-7657-469a-b146-f39b941e1fa9 admin admin] PATH_INFO: `/v3/users/8062bd62e39749cca2be1cbd900ffa29` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:21.176317 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bdd1b-7657-469a-b146-f39b941e1fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8062bd62e39749cca2be1cbd900ffa29)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:21.178259 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bdd1b-7657-469a-b146-f39b941e1fa9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:21.237660 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-172bdd1b-7657-469a-b146-f39b941e1fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8062bd62e39749cca2be1cbd900ffa29'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:21.239896 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:21.247707 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-172bdd1b-7657-469a-b146-f39b941e1fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8062bd62e39749cca2be1cbd900ffa29'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:21.248539 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-172bdd1b-7657-469a-b146-f39b941e1fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8062bd62e39749cca2be1cbd900ffa29'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:21.261309 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-172bdd1b-7657-469a-b146-f39b941e1fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8062bd62e39749cca2be1cbd900ffa29'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:21.269120 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-172bdd1b-7657-469a-b146-f39b941e1fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8062bd62e39749cca2be1cbd900ffa29'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:21.275965 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1345/2702] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:29:21 2022] DELETE /identity/v3/users/8062bd62e39749cca2be1cbd900ffa29 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:21.558676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4960-302e-4ddf-b5ee-64944a416e2d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:21.560458 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-effe4960-302e-4ddf-b5ee-64944a416e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:21.573520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:21.575540 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4960-302e-4ddf-b5ee-64944a416e2d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:21.643699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cd852-a982-4246-ab13-196b6c937905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:21.645367 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cd852-a982-4246-ab13-196b6c937905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:21.645652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cd852-a982-4246-ab13-196b6c937905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:21.645927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cd852-a982-4246-ab13-196b6c937905 admin admin] PATH_INFO: `/v3/projects/737dbbb206a34a5791cb47aa8c1b1118` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:21.647150 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cd852-a982-4246-ab13-196b6c937905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=737dbbb206a34a5791cb47aa8c1b1118)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:21.649107 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cd852-a982-4246-ab13-196b6c937905 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:21.697221 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3e5cd852-a982-4246-ab13-196b6c937905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '737dbbb206a34a5791cb47aa8c1b1118', 'request_id': 'req-3e5cd852-a982-4246-ab13-196b6c937905'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:21.704382 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3e5cd852-a982-4246-ab13-196b6c937905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '737dbbb206a34a5791cb47aa8c1b1118', 'request_id': 'req-3e5cd852-a982-4246-ab13-196b6c937905'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:21.712230 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3e5cd852-a982-4246-ab13-196b6c937905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '737dbbb206a34a5791cb47aa8c1b1118', 'request_id': 'req-3e5cd852-a982-4246-ab13-196b6c937905'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:21.723448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3e5cd852-a982-4246-ab13-196b6c937905 admin admin] The token cache is being invalidate because project 737dbbb206a34a5791cb47aa8c1b1118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:29:21.723741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3e5cd852-a982-4246-ab13-196b6c937905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:21.724410 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3e5cd852-a982-4246-ab13-196b6c937905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:21.725931 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1358/2703] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:29:21 2022] DELETE /identity/v3/projects/737dbbb206a34a5791cb47aa8c1b1118 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:29:21.730855 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b69bf-0800-429a-9e1d-0e0d6ee053a0 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:21.731336 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b69bf-0800-429a-9e1d-0e0d6ee053a0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:21.731474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b69bf-0800-429a-9e1d-0e0d6ee053a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:21.754150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a15b69bf-0800-429a-9e1d-0e0d6ee053a0 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:21.755360 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a15b69bf-0800-429a-9e1d-0e0d6ee053a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:21.816969 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1346/2704] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:21.825778 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37c7ac-f98f-4d0d-aabb-a4bb9c61921b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:21.826073 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37c7ac-f98f-4d0d-aabb-a4bb9c61921b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:21.826374 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37c7ac-f98f-4d0d-aabb-a4bb9c61921b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:21.846323 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-3b37c7ac-f98f-4d0d-aabb-a4bb9c61921b None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:21.847592 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3b37c7ac-f98f-4d0d-aabb-a4bb9c61921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:21.855744 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1359/2705] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:21.860051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b69bf-0800-429a-9e1d-0e0d6ee053a0 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:21.870888 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b69bf-0800-429a-9e1d-0e0d6ee053a0 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:21.876143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288b51c-71cd-4218-86c8-66fe385d9003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:21.877102 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288b51c-71cd-4218-86c8-66fe385d9003 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:21.877394 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288b51c-71cd-4218-86c8-66fe385d9003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:21.877672 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288b51c-71cd-4218-86c8-66fe385d9003 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:21.878335 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288b51c-71cd-4218-86c8-66fe385d9003 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:29:21.878648 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288b51c-71cd-4218-86c8-66fe385d9003 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:21.880302 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288b51c-71cd-4218-86c8-66fe385d9003 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:21.892796 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1347/2706] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:29:21.897634 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37c7ac-f98f-4d0d-aabb-a4bb9c61921b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:21.909027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37c7ac-f98f-4d0d-aabb-a4bb9c61921b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:21.913727 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53d5e-f42c-431b-9015-63993ed58b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:21.914328 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53d5e-f42c-431b-9015-63993ed58b36 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:21.914609 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53d5e-f42c-431b-9015-63993ed58b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:21.914911 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53d5e-f42c-431b-9015-63993ed58b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:21.915546 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe53d5e-f42c-431b-9015-63993ed58b36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:21.917454 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe53d5e-f42c-431b-9015-63993ed58b36 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:21.945982 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1360/2707] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:29:21 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:29:21.951017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288b51c-71cd-4218-86c8-66fe385d9003 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:21.961376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288b51c-71cd-4218-86c8-66fe385d9003 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:22.024626 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10153183-c90e-4148-ad12-4639c52cfbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:22.025133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10153183-c90e-4148-ad12-4639c52cfbf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:22.025415 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10153183-c90e-4148-ad12-4639c52cfbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:22.025691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10153183-c90e-4148-ad12-4639c52cfbf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:22.026370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10153183-c90e-4148-ad12-4639c52cfbf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:22.028330 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10153183-c90e-4148-ad12-4639c52cfbf2 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:22.052024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1348/2708] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:29:21 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:29:22.056327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53d5e-f42c-431b-9015-63993ed58b36 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:22.067579 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53d5e-f42c-431b-9015-63993ed58b36 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:22.072288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992e2f3-2dae-493b-86a7-cf0149a0326b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:22.072891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992e2f3-2dae-493b-86a7-cf0149a0326b admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:22.073173 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992e2f3-2dae-493b-86a7-cf0149a0326b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:22.073447 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992e2f3-2dae-493b-86a7-cf0149a0326b admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:22.074095 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992e2f3-2dae-493b-86a7-cf0149a0326b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:22.075747 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992e2f3-2dae-493b-86a7-cf0149a0326b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:22.086307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1361/2709] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:29:22.090340 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10153183-c90e-4148-ad12-4639c52cfbf2 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:22.100508 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10153183-c90e-4148-ad12-4639c52cfbf2 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:22.105129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a1fc7-1e17-4cef-8929-bf191d64fa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:22.106221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a1fc7-1e17-4cef-8929-bf191d64fa88 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:22.106498 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a1fc7-1e17-4cef-8929-bf191d64fa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:22.106788 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a1fc7-1e17-4cef-8929-bf191d64fa88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:22.107434 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a1fc7-1e17-4cef-8929-bf191d64fa88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:22.109040 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a1fc7-1e17-4cef-8929-bf191d64fa88 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:22.120258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1349/2710] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:29:22.125678 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992e2f3-2dae-493b-86a7-cf0149a0326b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:22.135265 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992e2f3-2dae-493b-86a7-cf0149a0326b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:22.140413 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed786467-1695-4a1f-93a7-5aee6c5961ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:22.141076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed786467-1695-4a1f-93a7-5aee6c5961ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:22.141353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed786467-1695-4a1f-93a7-5aee6c5961ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:22.141634 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed786467-1695-4a1f-93a7-5aee6c5961ac admin admin] PATH_INFO: `/v3/projects/de503dbe554e4118bd794b6069ebdaab/users/80e4375427934e7387a2590d8a5a2e0e/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:22.157269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed786467-1695-4a1f-93a7-5aee6c5961ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=de503dbe554e4118bd794b6069ebdaab, user_id=80e4375427934e7387a2590d8a5a2e0e, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:22.160036 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed786467-1695-4a1f-93a7-5aee6c5961ac admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:22.174357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1362/2711] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:29:22 2022] PUT /identity/v3/projects/de503dbe554e4118bd794b6069ebdaab/users/80e4375427934e7387a2590d8a5a2e0e/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:22.179600 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5103e63-1775-43b1-b8fd-98bd4607e330 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:22.179893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5103e63-1775-43b1-b8fd-98bd4607e330 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:22.180172 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5103e63-1775-43b1-b8fd-98bd4607e330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:22.200632 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f5103e63-1775-43b1-b8fd-98bd4607e330 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:22.201905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f5103e63-1775-43b1-b8fd-98bd4607e330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:22.238711 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:22.287400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1350/2712] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:22.297683 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed786467-1695-4a1f-93a7-5aee6c5961ac admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:22.299460 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ed786467-1695-4a1f-93a7-5aee6c5961ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:22.342927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:22.369521 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed786467-1695-4a1f-93a7-5aee6c5961ac admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:22.373201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6768f5-f9cd-44e3-abc3-b519813b4bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:22.373813 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6768f5-f9cd-44e3-abc3-b519813b4bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:22.374087 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6768f5-f9cd-44e3-abc3-b519813b4bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:22.374359 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6768f5-f9cd-44e3-abc3-b519813b4bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:22.383737 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6768f5-f9cd-44e3-abc3-b519813b4bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:22.385172 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6768f5-f9cd-44e3-abc3-b519813b4bb8 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:22.395453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1363/2713] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:29:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:29:23.077473 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8309be9-a668-43f3-89a5-9db654250a74 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:23.078052 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8309be9-a668-43f3-89a5-9db654250a74 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:23.078052 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8309be9-a668-43f3-89a5-9db654250a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:23.112792 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a8309be9-a668-43f3-89a5-9db654250a74 None None] MFA Rules not processed for user `80e4375427934e7387a2590d8a5a2e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:23.114278 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a8309be9-a668-43f3-89a5-9db654250a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:23.204248 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1351/2714] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:29:23.221289 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6768f5-f9cd-44e3-abc3-b519813b4bb8 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:23.223711 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1c6768f5-f9cd-44e3-abc3-b519813b4bb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:23.302006 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6768f5-f9cd-44e3-abc3-b519813b4bb8 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:23.306011 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585b8c5-56de-4f34-9139-04d7c6880174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:23.307116 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585b8c5-56de-4f34-9139-04d7c6880174 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:23.307680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585b8c5-56de-4f34-9139-04d7c6880174 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:23.308197 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585b8c5-56de-4f34-9139-04d7c6880174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:23.319419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585b8c5-56de-4f34-9139-04d7c6880174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:23.320800 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585b8c5-56de-4f34-9139-04d7c6880174 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:23.331120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1364/2715] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:29:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:29:24.764597 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecd6be-9a53-4f7e-9d35-593c4ef13c5e None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:24.765160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecd6be-9a53-4f7e-9d35-593c4ef13c5e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:24.765160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecd6be-9a53-4f7e-9d35-593c4ef13c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:24.786382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8cecd6be-9a53-4f7e-9d35-593c4ef13c5e None None] MFA Rules not processed for user `80e4375427934e7387a2590d8a5a2e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:24.791385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8cecd6be-9a53-4f7e-9d35-593c4ef13c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:24.795181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1352/2716] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:31.607062 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585b8c5-56de-4f34-9139-04d7c6880174 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:31.608484 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f585b8c5-56de-4f34-9139-04d7c6880174 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:31.621018 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585b8c5-56de-4f34-9139-04d7c6880174 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:31.624578 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a54e9-f229-4173-b1de-9568820786d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:31.625193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a54e9-f229-4173-b1de-9568820786d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:31.625471 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a54e9-f229-4173-b1de-9568820786d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:31.625740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a54e9-f229-4173-b1de-9568820786d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:31.627507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-010a54e9-f229-4173-b1de-9568820786d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:31.639940 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a54e9-f229-4173-b1de-9568820786d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:31.641375 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a54e9-f229-4173-b1de-9568820786d1 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:31.651475 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1365/2717] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:29:34.780171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=47 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:35.118193 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecd6be-9a53-4f7e-9d35-593c4ef13c5e None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:35.120157 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8cecd6be-9a53-4f7e-9d35-593c4ef13c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:35.239062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecd6be-9a53-4f7e-9d35-593c4ef13c5e None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:35.245736 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc82bed-79f6-4d60-ad6d-52175333f3e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efd209a50a994b7c8485f2996697218b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:35.246617 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a54e9-f229-4173-b1de-9568820786d1 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:35.248352 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-010a54e9-f229-4173-b1de-9568820786d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:35.248499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc82bed-79f6-4d60-ad6d-52175333f3e9 service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:35.249082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc82bed-79f6-4d60-ad6d-52175333f3e9 service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:35.249517 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc82bed-79f6-4d60-ad6d-52175333f3e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:35.252832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8bc82bed-79f6-4d60-ad6d-52175333f3e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:35.266556 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc82bed-79f6-4d60-ad6d-52175333f3e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:35.266950 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a54e9-f229-4173-b1de-9568820786d1 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:35.269334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc82bed-79f6-4d60-ad6d-52175333f3e9 service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:35.295005 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1353/2718] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:29:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:29:35.306155 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b79f38-d3c4-4ad9-b75d-f0c1299ca3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:35.308015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b79f38-d3c4-4ad9-b75d-f0c1299ca3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:35.308015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b79f38-d3c4-4ad9-b75d-f0c1299ca3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:35.308218 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b79f38-d3c4-4ad9-b75d-f0c1299ca3ae admin admin] PATH_INFO: `/v3/users/36c0cb5c49fc4756930a9af1244e60a9` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:35.310450 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b79f38-d3c4-4ad9-b75d-f0c1299ca3ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c0cb5c49fc4756930a9af1244e60a9)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:35.312611 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b79f38-d3c4-4ad9-b75d-f0c1299ca3ae admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:35.381766 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-70b79f38-d3c4-4ad9-b75d-f0c1299ca3ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c0cb5c49fc4756930a9af1244e60a9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:35.390252 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-70b79f38-d3c4-4ad9-b75d-f0c1299ca3ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c0cb5c49fc4756930a9af1244e60a9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:35.412121 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-70b79f38-d3c4-4ad9-b75d-f0c1299ca3ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c0cb5c49fc4756930a9af1244e60a9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:35.412865 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-70b79f38-d3c4-4ad9-b75d-f0c1299ca3ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c0cb5c49fc4756930a9af1244e60a9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:35.421054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-70b79f38-d3c4-4ad9-b75d-f0c1299ca3ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c0cb5c49fc4756930a9af1244e60a9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:35.428125 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1366/2719] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:29:35 2022] DELETE /identity/v3/users/36c0cb5c49fc4756930a9af1244e60a9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:35.619101 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc82bed-79f6-4d60-ad6d-52175333f3e9 service placement] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:35.630749 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc82bed-79f6-4d60-ad6d-52175333f3e9 service placement] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:35.699235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2c540-d383-4300-9670-94b4f4a44911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:35.700021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2c540-d383-4300-9670-94b4f4a44911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:35.700163 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2c540-d383-4300-9670-94b4f4a44911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:35.700434 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2c540-d383-4300-9670-94b4f4a44911 admin admin] PATH_INFO: `/v3/projects/a2cfa8198a1d4fd2abe663ea6834ef27` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:35.702236 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2c540-d383-4300-9670-94b4f4a44911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2cfa8198a1d4fd2abe663ea6834ef27)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:35.703629 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2c540-d383-4300-9670-94b4f4a44911 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:35.758213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8ea2c540-d383-4300-9670-94b4f4a44911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2cfa8198a1d4fd2abe663ea6834ef27', 'request_id': 'req-8ea2c540-d383-4300-9670-94b4f4a44911'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:35.767011 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8ea2c540-d383-4300-9670-94b4f4a44911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2cfa8198a1d4fd2abe663ea6834ef27', 'request_id': 'req-8ea2c540-d383-4300-9670-94b4f4a44911'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:35.775056 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8ea2c540-d383-4300-9670-94b4f4a44911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2cfa8198a1d4fd2abe663ea6834ef27', 'request_id': 'req-8ea2c540-d383-4300-9670-94b4f4a44911'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:35.791491 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8ea2c540-d383-4300-9670-94b4f4a44911 admin admin] The token cache is being invalidate because project a2cfa8198a1d4fd2abe663ea6834ef27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:29:35.792382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8ea2c540-d383-4300-9670-94b4f4a44911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:35.792382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8ea2c540-d383-4300-9670-94b4f4a44911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:29:35.794382 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1354/2720] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:29:35 2022] DELETE /identity/v3/projects/a2cfa8198a1d4fd2abe663ea6834ef27 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:29:35.799327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87728c-18f9-4cc7-8cff-e2f0adcff796 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:35.799610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87728c-18f9-4cc7-8cff-e2f0adcff796 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:35.799888 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87728c-18f9-4cc7-8cff-e2f0adcff796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:35.820478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-4d87728c-18f9-4cc7-8cff-e2f0adcff796 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:35.822013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4d87728c-18f9-4cc7-8cff-e2f0adcff796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:35.857132 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:35.894770 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1367/2721] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:35.903936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2305e9-f465-4079-aa39-ab08aaee69c5 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:35.904342 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2305e9-f465-4079-aa39-ab08aaee69c5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:35.904807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2305e9-f465-4079-aa39-ab08aaee69c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:35.928697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-bc2305e9-f465-4079-aa39-ab08aaee69c5 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:35.929919 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-bc2305e9-f465-4079-aa39-ab08aaee69c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:35.938059 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1355/2722] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:35.942374 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87728c-18f9-4cc7-8cff-e2f0adcff796 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:35.952277 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87728c-18f9-4cc7-8cff-e2f0adcff796 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:35.956964 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4a3a9-3674-4aad-abc5-b21caafa01a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:35.957568 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4a3a9-3674-4aad-abc5-b21caafa01a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:35.957853 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4a3a9-3674-4aad-abc5-b21caafa01a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:35.958132 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4a3a9-3674-4aad-abc5-b21caafa01a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:35.958822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4a3a9-3674-4aad-abc5-b21caafa01a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:29:35.959131 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4a3a9-3674-4aad-abc5-b21caafa01a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:35.960748 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4a3a9-3674-4aad-abc5-b21caafa01a9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:35.973307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1368/2723] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:29:35.978115 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2305e9-f465-4079-aa39-ab08aaee69c5 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:35.990072 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2305e9-f465-4079-aa39-ab08aaee69c5 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:35.994882 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415a29e-67b6-4ce6-a26d-0b4e7400a483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:35.995492 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415a29e-67b6-4ce6-a26d-0b4e7400a483 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:35.995783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415a29e-67b6-4ce6-a26d-0b4e7400a483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:35.996081 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415a29e-67b6-4ce6-a26d-0b4e7400a483 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:35.996739 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415a29e-67b6-4ce6-a26d-0b4e7400a483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:35.998661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415a29e-67b6-4ce6-a26d-0b4e7400a483 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:36.010297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:36.033028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1356/2724] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:29:35 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:29:36.037964 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4a3a9-3674-4aad-abc5-b21caafa01a9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:36.053137 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4a3a9-3674-4aad-abc5-b21caafa01a9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:36.110495 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba256e-d591-4fac-a575-1ec5622e081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:36.111130 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba256e-d591-4fac-a575-1ec5622e081c admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:36.111409 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba256e-d591-4fac-a575-1ec5622e081c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:36.111707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba256e-d591-4fac-a575-1ec5622e081c admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:36.112342 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba256e-d591-4fac-a575-1ec5622e081c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:36.114541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba256e-d591-4fac-a575-1ec5622e081c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:36.144685 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1369/2725] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:29:36 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:29:36.149604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415a29e-67b6-4ce6-a26d-0b4e7400a483 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:36.161405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415a29e-67b6-4ce6-a26d-0b4e7400a483 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:36.166155 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea56e6-369d-40b5-8238-b0997e079ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:36.166798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea56e6-369d-40b5-8238-b0997e079ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:36.167084 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea56e6-369d-40b5-8238-b0997e079ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:36.167356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea56e6-369d-40b5-8238-b0997e079ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:36.168588 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea56e6-369d-40b5-8238-b0997e079ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:36.170179 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea56e6-369d-40b5-8238-b0997e079ae1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:36.180825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1357/2726] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:29:36.185647 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba256e-d591-4fac-a575-1ec5622e081c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:36.195839 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba256e-d591-4fac-a575-1ec5622e081c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:36.201079 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1b1ba-506d-4ec3-a99a-82851cdbf461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:36.201687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1b1ba-506d-4ec3-a99a-82851cdbf461 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:36.201974 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1b1ba-506d-4ec3-a99a-82851cdbf461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:36.202246 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1b1ba-506d-4ec3-a99a-82851cdbf461 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:36.202919 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1b1ba-506d-4ec3-a99a-82851cdbf461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:36.204533 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1b1ba-506d-4ec3-a99a-82851cdbf461 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:36.215676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1370/2727] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:29:36.219949 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea56e6-369d-40b5-8238-b0997e079ae1 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:36.230685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea56e6-369d-40b5-8238-b0997e079ae1 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:36.235408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7dec44-b846-4001-82b6-0b07dfa5ba39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:36.236065 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dec44-b846-4001-82b6-0b07dfa5ba39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:36.236350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dec44-b846-4001-82b6-0b07dfa5ba39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:36.236628 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dec44-b846-4001-82b6-0b07dfa5ba39 admin admin] PATH_INFO: `/v3/projects/8b7b2344e7b94d3c8d0d76a0866ec5c6/users/97e4c6d351914409838e060fb208a0ac/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:36.252698 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7dec44-b846-4001-82b6-0b07dfa5ba39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7b2344e7b94d3c8d0d76a0866ec5c6, user_id=97e4c6d351914409838e060fb208a0ac, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:36.255423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7dec44-b846-4001-82b6-0b07dfa5ba39 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:36.271224 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1358/2728] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:29:36 2022] PUT /identity/v3/projects/8b7b2344e7b94d3c8d0d76a0866ec5c6/users/97e4c6d351914409838e060fb208a0ac/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:29:36.276293 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e207e2-dc08-494b-8ee9-2f933caba575 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:36.276784 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e207e2-dc08-494b-8ee9-2f933caba575 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:36.276896 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e207e2-dc08-494b-8ee9-2f933caba575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:36.296814 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-32e207e2-dc08-494b-8ee9-2f933caba575 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:36.298057 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-32e207e2-dc08-494b-8ee9-2f933caba575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:36.358161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1371/2729] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:29:36.371808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7dec44-b846-4001-82b6-0b07dfa5ba39 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:36.373527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-af7dec44-b846-4001-82b6-0b07dfa5ba39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:36.439664 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7dec44-b846-4001-82b6-0b07dfa5ba39 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:36.443448 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441396b1-ea9b-4f0f-9089-7324eb350f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:36.444067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441396b1-ea9b-4f0f-9089-7324eb350f3e service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:36.444351 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441396b1-ea9b-4f0f-9089-7324eb350f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:36.444631 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441396b1-ea9b-4f0f-9089-7324eb350f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:36.455431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441396b1-ea9b-4f0f-9089-7324eb350f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:36.457750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441396b1-ea9b-4f0f-9089-7324eb350f3e service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:36.473185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1359/2730] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:29:40.779025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f9bba-8cff-4730-af12-fd68016c0124 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:40.779908 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f9bba-8cff-4730-af12-fd68016c0124 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:40.780342 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f9bba-8cff-4730-af12-fd68016c0124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:40.818407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-949f9bba-8cff-4730-af12-fd68016c0124 None None] MFA Rules not processed for user `97e4c6d351914409838e060fb208a0ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:40.819665 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-949f9bba-8cff-4730-af12-fd68016c0124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:40.857658 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:40.903139 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1372/2731] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:40.921227 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441396b1-ea9b-4f0f-9089-7324eb350f3e service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:29:40.922875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-441396b1-ea9b-4f0f-9089-7324eb350f3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:41.021808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441396b1-ea9b-4f0f-9089-7324eb350f3e service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:29:41.028677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0a04e-104c-476a-9df6-ac47e0ff948d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:29:41.029304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0a04e-104c-476a-9df6-ac47e0ff948d service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:41.029590 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0a04e-104c-476a-9df6-ac47e0ff948d service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:41.029871 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0a04e-104c-476a-9df6-ac47e0ff948d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:41.038891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0a04e-104c-476a-9df6-ac47e0ff948d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:29:41.040738 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0a04e-104c-476a-9df6-ac47e0ff948d service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:29:41.051848 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1360/2732] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:29:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:29:41.949473 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b0989-a82a-4ad4-8ec2-186d6544c6a8 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:41.950246 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b0989-a82a-4ad4-8ec2-186d6544c6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:41.950246 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b0989-a82a-4ad4-8ec2-186d6544c6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:41.977503 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d71b0989-a82a-4ad4-8ec2-186d6544c6a8 None None] MFA Rules not processed for user `80e4375427934e7387a2590d8a5a2e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:41.978774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d71b0989-a82a-4ad4-8ec2-186d6544c6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:42.044803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1373/2733] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:43.040829 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef75f2a-3fc5-4dcf-bc5a-8698c7fb72dc None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:29:43.041296 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef75f2a-3fc5-4dcf-bc5a-8698c7fb72dc None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:29:43.041393 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef75f2a-3fc5-4dcf-bc5a-8698c7fb72dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:29:43.069789 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9ef75f2a-3fc5-4dcf-bc5a-8698c7fb72dc None None] MFA Rules not processed for user `97e4c6d351914409838e060fb208a0ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:29:43.071306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9ef75f2a-3fc5-4dcf-bc5a-8698c7fb72dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:29:43.094202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1361/2734] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:29:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:29:52.036357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=38 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:29:53.060895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=81,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:30:02.003869 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7160586-ac61-4150-89e7-9ff95510b1d4 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:02.004358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7160586-ac61-4150-89e7-9ff95510b1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:02.004937 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7160586-ac61-4150-89e7-9ff95510b1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:02.036779 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e7160586-ac61-4150-89e7-9ff95510b1d4 None None] MFA Rules not processed for user `71c7a54c598642a4b9219ae21c34f0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:30:02.038091 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e7160586-ac61-4150-89e7-9ff95510b1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:30:02.101046 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1374/2735] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 27 04:30:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:30:02.159408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef75f2a-3fc5-4dcf-bc5a-8698c7fb72dc None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:02.161381 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9ef75f2a-3fc5-4dcf-bc5a-8698c7fb72dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:30:02.244470 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef75f2a-3fc5-4dcf-bc5a-8698c7fb72dc None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:02.249968 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b53eed-7fff-46a6-a9f3-5222f47b6490 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c295a3063c3b45be96b406f586180142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:02.250584 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b53eed-7fff-46a6-a9f3-5222f47b6490 service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:02.250897 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b53eed-7fff-46a6-a9f3-5222f47b6490 service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:02.251180 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b53eed-7fff-46a6-a9f3-5222f47b6490 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:02.259694 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b53eed-7fff-46a6-a9f3-5222f47b6490 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:02.261868 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b53eed-7fff-46a6-a9f3-5222f47b6490 service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:02.270465 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1362/2736] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 27 04:30:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:30:12.093896 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=25 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:30:12.266914 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=32 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:30:17.758822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bcad3-d0ce-46a5-b174-f6107778be35 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:17.759358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bcad3-d0ce-46a5-b174-f6107778be35 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:17.759358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bcad3-d0ce-46a5-b174-f6107778be35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:17.780723 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-110bcad3-d0ce-46a5-b174-f6107778be35 None None] MFA Rules not processed for user `71c7a54c598642a4b9219ae21c34f0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:30:17.781999 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-110bcad3-d0ce-46a5-b174-f6107778be35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:30:17.790012 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1375/2737] 10.222.0.48 () {58 vars in 967 bytes} [Tue Sep 27 04:30:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:30:17.802476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b53eed-7fff-46a6-a9f3-5222f47b6490 service swift] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:17.813360 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b53eed-7fff-46a6-a9f3-5222f47b6490 service swift] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:17.818389 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b347acb-8ed8-4736-abfa-4d2b68cd686d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c295a3063c3b45be96b406f586180142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:17.819076 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b347acb-8ed8-4736-abfa-4d2b68cd686d service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:17.819318 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b347acb-8ed8-4736-abfa-4d2b68cd686d service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:17.819597 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b347acb-8ed8-4736-abfa-4d2b68cd686d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:17.829173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b347acb-8ed8-4736-abfa-4d2b68cd686d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:17.831007 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b347acb-8ed8-4736-abfa-4d2b68cd686d service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:17.840777 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1363/2738] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 27 04:30:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:30:19.795145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bcad3-d0ce-46a5-b174-f6107778be35 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:19.796623 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-110bcad3-d0ce-46a5-b174-f6107778be35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:30:19.812946 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bcad3-d0ce-46a5-b174-f6107778be35 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:19.821730 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9689b-5f3c-4f5a-a527-07154ec7c13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:19.822372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9689b-5f3c-4f5a-a527-07154ec7c13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:19.822653 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9689b-5f3c-4f5a-a527-07154ec7c13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:19.823591 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9689b-5f3c-4f5a-a527-07154ec7c13a admin admin] PATH_INFO: `/v3/users/80e4375427934e7387a2590d8a5a2e0e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:19.824693 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9689b-5f3c-4f5a-a527-07154ec7c13a admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e4375427934e7387a2590d8a5a2e0e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:19.826790 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9689b-5f3c-4f5a-a527-07154ec7c13a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:19.875632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4ec9689b-5f3c-4f5a-a527-07154ec7c13a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e4375427934e7387a2590d8a5a2e0e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:19.883028 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4ec9689b-5f3c-4f5a-a527-07154ec7c13a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e4375427934e7387a2590d8a5a2e0e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:19.897248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4ec9689b-5f3c-4f5a-a527-07154ec7c13a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e4375427934e7387a2590d8a5a2e0e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:19.897976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4ec9689b-5f3c-4f5a-a527-07154ec7c13a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e4375427934e7387a2590d8a5a2e0e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:19.906551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4ec9689b-5f3c-4f5a-a527-07154ec7c13a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e4375427934e7387a2590d8a5a2e0e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:19.912765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1376/2739] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:30:19 2022] DELETE /identity/v3/users/80e4375427934e7387a2590d8a5a2e0e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:30:20.088280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b347acb-8ed8-4736-abfa-4d2b68cd686d service swift] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:20.100139 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b347acb-8ed8-4736-abfa-4d2b68cd686d service swift] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:20.160971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be79aa9-47ac-4290-b0b5-acfd9c526fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:20.161616 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be79aa9-47ac-4290-b0b5-acfd9c526fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:20.161961 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be79aa9-47ac-4290-b0b5-acfd9c526fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:20.162264 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be79aa9-47ac-4290-b0b5-acfd9c526fe3 admin admin] PATH_INFO: `/v3/projects/de503dbe554e4118bd794b6069ebdaab` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:20.163582 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be79aa9-47ac-4290-b0b5-acfd9c526fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de503dbe554e4118bd794b6069ebdaab)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:20.165836 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be79aa9-47ac-4290-b0b5-acfd9c526fe3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:20.212941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4be79aa9-47ac-4290-b0b5-acfd9c526fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de503dbe554e4118bd794b6069ebdaab', 'request_id': 'req-4be79aa9-47ac-4290-b0b5-acfd9c526fe3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:20.218282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4be79aa9-47ac-4290-b0b5-acfd9c526fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de503dbe554e4118bd794b6069ebdaab', 'request_id': 'req-4be79aa9-47ac-4290-b0b5-acfd9c526fe3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:20.224548 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4be79aa9-47ac-4290-b0b5-acfd9c526fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de503dbe554e4118bd794b6069ebdaab', 'request_id': 'req-4be79aa9-47ac-4290-b0b5-acfd9c526fe3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:20.238032 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4be79aa9-47ac-4290-b0b5-acfd9c526fe3 admin admin] The token cache is being invalidate because project de503dbe554e4118bd794b6069ebdaab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:30:20.238321 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4be79aa9-47ac-4290-b0b5-acfd9c526fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:20.238977 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4be79aa9-47ac-4290-b0b5-acfd9c526fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:20.240753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1364/2740] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:30:20 2022] DELETE /identity/v3/projects/de503dbe554e4118bd794b6069ebdaab => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:30:20.246190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74072850-c75b-4f55-b267-43087109709b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:20.246481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74072850-c75b-4f55-b267-43087109709b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:20.246824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74072850-c75b-4f55-b267-43087109709b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:20.267387 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-74072850-c75b-4f55-b267-43087109709b None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:30:20.268598 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-74072850-c75b-4f55-b267-43087109709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:30:20.332303 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1377/2741] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:30:20.396788 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4f811-2891-4a5d-834f-0ce61977f16d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:20.397072 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4f811-2891-4a5d-834f-0ce61977f16d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:20.397380 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4f811-2891-4a5d-834f-0ce61977f16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:20.418520 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-20e4f811-2891-4a5d-834f-0ce61977f16d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:30:20.419812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-20e4f811-2891-4a5d-834f-0ce61977f16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:30:20.427774 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1365/2742] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:30:20.432064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74072850-c75b-4f55-b267-43087109709b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:20.442354 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74072850-c75b-4f55-b267-43087109709b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:20.446976 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c26678-d224-4af9-8c33-edfcb3843d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:20.447583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c26678-d224-4af9-8c33-edfcb3843d7f admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:20.447863 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c26678-d224-4af9-8c33-edfcb3843d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:20.448687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c26678-d224-4af9-8c33-edfcb3843d7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:20.449353 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c26678-d224-4af9-8c33-edfcb3843d7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:30:20.449652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c26678-d224-4af9-8c33-edfcb3843d7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:20.451275 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c26678-d224-4af9-8c33-edfcb3843d7f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:20.463077 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1378/2743] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:30:20.467622 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4f811-2891-4a5d-834f-0ce61977f16d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:20.476807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4f811-2891-4a5d-834f-0ce61977f16d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:20.482168 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d41fa-824e-4c76-ae95-01145f079561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:20.482802 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d41fa-824e-4c76-ae95-01145f079561 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:20.483089 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d41fa-824e-4c76-ae95-01145f079561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:20.483365 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d41fa-824e-4c76-ae95-01145f079561 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:20.484001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d41fa-824e-4c76-ae95-01145f079561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:20.485940 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d41fa-824e-4c76-ae95-01145f079561 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:20.524198 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1366/2744] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:30:20 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:30:20.528551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c26678-d224-4af9-8c33-edfcb3843d7f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:20.538562 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c26678-d224-4af9-8c33-edfcb3843d7f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:20.587469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:30:20.597850 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dfef9-d6ef-4572-8d01-9756ec4c01d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:20.598466 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dfef9-d6ef-4572-8d01-9756ec4c01d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:20.598776 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dfef9-d6ef-4572-8d01-9756ec4c01d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:20.599087 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dfef9-d6ef-4572-8d01-9756ec4c01d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:20.599741 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205dfef9-d6ef-4572-8d01-9756ec4c01d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:20.601720 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205dfef9-d6ef-4572-8d01-9756ec4c01d4 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:20.624811 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1379/2745] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:30:20 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:30:20.629028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d41fa-824e-4c76-ae95-01145f079561 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:20.639527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d41fa-824e-4c76-ae95-01145f079561 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:20.644221 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadd10b-a38e-4a19-b151-70a12240227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:20.644832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadd10b-a38e-4a19-b151-70a12240227b admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:20.645268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadd10b-a38e-4a19-b151-70a12240227b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:20.645387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadd10b-a38e-4a19-b151-70a12240227b admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:20.646167 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadd10b-a38e-4a19-b151-70a12240227b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:20.647832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadd10b-a38e-4a19-b151-70a12240227b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:20.658202 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1367/2746] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:30:20.662202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dfef9-d6ef-4572-8d01-9756ec4c01d4 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:20.672796 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dfef9-d6ef-4572-8d01-9756ec4c01d4 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:20.677373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ea34b-97da-450b-a404-50b9620d4a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:20.677965 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ea34b-97da-450b-a404-50b9620d4a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:20.678245 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ea34b-97da-450b-a404-50b9620d4a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:20.678520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ea34b-97da-450b-a404-50b9620d4a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:20.679198 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ea34b-97da-450b-a404-50b9620d4a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:20.680788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ea34b-97da-450b-a404-50b9620d4a31 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:20.691903 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1380/2747] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:30:20.696645 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadd10b-a38e-4a19-b151-70a12240227b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:20.706968 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadd10b-a38e-4a19-b151-70a12240227b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:20.711953 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd083771-d6aa-489f-bab9-c9e279269b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:20.712618 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd083771-d6aa-489f-bab9-c9e279269b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:20.712900 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd083771-d6aa-489f-bab9-c9e279269b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:20.713178 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd083771-d6aa-489f-bab9-c9e279269b17 admin admin] PATH_INFO: `/v3/projects/e3bf1c3778274f418c6ed46e2913934d/users/a2450198bcdc4e4a89b6ace92fec157f/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:20.728499 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd083771-d6aa-489f-bab9-c9e279269b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3bf1c3778274f418c6ed46e2913934d, user_id=a2450198bcdc4e4a89b6ace92fec157f, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:20.731692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd083771-d6aa-489f-bab9-c9e279269b17 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:20.746024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1368/2748] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:30:20 2022] PUT /identity/v3/projects/e3bf1c3778274f418c6ed46e2913934d/users/a2450198bcdc4e4a89b6ace92fec157f/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:30:20.756413 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336159d1-f5d0-4f16-b9b5-9473421e97a2 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:20.756815 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336159d1-f5d0-4f16-b9b5-9473421e97a2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:20.757202 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336159d1-f5d0-4f16-b9b5-9473421e97a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:20.784902 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-336159d1-f5d0-4f16-b9b5-9473421e97a2 None None] MFA Rules not processed for user `a2450198bcdc4e4a89b6ace92fec157f`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:30:20.786112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-336159d1-f5d0-4f16-b9b5-9473421e97a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:30:20.852073 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1381/2749] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:30:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:30:20.863885 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd083771-d6aa-489f-bab9-c9e279269b17 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:20.865862 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cd083771-d6aa-489f-bab9-c9e279269b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:30:20.872334 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:30:20.926807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd083771-d6aa-489f-bab9-c9e279269b17 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:20.930398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeeb0ca-fa9a-483a-88de-9d41b0432ed0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:20.931048 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeeb0ca-fa9a-483a-88de-9d41b0432ed0 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:20.931332 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeeb0ca-fa9a-483a-88de-9d41b0432ed0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:20.931604 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeeb0ca-fa9a-483a-88de-9d41b0432ed0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:20.940289 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeeb0ca-fa9a-483a-88de-9d41b0432ed0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:20.941742 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeeb0ca-fa9a-483a-88de-9d41b0432ed0 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:20.951172 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1369/2750] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:30:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:30:30.849162 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:30:30.946840 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=24 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:30:55.119055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336159d1-f5d0-4f16-b9b5-9473421e97a2 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:55.181635 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336159d1-f5d0-4f16-b9b5-9473421e97a2 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:55.186913 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e7b9e-1123-4961-b690-25857cc4beda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:55.187546 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e7b9e-1123-4961-b690-25857cc4beda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:55.187872 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e7b9e-1123-4961-b690-25857cc4beda admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:55.188123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e7b9e-1123-4961-b690-25857cc4beda admin admin] PATH_INFO: `/v3/users/a2450198bcdc4e4a89b6ace92fec157f` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:55.189314 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e7b9e-1123-4961-b690-25857cc4beda admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2450198bcdc4e4a89b6ace92fec157f)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:55.191278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e7b9e-1123-4961-b690-25857cc4beda admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:55.237157 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1e5e7b9e-1123-4961-b690-25857cc4beda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2450198bcdc4e4a89b6ace92fec157f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:55.244172 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1e5e7b9e-1123-4961-b690-25857cc4beda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2450198bcdc4e4a89b6ace92fec157f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:55.256274 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1e5e7b9e-1123-4961-b690-25857cc4beda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2450198bcdc4e4a89b6ace92fec157f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:55.256964 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1e5e7b9e-1123-4961-b690-25857cc4beda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2450198bcdc4e4a89b6ace92fec157f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:55.263905 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1e5e7b9e-1123-4961-b690-25857cc4beda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2450198bcdc4e4a89b6ace92fec157f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:55.269595 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1382/2751] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:30:55 2022] DELETE /identity/v3/users/a2450198bcdc4e4a89b6ace92fec157f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:30:55.274174 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535217f5-b3b8-46a8-90e2-a50033d2217d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:55.274704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535217f5-b3b8-46a8-90e2-a50033d2217d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:55.274704 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535217f5-b3b8-46a8-90e2-a50033d2217d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:55.294243 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-535217f5-b3b8-46a8-90e2-a50033d2217d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:30:55.295476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-535217f5-b3b8-46a8-90e2-a50033d2217d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:30:55.351452 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1370/2752] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:30:55.361575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e7b9e-1123-4961-b690-25857cc4beda admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:55.362999 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1e5e7b9e-1123-4961-b690-25857cc4beda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:30:55.420012 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e7b9e-1123-4961-b690-25857cc4beda admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:55.423822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f43ad8-641f-43f7-a4b7-08fc4c793aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:55.424429 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f43ad8-641f-43f7-a4b7-08fc4c793aba service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:55.424713 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f43ad8-641f-43f7-a4b7-08fc4c793aba service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:55.424989 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f43ad8-641f-43f7-a4b7-08fc4c793aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:55.434028 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f43ad8-641f-43f7-a4b7-08fc4c793aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:55.435492 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f43ad8-641f-43f7-a4b7-08fc4c793aba service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:55.444821 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1383/2753] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:30:55.707007 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535217f5-b3b8-46a8-90e2-a50033d2217d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:55.708437 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-535217f5-b3b8-46a8-90e2-a50033d2217d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:30:55.721130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535217f5-b3b8-46a8-90e2-a50033d2217d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:55.727287 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccf328-e405-4235-9d36-0351c3bdf97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:55.728165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccf328-e405-4235-9d36-0351c3bdf97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:55.728486 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccf328-e405-4235-9d36-0351c3bdf97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:55.728824 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccf328-e405-4235-9d36-0351c3bdf97b admin admin] PATH_INFO: `/v3/projects/e3bf1c3778274f418c6ed46e2913934d` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:55.730408 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccf328-e405-4235-9d36-0351c3bdf97b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3bf1c3778274f418c6ed46e2913934d)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:55.733480 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccf328-e405-4235-9d36-0351c3bdf97b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:55.782519 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-15ccf328-e405-4235-9d36-0351c3bdf97b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3bf1c3778274f418c6ed46e2913934d', 'request_id': 'req-15ccf328-e405-4235-9d36-0351c3bdf97b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:55.788258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-15ccf328-e405-4235-9d36-0351c3bdf97b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3bf1c3778274f418c6ed46e2913934d', 'request_id': 'req-15ccf328-e405-4235-9d36-0351c3bdf97b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:55.794605 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-15ccf328-e405-4235-9d36-0351c3bdf97b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3bf1c3778274f418c6ed46e2913934d', 'request_id': 'req-15ccf328-e405-4235-9d36-0351c3bdf97b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:55.807670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-15ccf328-e405-4235-9d36-0351c3bdf97b admin admin] The token cache is being invalidate because project e3bf1c3778274f418c6ed46e2913934d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:30:55.807966 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-15ccf328-e405-4235-9d36-0351c3bdf97b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:55.808761 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-15ccf328-e405-4235-9d36-0351c3bdf97b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:30:55.810249 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1371/2754] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:30:55 2022] DELETE /identity/v3/projects/e3bf1c3778274f418c6ed46e2913934d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:30:55.816278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb74c03-a518-46ba-9b73-b71f7c114d7c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:55.816562 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb74c03-a518-46ba-9b73-b71f7c114d7c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:55.816834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb74c03-a518-46ba-9b73-b71f7c114d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:55.836461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ccb74c03-a518-46ba-9b73-b71f7c114d7c None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:30:55.837588 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ccb74c03-a518-46ba-9b73-b71f7c114d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:30:55.854631 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:30:55.897694 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1384/2755] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:30:55.907419 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794fe2a-18c7-4375-b8f7-079f74f85dd9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:55.907705 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794fe2a-18c7-4375-b8f7-079f74f85dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:55.908027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794fe2a-18c7-4375-b8f7-079f74f85dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:55.927304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-0794fe2a-18c7-4375-b8f7-079f74f85dd9 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:30:55.928501 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0794fe2a-18c7-4375-b8f7-079f74f85dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:30:55.936288 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1372/2756] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:30:55.940452 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb74c03-a518-46ba-9b73-b71f7c114d7c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:55.950695 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb74c03-a518-46ba-9b73-b71f7c114d7c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:55.955255 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932d7a9-e63a-4646-a129-70bcad092d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:55.955851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932d7a9-e63a-4646-a129-70bcad092d93 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:55.956135 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932d7a9-e63a-4646-a129-70bcad092d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:55.956414 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932d7a9-e63a-4646-a129-70bcad092d93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:55.957069 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932d7a9-e63a-4646-a129-70bcad092d93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:30:55.957380 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932d7a9-e63a-4646-a129-70bcad092d93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:55.959025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932d7a9-e63a-4646-a129-70bcad092d93 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:55.971113 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1385/2757] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:30:55.975143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794fe2a-18c7-4375-b8f7-079f74f85dd9 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:55.984182 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794fe2a-18c7-4375-b8f7-079f74f85dd9 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:55.988792 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9462e54-dfa8-4a00-ba59-94a110e184a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:55.989623 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9462e54-dfa8-4a00-ba59-94a110e184a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:55.989902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9462e54-dfa8-4a00-ba59-94a110e184a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:55.990175 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9462e54-dfa8-4a00-ba59-94a110e184a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:55.990840 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9462e54-dfa8-4a00-ba59-94a110e184a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:55.992984 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9462e54-dfa8-4a00-ba59-94a110e184a5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:56.019911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1373/2758] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:30:55 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:30:56.023972 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932d7a9-e63a-4646-a129-70bcad092d93 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:56.034520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932d7a9-e63a-4646-a129-70bcad092d93 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:56.090330 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e769826-e008-49ab-84f1-ac1bb1f3705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:56.090891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e769826-e008-49ab-84f1-ac1bb1f3705c admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:56.091174 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e769826-e008-49ab-84f1-ac1bb1f3705c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:56.091447 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e769826-e008-49ab-84f1-ac1bb1f3705c admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:56.092082 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e769826-e008-49ab-84f1-ac1bb1f3705c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:56.093993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e769826-e008-49ab-84f1-ac1bb1f3705c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:56.114079 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1386/2759] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:30:56 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:30:56.118468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9462e54-dfa8-4a00-ba59-94a110e184a5 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:56.129283 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9462e54-dfa8-4a00-ba59-94a110e184a5 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:56.133910 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b4252-c24f-4b0f-ae27-63106b9152d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:56.134501 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b4252-c24f-4b0f-ae27-63106b9152d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:56.134819 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b4252-c24f-4b0f-ae27-63106b9152d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:56.135096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b4252-c24f-4b0f-ae27-63106b9152d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:56.135740 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b4252-c24f-4b0f-ae27-63106b9152d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:56.137976 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b4252-c24f-4b0f-ae27-63106b9152d2 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:56.147691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1374/2760] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:30:56.151366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e769826-e008-49ab-84f1-ac1bb1f3705c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:56.161111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e769826-e008-49ab-84f1-ac1bb1f3705c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:56.165639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf8a07-dc65-4917-89df-3934fb8dc831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:56.166219 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf8a07-dc65-4917-89df-3934fb8dc831 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:56.166500 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf8a07-dc65-4917-89df-3934fb8dc831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:56.166806 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf8a07-dc65-4917-89df-3934fb8dc831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:56.167435 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf8a07-dc65-4917-89df-3934fb8dc831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:56.171132 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf8a07-dc65-4917-89df-3934fb8dc831 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:56.181637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1387/2761] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:30:56.186205 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b4252-c24f-4b0f-ae27-63106b9152d2 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:56.195998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b4252-c24f-4b0f-ae27-63106b9152d2 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:56.201165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eeee7d-9417-44bc-bae1-7a03954a674f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:56.201799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eeee7d-9417-44bc-bae1-7a03954a674f admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:56.202080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eeee7d-9417-44bc-bae1-7a03954a674f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:56.202355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eeee7d-9417-44bc-bae1-7a03954a674f admin admin] PATH_INFO: `/v3/projects/08759b42dc2c417db0a9eaaa89d75287/users/fdbe99c6de564e91b43ef11676fddf87/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:56.216391 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eeee7d-9417-44bc-bae1-7a03954a674f admin admin] RBAC: Authorizing `identity:create_grant(project_id=08759b42dc2c417db0a9eaaa89d75287, user_id=fdbe99c6de564e91b43ef11676fddf87, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:56.219067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eeee7d-9417-44bc-bae1-7a03954a674f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:56.231650 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1375/2762] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:30:56 2022] PUT /identity/v3/projects/08759b42dc2c417db0a9eaaa89d75287/users/fdbe99c6de564e91b43ef11676fddf87/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:30:56.236461 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77bc18-ff22-49ca-8c1d-4db019383f80 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:56.236744 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77bc18-ff22-49ca-8c1d-4db019383f80 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:56.237017 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77bc18-ff22-49ca-8c1d-4db019383f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:56.256180 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-3f77bc18-ff22-49ca-8c1d-4db019383f80 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:30:56.257368 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3f77bc18-ff22-49ca-8c1d-4db019383f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:30:56.314518 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1388/2763] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:30:56.323900 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eeee7d-9417-44bc-bae1-7a03954a674f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:30:56.326130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-68eeee7d-9417-44bc-bae1-7a03954a674f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:30:56.347732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:30:56.384917 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eeee7d-9417-44bc-bae1-7a03954a674f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:30:56.389146 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71498830-c05c-4538-bc30-2df85663f6f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:30:56.389744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71498830-c05c-4538-bc30-2df85663f6f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:30:56.390027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71498830-c05c-4538-bc30-2df85663f6f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:30:56.390304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71498830-c05c-4538-bc30-2df85663f6f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:30:56.399583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71498830-c05c-4538-bc30-2df85663f6f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:30:56.400759 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71498830-c05c-4538-bc30-2df85663f6f5 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:30:56.410398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1376/2764] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:30:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:31:00.509412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc54c13-4157-4640-90fc-cd6d87a4be2d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:31:00.509911 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc54c13-4157-4640-90fc-cd6d87a4be2d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:31:00.510010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc54c13-4157-4640-90fc-cd6d87a4be2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:31:00.539364 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-afc54c13-4157-4640-90fc-cd6d87a4be2d None None] MFA Rules not processed for user `fdbe99c6de564e91b43ef11676fddf87`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:31:00.540503 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-afc54c13-4157-4640-90fc-cd6d87a4be2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:31:00.557248 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:31:00.627082 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1389/2765] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:31:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:31:00.631568 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71498830-c05c-4538-bc30-2df85663f6f5 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:31:00.646313 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71498830-c05c-4538-bc30-2df85663f6f5 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:31:00.652541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbeac0-787c-4dda-8cb4-e180110a2431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:31:00.653161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbeac0-787c-4dda-8cb4-e180110a2431 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:31:00.653444 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbeac0-787c-4dda-8cb4-e180110a2431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:31:00.653718 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbeac0-787c-4dda-8cb4-e180110a2431 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:31:00.654368 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbeac0-787c-4dda-8cb4-e180110a2431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:31:00.656527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbeac0-787c-4dda-8cb4-e180110a2431 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:31:00.685691 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1377/2766] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:31:00 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:31:00.689866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc54c13-4157-4640-90fc-cd6d87a4be2d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:31:00.701459 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc54c13-4157-4640-90fc-cd6d87a4be2d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:31:00.768232 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcf1ac-5937-4561-9523-65fca23544a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:31:00.768847 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcf1ac-5937-4561-9523-65fca23544a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:31:00.769126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcf1ac-5937-4561-9523-65fca23544a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:31:00.769389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcf1ac-5937-4561-9523-65fca23544a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:31:00.770087 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcf1ac-5937-4561-9523-65fca23544a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:31:00.772193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcf1ac-5937-4561-9523-65fca23544a0 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:31:00.794670 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1390/2767] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:31:00 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:31:00.798628 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbeac0-787c-4dda-8cb4-e180110a2431 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:31:00.809820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbeac0-787c-4dda-8cb4-e180110a2431 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:31:00.814457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc07a49-1e98-4415-92cf-4cf6f3a6d973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:31:00.815214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc07a49-1e98-4415-92cf-4cf6f3a6d973 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:31:00.815503 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc07a49-1e98-4415-92cf-4cf6f3a6d973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:31:00.815780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc07a49-1e98-4415-92cf-4cf6f3a6d973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:31:00.816467 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc07a49-1e98-4415-92cf-4cf6f3a6d973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:31:00.818075 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc07a49-1e98-4415-92cf-4cf6f3a6d973 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:31:00.833053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1378/2768] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:31:00.834360 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcf1ac-5937-4561-9523-65fca23544a0 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:31:00.844656 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcf1ac-5937-4561-9523-65fca23544a0 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:31:00.849356 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066498aa-80cf-42d0-b321-9d696b531271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:31:00.849960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066498aa-80cf-42d0-b321-9d696b531271 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:31:00.850238 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066498aa-80cf-42d0-b321-9d696b531271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:31:00.850514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066498aa-80cf-42d0-b321-9d696b531271 admin admin] PATH_INFO: `/v3/projects/119862207aab407b8c9082592b3c6f9d/users/5cbbbecd7b4344a591eabe5a265fc1d1/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:31:00.866603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066498aa-80cf-42d0-b321-9d696b531271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=119862207aab407b8c9082592b3c6f9d, user_id=5cbbbecd7b4344a591eabe5a265fc1d1, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:31:00.869405 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066498aa-80cf-42d0-b321-9d696b531271 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:31:00.883985 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1391/2769] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:31:00 2022] PUT /identity/v3/projects/119862207aab407b8c9082592b3c6f9d/users/5cbbbecd7b4344a591eabe5a265fc1d1/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:31:00.888475 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc07a49-1e98-4415-92cf-4cf6f3a6d973 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:31:00.898807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc07a49-1e98-4415-92cf-4cf6f3a6d973 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:31:00.958337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de4a8a-6346-4e85-b03e-1887447b33ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:31:00.959022 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de4a8a-6346-4e85-b03e-1887447b33ce admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:31:00.959300 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de4a8a-6346-4e85-b03e-1887447b33ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:31:00.959580 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de4a8a-6346-4e85-b03e-1887447b33ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:31:00.960243 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de4a8a-6346-4e85-b03e-1887447b33ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:31:00.961883 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de4a8a-6346-4e85-b03e-1887447b33ce admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:31:00.975385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1379/2770] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:31:00.979175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066498aa-80cf-42d0-b321-9d696b531271 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:31:00.991556 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066498aa-80cf-42d0-b321-9d696b531271 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:31:00.996983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b02ce-8e4b-4d77-9090-2a94c2a452c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:31:00.997639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b02ce-8e4b-4d77-9090-2a94c2a452c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:31:00.997920 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b02ce-8e4b-4d77-9090-2a94c2a452c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:31:00.998761 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b02ce-8e4b-4d77-9090-2a94c2a452c6 admin admin] PATH_INFO: `/v3/projects/119862207aab407b8c9082592b3c6f9d/users/5cbbbecd7b4344a591eabe5a265fc1d1/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:31:01.003370 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b02ce-8e4b-4d77-9090-2a94c2a452c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=119862207aab407b8c9082592b3c6f9d, user_id=5cbbbecd7b4344a591eabe5a265fc1d1, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:31:01.007044 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b02ce-8e4b-4d77-9090-2a94c2a452c6 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:31:01.035027 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1392/2771] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:31:00 2022] PUT /identity/v3/projects/119862207aab407b8c9082592b3c6f9d/users/5cbbbecd7b4344a591eabe5a265fc1d1/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:31:05.358039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434c620-e140-4cfd-a440-74d1f2ebf07f None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:31:05.358571 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434c620-e140-4cfd-a440-74d1f2ebf07f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:31:05.358674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434c620-e140-4cfd-a440-74d1f2ebf07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:31:05.390145 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e434c620-e140-4cfd-a440-74d1f2ebf07f None None] MFA Rules not processed for user `5cbbbecd7b4344a591eabe5a265fc1d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:31:05.391417 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e434c620-e140-4cfd-a440-74d1f2ebf07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:31:05.467565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1380/2772] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:31:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:31:05.488488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b02ce-8e4b-4d77-9090-2a94c2a452c6 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:31:05.490546 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f32b02ce-8e4b-4d77-9090-2a94c2a452c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:31:05.574482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b02ce-8e4b-4d77-9090-2a94c2a452c6 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:31:05.580269 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d812b-f2a5-4a1d-b9b9-6aae90bab12c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:31:05.580974 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d812b-f2a5-4a1d-b9b9-6aae90bab12c service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:31:05.581253 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d812b-f2a5-4a1d-b9b9-6aae90bab12c service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:31:05.581524 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d812b-f2a5-4a1d-b9b9-6aae90bab12c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:31:05.587001 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:31:05.649975 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d812b-f2a5-4a1d-b9b9-6aae90bab12c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:31:05.651624 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d812b-f2a5-4a1d-b9b9-6aae90bab12c service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:31:05.661592 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1393/2773] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:31:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:31:06.684113 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cd092-61dc-4bd3-8957-1b1b34c6b124 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:31:06.684661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cd092-61dc-4bd3-8957-1b1b34c6b124 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:31:06.684891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cd092-61dc-4bd3-8957-1b1b34c6b124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:31:06.708695 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1b5cd092-61dc-4bd3-8957-1b1b34c6b124 None None] MFA Rules not processed for user `fdbe99c6de564e91b43ef11676fddf87`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:31:06.709947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1b5cd092-61dc-4bd3-8957-1b1b34c6b124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:31:06.729169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1381/2774] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:31:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:31:15.657077 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=24 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:31:16.702893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:31:17.066766 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d812b-f2a5-4a1d-b9b9-6aae90bab12c service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:31:17.122067 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d812b-f2a5-4a1d-b9b9-6aae90bab12c service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:31:17.126231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2d273-e523-4857-bf66-33a0ccf793ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:31:17.126871 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2d273-e523-4857-bf66-33a0ccf793ef service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:31:17.127154 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2d273-e523-4857-bf66-33a0ccf793ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:31:17.127432 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2d273-e523-4857-bf66-33a0ccf793ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:31:17.129185 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-35d2d273-e523-4857-bf66-33a0ccf793ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:31:17.139355 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2d273-e523-4857-bf66-33a0ccf793ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:31:17.140789 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2d273-e523-4857-bf66-33a0ccf793ef service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:31:17.148840 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1394/2775] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:31:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:31:23.127459 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cd092-61dc-4bd3-8957-1b1b34c6b124 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:31:23.128889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1b5cd092-61dc-4bd3-8957-1b1b34c6b124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:31:23.182865 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cd092-61dc-4bd3-8957-1b1b34c6b124 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:31:23.186895 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200e1b7-5f5c-4065-b0fc-ace9defc4e22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:31:23.187912 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200e1b7-5f5c-4065-b0fc-ace9defc4e22 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:31:23.189331 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200e1b7-5f5c-4065-b0fc-ace9defc4e22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:31:23.189607 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200e1b7-5f5c-4065-b0fc-ace9defc4e22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:31:23.191336 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5200e1b7-5f5c-4065-b0fc-ace9defc4e22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:31:23.205106 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200e1b7-5f5c-4065-b0fc-ace9defc4e22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:31:23.206527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200e1b7-5f5c-4065-b0fc-ace9defc4e22 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:31:23.217148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1382/2776] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:31:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:31:27.145171 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=26 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:31:30.952960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2d273-e523-4857-bf66-33a0ccf793ef service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:31:30.962154 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2d273-e523-4857-bf66-33a0ccf793ef service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:31:30.965702 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1507b-6f7c-4f29-a945-12182a69fd8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:31:30.966290 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1507b-6f7c-4f29-a945-12182a69fd8b service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:31:30.966569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1507b-6f7c-4f29-a945-12182a69fd8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:31:30.966879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1507b-6f7c-4f29-a945-12182a69fd8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:31:30.968594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0ba1507b-6f7c-4f29-a945-12182a69fd8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:31:30.981632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1507b-6f7c-4f29-a945-12182a69fd8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:31:30.983598 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1507b-6f7c-4f29-a945-12182a69fd8b service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:31:30.994792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1395/2777] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:31:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:31:33.212370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=26 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:31:40.989928 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=6 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:32:26.565449 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200e1b7-5f5c-4065-b0fc-ace9defc4e22 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:32:26.567042 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5200e1b7-5f5c-4065-b0fc-ace9defc4e22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:32:26.644073 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200e1b7-5f5c-4065-b0fc-ace9defc4e22 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:32:26.649551 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4be747-5c5e-4710-9a4a-14dca8866dc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efd209a50a994b7c8485f2996697218b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:32:26.650252 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4be747-5c5e-4710-9a4a-14dca8866dc6 service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:32:26.651069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4be747-5c5e-4710-9a4a-14dca8866dc6 service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:32:26.651527 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4be747-5c5e-4710-9a4a-14dca8866dc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:32:26.653345 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5f4be747-5c5e-4710-9a4a-14dca8866dc6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:32:26.666129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4be747-5c5e-4710-9a4a-14dca8866dc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:32:26.667903 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4be747-5c5e-4710-9a4a-14dca8866dc6 service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:32:26.678775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1383/2778] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:32:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:32:29.750649 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1507b-6f7c-4f29-a945-12182a69fd8b service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:32:29.814256 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1507b-6f7c-4f29-a945-12182a69fd8b service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:32:29.819015 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cec2f-14f2-446b-af60-d9a70216bee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:32:29.819694 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cec2f-14f2-446b-af60-d9a70216bee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:32:29.819979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cec2f-14f2-446b-af60-d9a70216bee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:32:29.820254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cec2f-14f2-446b-af60-d9a70216bee1 admin admin] PATH_INFO: `/v3/users/fdbe99c6de564e91b43ef11676fddf87` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:32:29.821406 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cec2f-14f2-446b-af60-d9a70216bee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdbe99c6de564e91b43ef11676fddf87)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:32:29.823483 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cec2f-14f2-446b-af60-d9a70216bee1 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:32:29.869327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-399cec2f-14f2-446b-af60-d9a70216bee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdbe99c6de564e91b43ef11676fddf87'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:29.877278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-399cec2f-14f2-446b-af60-d9a70216bee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdbe99c6de564e91b43ef11676fddf87'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:29.889409 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-399cec2f-14f2-446b-af60-d9a70216bee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdbe99c6de564e91b43ef11676fddf87'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:29.890843 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-399cec2f-14f2-446b-af60-d9a70216bee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdbe99c6de564e91b43ef11676fddf87'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:29.897820 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-399cec2f-14f2-446b-af60-d9a70216bee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdbe99c6de564e91b43ef11676fddf87'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:29.903747 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1396/2779] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:32:29 2022] DELETE /identity/v3/users/fdbe99c6de564e91b43ef11676fddf87 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:32:30.071606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4be747-5c5e-4710-9a4a-14dca8866dc6 service placement] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:32:30.082951 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4be747-5c5e-4710-9a4a-14dca8866dc6 service placement] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:32:30.139642 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cda941-e016-40ab-9bb2-e38a4e863e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:32:30.140306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cda941-e016-40ab-9bb2-e38a4e863e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:32:30.140596 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cda941-e016-40ab-9bb2-e38a4e863e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:32:30.140879 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cda941-e016-40ab-9bb2-e38a4e863e30 admin admin] PATH_INFO: `/v3/projects/08759b42dc2c417db0a9eaaa89d75287` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:32:30.142023 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cda941-e016-40ab-9bb2-e38a4e863e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08759b42dc2c417db0a9eaaa89d75287)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:32:30.143981 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cda941-e016-40ab-9bb2-e38a4e863e30 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:32:30.188617 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-01cda941-e016-40ab-9bb2-e38a4e863e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08759b42dc2c417db0a9eaaa89d75287', 'request_id': 'req-01cda941-e016-40ab-9bb2-e38a4e863e30'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:30.194181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-01cda941-e016-40ab-9bb2-e38a4e863e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08759b42dc2c417db0a9eaaa89d75287', 'request_id': 'req-01cda941-e016-40ab-9bb2-e38a4e863e30'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:30.200269 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-01cda941-e016-40ab-9bb2-e38a4e863e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08759b42dc2c417db0a9eaaa89d75287', 'request_id': 'req-01cda941-e016-40ab-9bb2-e38a4e863e30'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:30.212832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-01cda941-e016-40ab-9bb2-e38a4e863e30 admin admin] The token cache is being invalidate because project 08759b42dc2c417db0a9eaaa89d75287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:32:30.213121 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-01cda941-e016-40ab-9bb2-e38a4e863e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:30.213759 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-01cda941-e016-40ab-9bb2-e38a4e863e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:30.215277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1384/2780] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:32:30 2022] DELETE /identity/v3/projects/08759b42dc2c417db0a9eaaa89d75287 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:32:30.219312 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cec2f-14f2-446b-af60-d9a70216bee1 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:32:30.220803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-399cec2f-14f2-446b-af60-d9a70216bee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:32:30.234268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cec2f-14f2-446b-af60-d9a70216bee1 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:32:30.290677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664d8bb-1310-481d-9d78-8c63fdb34626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:32:30.291256 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d8bb-1310-481d-9d78-8c63fdb34626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:32:30.291538 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d8bb-1310-481d-9d78-8c63fdb34626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:32:30.291815 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d8bb-1310-481d-9d78-8c63fdb34626 admin admin] PATH_INFO: `/v3/users/5cbbbecd7b4344a591eabe5a265fc1d1` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:32:30.292940 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664d8bb-1310-481d-9d78-8c63fdb34626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cbbbecd7b4344a591eabe5a265fc1d1)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:32:30.294901 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664d8bb-1310-481d-9d78-8c63fdb34626 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:32:30.316668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:32:30.342139 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5664d8bb-1310-481d-9d78-8c63fdb34626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cbbbecd7b4344a591eabe5a265fc1d1'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:30.348845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5664d8bb-1310-481d-9d78-8c63fdb34626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cbbbecd7b4344a591eabe5a265fc1d1'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:30.361340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5664d8bb-1310-481d-9d78-8c63fdb34626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cbbbecd7b4344a591eabe5a265fc1d1'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:30.362005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5664d8bb-1310-481d-9d78-8c63fdb34626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cbbbecd7b4344a591eabe5a265fc1d1'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:30.369059 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5664d8bb-1310-481d-9d78-8c63fdb34626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cbbbecd7b4344a591eabe5a265fc1d1'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:30.375520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1397/2781] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:32:30 2022] DELETE /identity/v3/users/5cbbbecd7b4344a591eabe5a265fc1d1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:32:30.552442 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cda941-e016-40ab-9bb2-e38a4e863e30 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:32:30.553985 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-01cda941-e016-40ab-9bb2-e38a4e863e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:32:30.567052 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cda941-e016-40ab-9bb2-e38a4e863e30 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:32:30.583875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:32:30.625936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efbc60-38f7-415b-bec3-d841831cff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:32:30.626575 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efbc60-38f7-415b-bec3-d841831cff84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:32:30.626893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efbc60-38f7-415b-bec3-d841831cff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:32:30.627174 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efbc60-38f7-415b-bec3-d841831cff84 admin admin] PATH_INFO: `/v3/projects/119862207aab407b8c9082592b3c6f9d` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:32:30.628299 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efbc60-38f7-415b-bec3-d841831cff84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=119862207aab407b8c9082592b3c6f9d)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:32:30.630223 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efbc60-38f7-415b-bec3-d841831cff84 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:32:30.676001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-23efbc60-38f7-415b-bec3-d841831cff84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119862207aab407b8c9082592b3c6f9d', 'request_id': 'req-23efbc60-38f7-415b-bec3-d841831cff84'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:30.681395 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-23efbc60-38f7-415b-bec3-d841831cff84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119862207aab407b8c9082592b3c6f9d', 'request_id': 'req-23efbc60-38f7-415b-bec3-d841831cff84'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:30.687392 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-23efbc60-38f7-415b-bec3-d841831cff84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119862207aab407b8c9082592b3c6f9d', 'request_id': 'req-23efbc60-38f7-415b-bec3-d841831cff84'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:30.699623 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-23efbc60-38f7-415b-bec3-d841831cff84 admin admin] The token cache is being invalidate because project 119862207aab407b8c9082592b3c6f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:32:30.699912 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-23efbc60-38f7-415b-bec3-d841831cff84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:30.700545 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-23efbc60-38f7-415b-bec3-d841831cff84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:32:30.702007 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1385/2782] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:32:30 2022] DELETE /identity/v3/projects/119862207aab407b8c9082592b3c6f9d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:32:40.371539 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:32:40.696526 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:34:15.104254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664d8bb-1310-481d-9d78-8c63fdb34626 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:34:15.105927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5664d8bb-1310-481d-9d78-8c63fdb34626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:34:15.250118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664d8bb-1310-481d-9d78-8c63fdb34626 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:34:15.301321 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efbc60-38f7-415b-bec3-d841831cff84 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:34:15.303421 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-23efbc60-38f7-415b-bec3-d841831cff84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:34:15.379929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e6701-ff91-4ae1-9834-ec42e4608693 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:34:15.380926 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e6701-ff91-4ae1-9834-ec42e4608693 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:34:15.381447 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e6701-ff91-4ae1-9834-ec42e4608693 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:34:15.381887 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e6701-ff91-4ae1-9834-ec42e4608693 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:34:15.385478 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-629e6701-ff91-4ae1-9834-ec42e4608693 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:34:15.401971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e6701-ff91-4ae1-9834-ec42e4608693 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:34:15.403785 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e6701-ff91-4ae1-9834-ec42e4608693 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:34:15.410552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efbc60-38f7-415b-bec3-d841831cff84 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:34:15.416476 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91a817-b6ad-4c20-9b8d-7bc62cb3da2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efd209a50a994b7c8485f2996697218b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:34:15.417116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91a817-b6ad-4c20-9b8d-7bc62cb3da2f service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:34:15.417402 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91a817-b6ad-4c20-9b8d-7bc62cb3da2f service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:34:15.417846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91a817-b6ad-4c20-9b8d-7bc62cb3da2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:34:15.419662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cd91a817-b6ad-4c20-9b8d-7bc62cb3da2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:34:15.426833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1398/2783] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:34:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:34:15.433635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91a817-b6ad-4c20-9b8d-7bc62cb3da2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:34:15.435457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91a817-b6ad-4c20-9b8d-7bc62cb3da2f service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:34:15.447689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1386/2784] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:34:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:34:18.577596 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c1161-b15e-45ba-b3a5-b042ba1276bf None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:34:18.578295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c1161-b15e-45ba-b3a5-b042ba1276bf None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:34:18.578295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c1161-b15e-45ba-b3a5-b042ba1276bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:34:18.599649 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e64c1161-b15e-45ba-b3a5-b042ba1276bf None None] MFA Rules not processed for user `97e4c6d351914409838e060fb208a0ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:34:18.600906 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e64c1161-b15e-45ba-b3a5-b042ba1276bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:34:18.656628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1399/2785] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:34:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:34:18.971493 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91a817-b6ad-4c20-9b8d-7bc62cb3da2f service placement] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:34:18.973171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cd91a817-b6ad-4c20-9b8d-7bc62cb3da2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:34:19.029371 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91a817-b6ad-4c20-9b8d-7bc62cb3da2f service placement] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:34:19.032941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c225253-5783-486b-8e33-640c6aabaf29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:34:19.033543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c225253-5783-486b-8e33-640c6aabaf29 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:34:19.033822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c225253-5783-486b-8e33-640c6aabaf29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:34:19.034096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c225253-5783-486b-8e33-640c6aabaf29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:34:19.035849 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9c225253-5783-486b-8e33-640c6aabaf29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:34:19.046639 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c225253-5783-486b-8e33-640c6aabaf29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:34:19.048123 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c225253-5783-486b-8e33-640c6aabaf29 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:34:19.056519 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1387/2786] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:34:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:34:19.390089 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c1161-b15e-45ba-b3a5-b042ba1276bf None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:34:19.391688 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e64c1161-b15e-45ba-b3a5-b042ba1276bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:34:19.408742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c1161-b15e-45ba-b3a5-b042ba1276bf None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:34:19.414053 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a9c45-0e14-43b4-9f28-bf3bfe47dd38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efd209a50a994b7c8485f2996697218b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:34:19.414808 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a9c45-0e14-43b4-9f28-bf3bfe47dd38 service placement] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:34:19.415161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a9c45-0e14-43b4-9f28-bf3bfe47dd38 service placement] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:34:19.415510 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a9c45-0e14-43b4-9f28-bf3bfe47dd38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:34:19.417474 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d98a9c45-0e14-43b4-9f28-bf3bfe47dd38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:34:19.430473 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a9c45-0e14-43b4-9f28-bf3bfe47dd38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:34:19.432130 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a9c45-0e14-43b4-9f28-bf3bfe47dd38 service placement] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:34:19.445099 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1400/2787] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:34:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:34:28.453877 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c225253-5783-486b-8e33-640c6aabaf29 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:34:28.455387 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9c225253-5783-486b-8e33-640c6aabaf29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:34:28.477712 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c225253-5783-486b-8e33-640c6aabaf29 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:34:28.487083 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20a04a-49ac-40bb-9744-b5205d5c51f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:34:28.488127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20a04a-49ac-40bb-9744-b5205d5c51f5 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:34:28.488644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20a04a-49ac-40bb-9744-b5205d5c51f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:34:28.489156 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20a04a-49ac-40bb-9744-b5205d5c51f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:34:28.492340 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1f20a04a-49ac-40bb-9744-b5205d5c51f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:34:28.514634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20a04a-49ac-40bb-9744-b5205d5c51f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:34:28.517624 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20a04a-49ac-40bb-9744-b5205d5c51f5 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:34:28.538787 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1388/2788] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:34:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:34:29.438456 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=93 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:34:32.510184 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a9c45-0e14-43b4-9f28-bf3bfe47dd38 service placement] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:34:32.523488 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a9c45-0e14-43b4-9f28-bf3bfe47dd38 service placement] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:34:32.530211 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4de420-fdbc-4b83-ab1e-460d09392de9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:34:32.530971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4de420-fdbc-4b83-ab1e-460d09392de9 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:34:32.531331 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4de420-fdbc-4b83-ab1e-460d09392de9 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:34:32.531706 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4de420-fdbc-4b83-ab1e-460d09392de9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:34:32.533620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fe4de420-fdbc-4b83-ab1e-460d09392de9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:34:32.547726 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4de420-fdbc-4b83-ab1e-460d09392de9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:34:32.549408 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4de420-fdbc-4b83-ab1e-460d09392de9 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:34:32.561792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1401/2789] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:34:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:34:38.529750 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=64 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:34:42.556115 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=6 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:35:36.814902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20a04a-49ac-40bb-9744-b5205d5c51f5 service nova] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:35:36.829277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20a04a-49ac-40bb-9744-b5205d5c51f5 service nova] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:35:36.835345 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86f020-26b8-4c14-8dca-d859aa52c9f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:35:36.835953 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86f020-26b8-4c14-8dca-d859aa52c9f8 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:35:36.836240 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86f020-26b8-4c14-8dca-d859aa52c9f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:35:36.836519 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86f020-26b8-4c14-8dca-d859aa52c9f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:35:36.838274 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3c86f020-26b8-4c14-8dca-d859aa52c9f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:35:36.849595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86f020-26b8-4c14-8dca-d859aa52c9f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:35:36.851218 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86f020-26b8-4c14-8dca-d859aa52c9f8 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:35:36.860162 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1389/2790] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:35:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:35:46.856068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=6 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:35:56.821576 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4de420-fdbc-4b83-ab1e-460d09392de9 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:35:56.831010 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4de420-fdbc-4b83-ab1e-460d09392de9 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:35:56.834665 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bce36-95e0-4734-aa66-6e30eea8fe7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:35:56.835297 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bce36-95e0-4734-aa66-6e30eea8fe7f service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:35:56.835580 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bce36-95e0-4734-aa66-6e30eea8fe7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:35:56.835857 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bce36-95e0-4734-aa66-6e30eea8fe7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:35:56.838541 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-914bce36-95e0-4734-aa66-6e30eea8fe7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:35:56.902485 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bce36-95e0-4734-aa66-6e30eea8fe7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:35:56.903967 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bce36-95e0-4734-aa66-6e30eea8fe7f service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:35:56.913561 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1402/2791] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:35:59.828787 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86f020-26b8-4c14-8dca-d859aa52c9f8 service nova] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:35:59.830231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3c86f020-26b8-4c14-8dca-d859aa52c9f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:35:59.843528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86f020-26b8-4c14-8dca-d859aa52c9f8 service nova] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:35:59.848266 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876b145-61be-407c-96c2-7bed23646376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:35:59.848934 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876b145-61be-407c-96c2-7bed23646376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:35:59.849297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876b145-61be-407c-96c2-7bed23646376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:35:59.849573 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876b145-61be-407c-96c2-7bed23646376 admin admin] PATH_INFO: `/v3/users/97e4c6d351914409838e060fb208a0ac` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:35:59.850865 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876b145-61be-407c-96c2-7bed23646376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e4c6d351914409838e060fb208a0ac)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:35:59.852971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876b145-61be-407c-96c2-7bed23646376 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:35:59.900512 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3876b145-61be-407c-96c2-7bed23646376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e4c6d351914409838e060fb208a0ac'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:35:59.907705 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3876b145-61be-407c-96c2-7bed23646376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e4c6d351914409838e060fb208a0ac'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:35:59.908372 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3876b145-61be-407c-96c2-7bed23646376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e4c6d351914409838e060fb208a0ac'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:35:59.920441 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3876b145-61be-407c-96c2-7bed23646376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e4c6d351914409838e060fb208a0ac'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:35:59.928208 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3876b145-61be-407c-96c2-7bed23646376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e4c6d351914409838e060fb208a0ac'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:35:59.934089 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1390/2792] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:35:59 2022] DELETE /identity/v3/users/97e4c6d351914409838e060fb208a0ac => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:36:00.111213 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bce36-95e0-4734-aa66-6e30eea8fe7f service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:00.124960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bce36-95e0-4734-aa66-6e30eea8fe7f service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:00.183296 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd145c4-3950-4074-b83b-02d7cc05fe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:00.183920 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd145c4-3950-4074-b83b-02d7cc05fe64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:00.184200 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd145c4-3950-4074-b83b-02d7cc05fe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:00.184502 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd145c4-3950-4074-b83b-02d7cc05fe64 admin admin] PATH_INFO: `/v3/projects/8b7b2344e7b94d3c8d0d76a0866ec5c6` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:00.185598 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd145c4-3950-4074-b83b-02d7cc05fe64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b7b2344e7b94d3c8d0d76a0866ec5c6)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:00.187522 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd145c4-3950-4074-b83b-02d7cc05fe64 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:00.233551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ddd145c4-3950-4074-b83b-02d7cc05fe64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7b2344e7b94d3c8d0d76a0866ec5c6', 'request_id': 'req-ddd145c4-3950-4074-b83b-02d7cc05fe64'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:00.239411 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ddd145c4-3950-4074-b83b-02d7cc05fe64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7b2344e7b94d3c8d0d76a0866ec5c6', 'request_id': 'req-ddd145c4-3950-4074-b83b-02d7cc05fe64'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:00.247729 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ddd145c4-3950-4074-b83b-02d7cc05fe64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7b2344e7b94d3c8d0d76a0866ec5c6', 'request_id': 'req-ddd145c4-3950-4074-b83b-02d7cc05fe64'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:00.259088 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ddd145c4-3950-4074-b83b-02d7cc05fe64 admin admin] The token cache is being invalidate because project 8b7b2344e7b94d3c8d0d76a0866ec5c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:36:00.259384 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ddd145c4-3950-4074-b83b-02d7cc05fe64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:00.260042 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ddd145c4-3950-4074-b83b-02d7cc05fe64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:00.261552 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1403/2793] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:36:00 2022] DELETE /identity/v3/projects/8b7b2344e7b94d3c8d0d76a0866ec5c6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:00.266688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92406c4-366f-4772-b817-36661878ed10 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:00.267010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92406c4-366f-4772-b817-36661878ed10 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:00.267293 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92406c4-366f-4772-b817-36661878ed10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:00.287986 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d92406c4-366f-4772-b817-36661878ed10 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:00.289244 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d92406c4-366f-4772-b817-36661878ed10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:00.347162 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1391/2794] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:36:00.355660 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1800e-cb09-4493-a01b-e1e3b6e31cf0 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:00.355949 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1800e-cb09-4493-a01b-e1e3b6e31cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:00.356227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1800e-cb09-4493-a01b-e1e3b6e31cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:00.377103 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b7c1800e-cb09-4493-a01b-e1e3b6e31cf0 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:00.378319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b7c1800e-cb09-4493-a01b-e1e3b6e31cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:00.386336 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1404/2795] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:00.390428 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92406c4-366f-4772-b817-36661878ed10 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:00.401635 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92406c4-366f-4772-b817-36661878ed10 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:00.406253 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebc6e6-ba33-49df-aaec-94ee6fb0a0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:00.406885 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebc6e6-ba33-49df-aaec-94ee6fb0a0ed admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:00.407451 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebc6e6-ba33-49df-aaec-94ee6fb0a0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:00.407737 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebc6e6-ba33-49df-aaec-94ee6fb0a0ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:00.408390 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebc6e6-ba33-49df-aaec-94ee6fb0a0ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:36:00.408697 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebc6e6-ba33-49df-aaec-94ee6fb0a0ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:00.410320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebc6e6-ba33-49df-aaec-94ee6fb0a0ed admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:00.422630 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1392/2796] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:36:00.427196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1800e-cb09-4493-a01b-e1e3b6e31cf0 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:00.437172 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1800e-cb09-4493-a01b-e1e3b6e31cf0 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:00.442180 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a7c3d-0fc0-44a2-8aff-de0f663a467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:00.442861 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a7c3d-0fc0-44a2-8aff-de0f663a467a admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:00.443149 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a7c3d-0fc0-44a2-8aff-de0f663a467a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:00.443427 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a7c3d-0fc0-44a2-8aff-de0f663a467a admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:00.444076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a7c3d-0fc0-44a2-8aff-de0f663a467a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:00.446101 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a7c3d-0fc0-44a2-8aff-de0f663a467a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:00.461796 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:00.475879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1405/2797] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:36:00 2022] POST /identity/v3/projects => generated 355 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:36:00.480459 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebc6e6-ba33-49df-aaec-94ee6fb0a0ed admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:00.491379 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebc6e6-ba33-49df-aaec-94ee6fb0a0ed admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:00.549253 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e7211-9401-4588-9eb1-2df3372d017f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:00.549864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7211-9401-4588-9eb1-2df3372d017f admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:00.550148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7211-9401-4588-9eb1-2df3372d017f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:00.550426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7211-9401-4588-9eb1-2df3372d017f admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:00.551133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e7211-9401-4588-9eb1-2df3372d017f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:00.553204 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e7211-9401-4588-9eb1-2df3372d017f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:00.561544 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:00.575512 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1393/2798] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:36:00 2022] POST /identity/v3/users => generated 278 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:36:00.579690 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a7c3d-0fc0-44a2-8aff-de0f663a467a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:00.590214 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a7c3d-0fc0-44a2-8aff-de0f663a467a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:00.594775 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa18a5-2fe8-4594-af51-86d46cbe3b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:00.595390 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa18a5-2fe8-4594-af51-86d46cbe3b88 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:00.595667 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa18a5-2fe8-4594-af51-86d46cbe3b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:00.595939 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa18a5-2fe8-4594-af51-86d46cbe3b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:00.596575 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa18a5-2fe8-4594-af51-86d46cbe3b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:00.598161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa18a5-2fe8-4594-af51-86d46cbe3b88 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:00.608423 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1406/2799] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:00.612446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e7211-9401-4588-9eb1-2df3372d017f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:00.623227 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e7211-9401-4588-9eb1-2df3372d017f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:00.628100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a65bf-4505-4765-bfcc-85d9ea2383cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:00.628729 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a65bf-4505-4765-bfcc-85d9ea2383cd admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:00.629012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a65bf-4505-4765-bfcc-85d9ea2383cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:00.629288 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a65bf-4505-4765-bfcc-85d9ea2383cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:00.629941 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a65bf-4505-4765-bfcc-85d9ea2383cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:00.631597 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a65bf-4505-4765-bfcc-85d9ea2383cd admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:00.642458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1394/2800] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:00.647314 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa18a5-2fe8-4594-af51-86d46cbe3b88 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:00.657506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa18a5-2fe8-4594-af51-86d46cbe3b88 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:00.663109 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ceb0a-4ebf-4b81-8602-37b9d827941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:00.663799 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ceb0a-4ebf-4b81-8602-37b9d827941f admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:00.664083 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ceb0a-4ebf-4b81-8602-37b9d827941f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:00.664378 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ceb0a-4ebf-4b81-8602-37b9d827941f admin admin] PATH_INFO: `/v3/projects/638affde64d94c02a5290419f1da5e78/users/1d9ad99636f3487b96ed26d9fb155d00/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:00.678939 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ceb0a-4ebf-4b81-8602-37b9d827941f admin admin] RBAC: Authorizing `identity:create_grant(project_id=638affde64d94c02a5290419f1da5e78, user_id=1d9ad99636f3487b96ed26d9fb155d00, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:00.681605 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ceb0a-4ebf-4b81-8602-37b9d827941f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:00.694576 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1407/2801] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:36:00 2022] PUT /identity/v3/projects/638affde64d94c02a5290419f1da5e78/users/1d9ad99636f3487b96ed26d9fb155d00/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:00.705677 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee6309-c0cc-424a-9ff0-0931a89ff261 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:00.705962 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee6309-c0cc-424a-9ff0-0931a89ff261 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:00.706235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee6309-c0cc-424a-9ff0-0931a89ff261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:00.734040 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9dee6309-c0cc-424a-9ff0-0931a89ff261 None None] MFA Rules not processed for user `1d9ad99636f3487b96ed26d9fb155d00`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:00.735271 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9dee6309-c0cc-424a-9ff0-0931a89ff261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:00.797304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1395/2802] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:00.801710 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ceb0a-4ebf-4b81-8602-37b9d827941f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:00.865620 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ceb0a-4ebf-4b81-8602-37b9d827941f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:00.870326 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8474597-3c7d-4cce-9d53-36aa6065d3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:00.870958 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8474597-3c7d-4cce-9d53-36aa6065d3fd admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:00.871237 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8474597-3c7d-4cce-9d53-36aa6065d3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:00.871510 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8474597-3c7d-4cce-9d53-36aa6065d3fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:00.872395 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8474597-3c7d-4cce-9d53-36aa6065d3fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:00.874301 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8474597-3c7d-4cce-9d53-36aa6065d3fd admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:00.902996 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1408/2803] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:36:00 2022] POST /identity/v3/projects => generated 357 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:36:00.907017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee6309-c0cc-424a-9ff0-0931a89ff261 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:00.917999 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee6309-c0cc-424a-9ff0-0931a89ff261 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:00.972642 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc68c5-8519-48b0-b4bb-b5d535a307b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:00.973242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc68c5-8519-48b0-b4bb-b5d535a307b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:00.973521 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc68c5-8519-48b0-b4bb-b5d535a307b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:00.973796 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc68c5-8519-48b0-b4bb-b5d535a307b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:00.974963 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc68c5-8519-48b0-b4bb-b5d535a307b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:00.976884 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc68c5-8519-48b0-b4bb-b5d535a307b9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:01.001487 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1396/2804] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:36:00 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:36:01.005435 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8474597-3c7d-4cce-9d53-36aa6065d3fd admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:01.016330 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8474597-3c7d-4cce-9d53-36aa6065d3fd admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:01.021124 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8f180-6e8a-4f45-a97e-81e91d0cc008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:01.021749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8f180-6e8a-4f45-a97e-81e91d0cc008 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:01.022025 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8f180-6e8a-4f45-a97e-81e91d0cc008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:01.022295 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8f180-6e8a-4f45-a97e-81e91d0cc008 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:01.023005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8f180-6e8a-4f45-a97e-81e91d0cc008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:01.024595 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8f180-6e8a-4f45-a97e-81e91d0cc008 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:01.035102 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1409/2805] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:01.039694 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc68c5-8519-48b0-b4bb-b5d535a307b9 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:01.049706 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc68c5-8519-48b0-b4bb-b5d535a307b9 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:01.055098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97eb66-4c9e-4f09-b674-ee6d56a350b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:01.055749 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97eb66-4c9e-4f09-b674-ee6d56a350b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:01.056028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97eb66-4c9e-4f09-b674-ee6d56a350b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:01.056301 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97eb66-4c9e-4f09-b674-ee6d56a350b4 admin admin] PATH_INFO: `/v3/projects/7e811eefc6c54e4aa6f203f669fed6b2/users/543b511c97c8404b9abe0175a37495c6/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:01.071396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97eb66-4c9e-4f09-b674-ee6d56a350b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e811eefc6c54e4aa6f203f669fed6b2, user_id=543b511c97c8404b9abe0175a37495c6, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:01.074041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97eb66-4c9e-4f09-b674-ee6d56a350b4 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:01.086589 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1397/2806] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:36:01 2022] PUT /identity/v3/projects/7e811eefc6c54e4aa6f203f669fed6b2/users/543b511c97c8404b9abe0175a37495c6/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:01.090549 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8f180-6e8a-4f45-a97e-81e91d0cc008 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:01.100822 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8f180-6e8a-4f45-a97e-81e91d0cc008 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:01.155669 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db334a2-1a35-4bd6-af71-30b05ac7ec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:01.156338 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db334a2-1a35-4bd6-af71-30b05ac7ec29 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:01.156577 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db334a2-1a35-4bd6-af71-30b05ac7ec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:01.156807 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db334a2-1a35-4bd6-af71-30b05ac7ec29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:01.157581 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db334a2-1a35-4bd6-af71-30b05ac7ec29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:01.159217 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db334a2-1a35-4bd6-af71-30b05ac7ec29 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:01.169348 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1410/2807] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:01.173400 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97eb66-4c9e-4f09-b674-ee6d56a350b4 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:01.184166 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97eb66-4c9e-4f09-b674-ee6d56a350b4 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:01.188715 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb7435-7e39-4228-8d03-443ab4f181df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:01.189356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb7435-7e39-4228-8d03-443ab4f181df admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:01.189639 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb7435-7e39-4228-8d03-443ab4f181df admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:01.189948 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb7435-7e39-4228-8d03-443ab4f181df admin admin] PATH_INFO: `/v3/projects/7e811eefc6c54e4aa6f203f669fed6b2/users/543b511c97c8404b9abe0175a37495c6/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:01.192088 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb7435-7e39-4228-8d03-443ab4f181df admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e811eefc6c54e4aa6f203f669fed6b2, user_id=543b511c97c8404b9abe0175a37495c6, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:01.194905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb7435-7e39-4228-8d03-443ab4f181df admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:01.205216 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1398/2808] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:36:01 2022] PUT /identity/v3/projects/7e811eefc6c54e4aa6f203f669fed6b2/users/543b511c97c8404b9abe0175a37495c6/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:01.215557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb950b2-1cac-40ea-a37b-e97498d00770 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:01.215852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb950b2-1cac-40ea-a37b-e97498d00770 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:01.216201 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb950b2-1cac-40ea-a37b-e97498d00770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:01.245730 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-9cb950b2-1cac-40ea-a37b-e97498d00770 None None] MFA Rules not processed for user `543b511c97c8404b9abe0175a37495c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:01.247204 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9cb950b2-1cac-40ea-a37b-e97498d00770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:01.266900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:01.317247 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1411/2809] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:01.328485 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb7435-7e39-4228-8d03-443ab4f181df admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:01.330214 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0afb7435-7e39-4228-8d03-443ab4f181df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:01.353277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:01.388350 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb7435-7e39-4228-8d03-443ab4f181df admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:01.391928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c86d5-2ee9-47b9-a08a-9fb923449e99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:01.392526 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c86d5-2ee9-47b9-a08a-9fb923449e99 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:01.392825 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c86d5-2ee9-47b9-a08a-9fb923449e99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:01.393096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c86d5-2ee9-47b9-a08a-9fb923449e99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:01.403988 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c86d5-2ee9-47b9-a08a-9fb923449e99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:01.405498 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c86d5-2ee9-47b9-a08a-9fb923449e99 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:01.415637 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1399/2810] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:36:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:36:01.491655 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb950b2-1cac-40ea-a37b-e97498d00770 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:01.502129 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb950b2-1cac-40ea-a37b-e97498d00770 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:01.505868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab31c7c-e925-498e-8e94-a5a29f1bd8f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:01.506471 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31c7c-e925-498e-8e94-a5a29f1bd8f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:01.506819 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31c7c-e925-498e-8e94-a5a29f1bd8f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:01.507118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31c7c-e925-498e-8e94-a5a29f1bd8f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:01.567836 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab31c7c-e925-498e-8e94-a5a29f1bd8f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:01.569177 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab31c7c-e925-498e-8e94-a5a29f1bd8f6 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:01.578111 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1412/2811] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:36:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:36:11.410877 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=17 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:11.574056 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=48 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:16.440150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c86d5-2ee9-47b9-a08a-9fb923449e99 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:16.500878 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c86d5-2ee9-47b9-a08a-9fb923449e99 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:16.505360 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92554b-f4b9-4d87-a251-883bc4890f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:16.505980 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92554b-f4b9-4d87-a251-883bc4890f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:16.506257 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92554b-f4b9-4d87-a251-883bc4890f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:16.506529 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92554b-f4b9-4d87-a251-883bc4890f58 admin admin] PATH_INFO: `/v3/users/1d9ad99636f3487b96ed26d9fb155d00` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:16.507658 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92554b-f4b9-4d87-a251-883bc4890f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9ad99636f3487b96ed26d9fb155d00)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:16.509563 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92554b-f4b9-4d87-a251-883bc4890f58 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:16.554114 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6d92554b-f4b9-4d87-a251-883bc4890f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9ad99636f3487b96ed26d9fb155d00'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:16.561154 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6d92554b-f4b9-4d87-a251-883bc4890f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9ad99636f3487b96ed26d9fb155d00'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:16.561810 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6d92554b-f4b9-4d87-a251-883bc4890f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9ad99636f3487b96ed26d9fb155d00'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:16.573652 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6d92554b-f4b9-4d87-a251-883bc4890f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9ad99636f3487b96ed26d9fb155d00'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:16.580566 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6d92554b-f4b9-4d87-a251-883bc4890f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9ad99636f3487b96ed26d9fb155d00'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:16.587005 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1400/2812] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:36:16 2022] DELETE /identity/v3/users/1d9ad99636f3487b96ed26d9fb155d00 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:16.591443 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49726095-8035-4020-8a83-b1bc90309088 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:16.591903 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49726095-8035-4020-8a83-b1bc90309088 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:16.592022 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49726095-8035-4020-8a83-b1bc90309088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:16.610544 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-49726095-8035-4020-8a83-b1bc90309088 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:16.611764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-49726095-8035-4020-8a83-b1bc90309088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:16.667706 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1413/2813] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:16.677734 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92554b-f4b9-4d87-a251-883bc4890f58 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:16.679328 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6d92554b-f4b9-4d87-a251-883bc4890f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:16.736265 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92554b-f4b9-4d87-a251-883bc4890f58 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:16.739913 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205593b0-e6d7-4948-8274-fd4a2934fd63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:16.740517 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205593b0-e6d7-4948-8274-fd4a2934fd63 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:16.740798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205593b0-e6d7-4948-8274-fd4a2934fd63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:16.741071 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205593b0-e6d7-4948-8274-fd4a2934fd63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:16.750173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205593b0-e6d7-4948-8274-fd4a2934fd63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:16.751634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205593b0-e6d7-4948-8274-fd4a2934fd63 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:16.762143 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1401/2814] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:36:17.022787 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49726095-8035-4020-8a83-b1bc90309088 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:17.024254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-49726095-8035-4020-8a83-b1bc90309088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:17.040188 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49726095-8035-4020-8a83-b1bc90309088 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:17.044971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f97c4-db01-4365-ba97-524e8427a45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:17.045679 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f97c4-db01-4365-ba97-524e8427a45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:17.046031 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f97c4-db01-4365-ba97-524e8427a45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:17.046358 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f97c4-db01-4365-ba97-524e8427a45e admin admin] PATH_INFO: `/v3/projects/638affde64d94c02a5290419f1da5e78` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:17.047590 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f97c4-db01-4365-ba97-524e8427a45e admin admin] RBAC: Authorizing `identity:delete_project(project_id=638affde64d94c02a5290419f1da5e78)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:17.049583 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f97c4-db01-4365-ba97-524e8427a45e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:17.097754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1e8f97c4-db01-4365-ba97-524e8427a45e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638affde64d94c02a5290419f1da5e78', 'request_id': 'req-1e8f97c4-db01-4365-ba97-524e8427a45e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:17.104006 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1e8f97c4-db01-4365-ba97-524e8427a45e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638affde64d94c02a5290419f1da5e78', 'request_id': 'req-1e8f97c4-db01-4365-ba97-524e8427a45e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:17.110836 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1e8f97c4-db01-4365-ba97-524e8427a45e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638affde64d94c02a5290419f1da5e78', 'request_id': 'req-1e8f97c4-db01-4365-ba97-524e8427a45e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:17.121428 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1e8f97c4-db01-4365-ba97-524e8427a45e admin admin] The token cache is being invalidate because project 638affde64d94c02a5290419f1da5e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:36:17.121718 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1e8f97c4-db01-4365-ba97-524e8427a45e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:17.122654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1e8f97c4-db01-4365-ba97-524e8427a45e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:17.124242 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1414/2815] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:36:17 2022] DELETE /identity/v3/projects/638affde64d94c02a5290419f1da5e78 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:17.128303 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205593b0-e6d7-4948-8274-fd4a2934fd63 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:17.138384 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205593b0-e6d7-4948-8274-fd4a2934fd63 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:17.156732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:17.202285 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7916b-38da-467b-8aa9-11463cac7f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:17.202872 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7916b-38da-467b-8aa9-11463cac7f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:17.203159 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7916b-38da-467b-8aa9-11463cac7f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:17.203436 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7916b-38da-467b-8aa9-11463cac7f97 admin admin] PATH_INFO: `/v3/users/543b511c97c8404b9abe0175a37495c6` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:17.204548 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7916b-38da-467b-8aa9-11463cac7f97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=543b511c97c8404b9abe0175a37495c6)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:17.206469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7916b-38da-467b-8aa9-11463cac7f97 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:17.254024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-40c7916b-38da-467b-8aa9-11463cac7f97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '543b511c97c8404b9abe0175a37495c6'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:17.262267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-40c7916b-38da-467b-8aa9-11463cac7f97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '543b511c97c8404b9abe0175a37495c6'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:17.262956 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-40c7916b-38da-467b-8aa9-11463cac7f97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '543b511c97c8404b9abe0175a37495c6'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:17.278207 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-40c7916b-38da-467b-8aa9-11463cac7f97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '543b511c97c8404b9abe0175a37495c6'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:17.285377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-40c7916b-38da-467b-8aa9-11463cac7f97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '543b511c97c8404b9abe0175a37495c6'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:17.291242 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1402/2816] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:36:17 2022] DELETE /identity/v3/users/543b511c97c8404b9abe0175a37495c6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:36:17.554908 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f97c4-db01-4365-ba97-524e8427a45e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:17.556421 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1e8f97c4-db01-4365-ba97-524e8427a45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:17.572366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f97c4-db01-4365-ba97-524e8427a45e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:17.629944 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa48cb-0c9b-41bb-9eaf-204fe91f4a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:17.630650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa48cb-0c9b-41bb-9eaf-204fe91f4a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:17.630867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa48cb-0c9b-41bb-9eaf-204fe91f4a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:17.631171 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa48cb-0c9b-41bb-9eaf-204fe91f4a16 admin admin] PATH_INFO: `/v3/projects/7e811eefc6c54e4aa6f203f669fed6b2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:17.632294 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa48cb-0c9b-41bb-9eaf-204fe91f4a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e811eefc6c54e4aa6f203f669fed6b2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:17.634187 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa48cb-0c9b-41bb-9eaf-204fe91f4a16 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:17.681325 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:17.703807 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5afa48cb-0c9b-41bb-9eaf-204fe91f4a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e811eefc6c54e4aa6f203f669fed6b2', 'request_id': 'req-5afa48cb-0c9b-41bb-9eaf-204fe91f4a16'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:17.710470 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5afa48cb-0c9b-41bb-9eaf-204fe91f4a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e811eefc6c54e4aa6f203f669fed6b2', 'request_id': 'req-5afa48cb-0c9b-41bb-9eaf-204fe91f4a16'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:17.717826 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5afa48cb-0c9b-41bb-9eaf-204fe91f4a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e811eefc6c54e4aa6f203f669fed6b2', 'request_id': 'req-5afa48cb-0c9b-41bb-9eaf-204fe91f4a16'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:17.728900 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5afa48cb-0c9b-41bb-9eaf-204fe91f4a16 admin admin] The token cache is being invalidate because project 7e811eefc6c54e4aa6f203f669fed6b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:36:17.729188 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5afa48cb-0c9b-41bb-9eaf-204fe91f4a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:17.729807 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5afa48cb-0c9b-41bb-9eaf-204fe91f4a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:17.731393 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1415/2817] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:36:17 2022] DELETE /identity/v3/projects/7e811eefc6c54e4aa6f203f669fed6b2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:17.736276 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5480eed-3b6c-4863-bcc9-323f06b2887d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:17.736782 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5480eed-3b6c-4863-bcc9-323f06b2887d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:17.736881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5480eed-3b6c-4863-bcc9-323f06b2887d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:17.756151 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e5480eed-3b6c-4863-bcc9-323f06b2887d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:17.757345 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e5480eed-3b6c-4863-bcc9-323f06b2887d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:17.815386 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1403/2818] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:36:17.824418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a565c-8fe4-4c2d-aae0-9d43e08fcc64 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:17.824707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a565c-8fe4-4c2d-aae0-9d43e08fcc64 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:17.824983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a565c-8fe4-4c2d-aae0-9d43e08fcc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:17.844859 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b84a565c-8fe4-4c2d-aae0-9d43e08fcc64 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:17.846064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b84a565c-8fe4-4c2d-aae0-9d43e08fcc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:17.854646 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1416/2819] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:17.858688 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5480eed-3b6c-4863-bcc9-323f06b2887d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:17.869767 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5480eed-3b6c-4863-bcc9-323f06b2887d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:17.875385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6788d35-1614-4e67-aa66-dc882f48dc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:17.876097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6788d35-1614-4e67-aa66-dc882f48dc30 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:17.876434 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6788d35-1614-4e67-aa66-dc882f48dc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:17.876769 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6788d35-1614-4e67-aa66-dc882f48dc30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:17.877544 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6788d35-1614-4e67-aa66-dc882f48dc30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:36:17.877858 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6788d35-1614-4e67-aa66-dc882f48dc30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:17.879776 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6788d35-1614-4e67-aa66-dc882f48dc30 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:17.893163 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1404/2820] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:36:17.897996 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a565c-8fe4-4c2d-aae0-9d43e08fcc64 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:17.907361 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a565c-8fe4-4c2d-aae0-9d43e08fcc64 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:17.911962 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d98d35-24df-4315-b176-53376fc1a33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:17.913175 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d98d35-24df-4315-b176-53376fc1a33e admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:17.913453 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d98d35-24df-4315-b176-53376fc1a33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:17.913725 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d98d35-24df-4315-b176-53376fc1a33e admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:17.914361 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d98d35-24df-4315-b176-53376fc1a33e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:17.916294 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d98d35-24df-4315-b176-53376fc1a33e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:17.942255 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1417/2821] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:36:17 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:36:17.946439 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6788d35-1614-4e67-aa66-dc882f48dc30 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:17.956255 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6788d35-1614-4e67-aa66-dc882f48dc30 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:17.982463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:18.016315 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e0969-8a9d-496b-9e2b-6130d3a035b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:18.016923 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e0969-8a9d-496b-9e2b-6130d3a035b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:18.017228 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e0969-8a9d-496b-9e2b-6130d3a035b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:18.017504 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e0969-8a9d-496b-9e2b-6130d3a035b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:18.018148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e0969-8a9d-496b-9e2b-6130d3a035b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:18.020100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e0969-8a9d-496b-9e2b-6130d3a035b4 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:18.042464 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1405/2822] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:36:17 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:36:18.046381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d98d35-24df-4315-b176-53376fc1a33e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:18.056448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d98d35-24df-4315-b176-53376fc1a33e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:18.060933 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e7c62-d2ac-44d1-aa7f-d47cea4fd816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:18.061517 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e7c62-d2ac-44d1-aa7f-d47cea4fd816 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:18.061792 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e7c62-d2ac-44d1-aa7f-d47cea4fd816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:18.062067 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e7c62-d2ac-44d1-aa7f-d47cea4fd816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:18.062702 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e7c62-d2ac-44d1-aa7f-d47cea4fd816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:18.064308 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e7c62-d2ac-44d1-aa7f-d47cea4fd816 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:18.077492 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1418/2823] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:18.082021 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e0969-8a9d-496b-9e2b-6130d3a035b4 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:18.094577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e0969-8a9d-496b-9e2b-6130d3a035b4 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:18.099902 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75414e-8cd8-4bb0-b7ef-beb70632d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:18.100575 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75414e-8cd8-4bb0-b7ef-beb70632d4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:18.100881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75414e-8cd8-4bb0-b7ef-beb70632d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:18.101241 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75414e-8cd8-4bb0-b7ef-beb70632d4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:18.101998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75414e-8cd8-4bb0-b7ef-beb70632d4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:18.103952 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75414e-8cd8-4bb0-b7ef-beb70632d4e6 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:18.114183 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1406/2824] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:36:18.118186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e7c62-d2ac-44d1-aa7f-d47cea4fd816 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:18.128309 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e7c62-d2ac-44d1-aa7f-d47cea4fd816 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:18.133412 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf3707-badc-4d0a-a255-f9a57a12bd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:18.134049 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf3707-badc-4d0a-a255-f9a57a12bd42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:18.134327 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf3707-badc-4d0a-a255-f9a57a12bd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:18.134601 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf3707-badc-4d0a-a255-f9a57a12bd42 admin admin] PATH_INFO: `/v3/projects/208b8db8bfde43808bd0eceb60fe6e28/users/a00b5bddb3034b95a002b094535fbcde/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:18.149208 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf3707-badc-4d0a-a255-f9a57a12bd42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=208b8db8bfde43808bd0eceb60fe6e28, user_id=a00b5bddb3034b95a002b094535fbcde, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:18.151882 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf3707-badc-4d0a-a255-f9a57a12bd42 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:18.164722 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1419/2825] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:36:18 2022] PUT /identity/v3/projects/208b8db8bfde43808bd0eceb60fe6e28/users/a00b5bddb3034b95a002b094535fbcde/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:18.174965 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ad689-7b28-47f0-8eaa-1546dc18c68c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:18.175282 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ad689-7b28-47f0-8eaa-1546dc18c68c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:18.175565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ad689-7b28-47f0-8eaa-1546dc18c68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:18.202979 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-233ad689-7b28-47f0-8eaa-1546dc18c68c None None] MFA Rules not processed for user `a00b5bddb3034b95a002b094535fbcde`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:18.204188 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-233ad689-7b28-47f0-8eaa-1546dc18c68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:18.266562 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1407/2826] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:36:18.271048 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf3707-badc-4d0a-a255-f9a57a12bd42 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:18.331305 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf3707-badc-4d0a-a255-f9a57a12bd42 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:18.335935 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce85c4-8e1d-4100-b403-90d419a5979f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:18.336535 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce85c4-8e1d-4100-b403-90d419a5979f admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:18.336817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce85c4-8e1d-4100-b403-90d419a5979f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:18.337716 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce85c4-8e1d-4100-b403-90d419a5979f admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:18.338347 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce85c4-8e1d-4100-b403-90d419a5979f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:18.340298 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce85c4-8e1d-4100-b403-90d419a5979f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:18.366092 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1420/2827] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:36:18 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:36:18.370955 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ad689-7b28-47f0-8eaa-1546dc18c68c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:18.384702 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ad689-7b28-47f0-8eaa-1546dc18c68c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:18.440398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2ce75-ce77-451d-82f7-f3b54b37327a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:18.441002 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2ce75-ce77-451d-82f7-f3b54b37327a admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:18.441283 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2ce75-ce77-451d-82f7-f3b54b37327a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:18.441555 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2ce75-ce77-451d-82f7-f3b54b37327a admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:18.442191 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2ce75-ce77-451d-82f7-f3b54b37327a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:18.444171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2ce75-ce77-451d-82f7-f3b54b37327a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:18.464775 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1408/2828] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:36:18 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:36:18.469008 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce85c4-8e1d-4100-b403-90d419a5979f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:18.480521 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce85c4-8e1d-4100-b403-90d419a5979f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:18.485867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53670bf-e60a-459b-8920-2bc8c0787f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:18.486551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53670bf-e60a-459b-8920-2bc8c0787f4e admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:18.486920 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53670bf-e60a-459b-8920-2bc8c0787f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:18.487774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53670bf-e60a-459b-8920-2bc8c0787f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:18.487910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53670bf-e60a-459b-8920-2bc8c0787f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:18.490183 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53670bf-e60a-459b-8920-2bc8c0787f4e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:18.503626 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1421/2829] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:18.508142 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2ce75-ce77-451d-82f7-f3b54b37327a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:18.518801 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2ce75-ce77-451d-82f7-f3b54b37327a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:18.523263 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab29d87-52e2-4fe6-bf6d-56d80da61425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:18.523906 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab29d87-52e2-4fe6-bf6d-56d80da61425 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:18.524195 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab29d87-52e2-4fe6-bf6d-56d80da61425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:18.524494 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab29d87-52e2-4fe6-bf6d-56d80da61425 admin admin] PATH_INFO: `/v3/projects/f0d45f40abe643f78c852a16d70dc60b/users/0a9959878ed34f099a14ab5a7f279ff5/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:18.538638 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab29d87-52e2-4fe6-bf6d-56d80da61425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0d45f40abe643f78c852a16d70dc60b, user_id=0a9959878ed34f099a14ab5a7f279ff5, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:18.541346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab29d87-52e2-4fe6-bf6d-56d80da61425 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:18.554346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1409/2830] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:36:18 2022] PUT /identity/v3/projects/f0d45f40abe643f78c852a16d70dc60b/users/0a9959878ed34f099a14ab5a7f279ff5/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:18.559137 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53670bf-e60a-459b-8920-2bc8c0787f4e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:18.568944 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53670bf-e60a-459b-8920-2bc8c0787f4e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:18.588998 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:18.627018 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d521d22-ff79-4642-9b3e-422031244797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:18.627668 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d521d22-ff79-4642-9b3e-422031244797 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:18.628130 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d521d22-ff79-4642-9b3e-422031244797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:18.628591 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d521d22-ff79-4642-9b3e-422031244797 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:18.629808 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d521d22-ff79-4642-9b3e-422031244797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:18.632895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d521d22-ff79-4642-9b3e-422031244797 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:18.643784 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1422/2831] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:18.647864 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab29d87-52e2-4fe6-bf6d-56d80da61425 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:18.653199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:18.659402 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab29d87-52e2-4fe6-bf6d-56d80da61425 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:18.664574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66747d7a-c5bd-46d7-b23c-f2adde454750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:18.665251 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66747d7a-c5bd-46d7-b23c-f2adde454750 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:18.665538 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66747d7a-c5bd-46d7-b23c-f2adde454750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:18.665813 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66747d7a-c5bd-46d7-b23c-f2adde454750 admin admin] PATH_INFO: `/v3/projects/f0d45f40abe643f78c852a16d70dc60b/users/0a9959878ed34f099a14ab5a7f279ff5/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:18.667808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66747d7a-c5bd-46d7-b23c-f2adde454750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0d45f40abe643f78c852a16d70dc60b, user_id=0a9959878ed34f099a14ab5a7f279ff5, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:18.670474 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66747d7a-c5bd-46d7-b23c-f2adde454750 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:18.683043 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1410/2832] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:36:18 2022] PUT /identity/v3/projects/f0d45f40abe643f78c852a16d70dc60b/users/0a9959878ed34f099a14ab5a7f279ff5/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:18.695549 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4484c18-2585-4186-8b32-1739721d2104 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:18.695848 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4484c18-2585-4186-8b32-1739721d2104 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:18.696169 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4484c18-2585-4186-8b32-1739721d2104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:18.727212 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c4484c18-2585-4186-8b32-1739721d2104 None None] MFA Rules not processed for user `0a9959878ed34f099a14ab5a7f279ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:18.728421 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c4484c18-2585-4186-8b32-1739721d2104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:18.796781 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1423/2833] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:18.808034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66747d7a-c5bd-46d7-b23c-f2adde454750 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:18.809875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-66747d7a-c5bd-46d7-b23c-f2adde454750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:18.865180 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66747d7a-c5bd-46d7-b23c-f2adde454750 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:18.869432 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0f995-8315-42b9-b3ff-83bac6ff7bce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:18.870029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0f995-8315-42b9-b3ff-83bac6ff7bce service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:18.870310 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0f995-8315-42b9-b3ff-83bac6ff7bce service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:18.870582 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0f995-8315-42b9-b3ff-83bac6ff7bce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:18.879964 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0f995-8315-42b9-b3ff-83bac6ff7bce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:18.881386 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0f995-8315-42b9-b3ff-83bac6ff7bce service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:18.890991 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1411/2834] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:36:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:36:19.454735 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4484c18-2585-4186-8b32-1739721d2104 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:19.517844 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4484c18-2585-4186-8b32-1739721d2104 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:19.522311 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29079958-c812-4552-9c03-42959b454852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:19.522953 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29079958-c812-4552-9c03-42959b454852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:19.523231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29079958-c812-4552-9c03-42959b454852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:19.523503 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29079958-c812-4552-9c03-42959b454852 admin admin] PATH_INFO: `/v3/users/a00b5bddb3034b95a002b094535fbcde` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:19.525220 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29079958-c812-4552-9c03-42959b454852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a00b5bddb3034b95a002b094535fbcde)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:19.527161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29079958-c812-4552-9c03-42959b454852 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:19.572476 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-29079958-c812-4552-9c03-42959b454852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a00b5bddb3034b95a002b094535fbcde'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:19.573562 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:19.581561 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-29079958-c812-4552-9c03-42959b454852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a00b5bddb3034b95a002b094535fbcde'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:19.593824 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-29079958-c812-4552-9c03-42959b454852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a00b5bddb3034b95a002b094535fbcde'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:19.594487 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-29079958-c812-4552-9c03-42959b454852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a00b5bddb3034b95a002b094535fbcde'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:19.601393 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-29079958-c812-4552-9c03-42959b454852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a00b5bddb3034b95a002b094535fbcde'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:19.607333 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1424/2835] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:36:19 2022] DELETE /identity/v3/users/a00b5bddb3034b95a002b094535fbcde => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:19.611770 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb6236-0e16-4224-8010-c0a1cb6c9d84 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:19.612082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb6236-0e16-4224-8010-c0a1cb6c9d84 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:19.612358 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb6236-0e16-4224-8010-c0a1cb6c9d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:19.631148 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-0dfb6236-0e16-4224-8010-c0a1cb6c9d84 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:19.632340 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0dfb6236-0e16-4224-8010-c0a1cb6c9d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:19.689946 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1412/2836] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:19.701853 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29079958-c812-4552-9c03-42959b454852 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:19.703550 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-29079958-c812-4552-9c03-42959b454852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:19.759948 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29079958-c812-4552-9c03-42959b454852 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:19.763619 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbead5b0-55c1-47dd-928e-55f499c7bf3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:19.764220 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead5b0-55c1-47dd-928e-55f499c7bf3b service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:19.764499 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead5b0-55c1-47dd-928e-55f499c7bf3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:19.764797 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead5b0-55c1-47dd-928e-55f499c7bf3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:19.773569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbead5b0-55c1-47dd-928e-55f499c7bf3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:19.775649 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbead5b0-55c1-47dd-928e-55f499c7bf3b service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:19.784835 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1425/2837] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:36:20.045481 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb6236-0e16-4224-8010-c0a1cb6c9d84 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:20.047068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0dfb6236-0e16-4224-8010-c0a1cb6c9d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:20.059455 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb6236-0e16-4224-8010-c0a1cb6c9d84 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:20.064124 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78694690-a03b-4380-abc1-c73cdf2e66eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:20.064753 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78694690-a03b-4380-abc1-c73cdf2e66eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:20.065028 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78694690-a03b-4380-abc1-c73cdf2e66eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:20.065306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78694690-a03b-4380-abc1-c73cdf2e66eb admin admin] PATH_INFO: `/v3/projects/208b8db8bfde43808bd0eceb60fe6e28` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:20.066431 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78694690-a03b-4380-abc1-c73cdf2e66eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=208b8db8bfde43808bd0eceb60fe6e28)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:20.068376 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78694690-a03b-4380-abc1-c73cdf2e66eb admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:20.126609 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-78694690-a03b-4380-abc1-c73cdf2e66eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208b8db8bfde43808bd0eceb60fe6e28', 'request_id': 'req-78694690-a03b-4380-abc1-c73cdf2e66eb'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:20.132026 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-78694690-a03b-4380-abc1-c73cdf2e66eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208b8db8bfde43808bd0eceb60fe6e28', 'request_id': 'req-78694690-a03b-4380-abc1-c73cdf2e66eb'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:20.138749 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-78694690-a03b-4380-abc1-c73cdf2e66eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208b8db8bfde43808bd0eceb60fe6e28', 'request_id': 'req-78694690-a03b-4380-abc1-c73cdf2e66eb'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:20.151839 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-78694690-a03b-4380-abc1-c73cdf2e66eb admin admin] The token cache is being invalidate because project 208b8db8bfde43808bd0eceb60fe6e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:36:20.152130 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-78694690-a03b-4380-abc1-c73cdf2e66eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:20.152752 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-78694690-a03b-4380-abc1-c73cdf2e66eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:20.154230 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1413/2838] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:36:20 2022] DELETE /identity/v3/projects/208b8db8bfde43808bd0eceb60fe6e28 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:20.158241 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbead5b0-55c1-47dd-928e-55f499c7bf3b service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:20.167665 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbead5b0-55c1-47dd-928e-55f499c7bf3b service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:20.222363 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94441f-9c77-4df6-8f90-8f12dd2f4762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:20.223007 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94441f-9c77-4df6-8f90-8f12dd2f4762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:20.223288 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94441f-9c77-4df6-8f90-8f12dd2f4762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:20.223558 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94441f-9c77-4df6-8f90-8f12dd2f4762 admin admin] PATH_INFO: `/v3/users/0a9959878ed34f099a14ab5a7f279ff5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:20.224654 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94441f-9c77-4df6-8f90-8f12dd2f4762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a9959878ed34f099a14ab5a7f279ff5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:20.226560 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94441f-9c77-4df6-8f90-8f12dd2f4762 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:20.272655 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2d94441f-9c77-4df6-8f90-8f12dd2f4762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a9959878ed34f099a14ab5a7f279ff5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:20.279994 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2d94441f-9c77-4df6-8f90-8f12dd2f4762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a9959878ed34f099a14ab5a7f279ff5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:20.290882 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:20.293642 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2d94441f-9c77-4df6-8f90-8f12dd2f4762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a9959878ed34f099a14ab5a7f279ff5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:20.294853 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2d94441f-9c77-4df6-8f90-8f12dd2f4762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a9959878ed34f099a14ab5a7f279ff5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:20.303639 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2d94441f-9c77-4df6-8f90-8f12dd2f4762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a9959878ed34f099a14ab5a7f279ff5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:20.311130 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1426/2839] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:36:20 2022] DELETE /identity/v3/users/0a9959878ed34f099a14ab5a7f279ff5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:20.584073 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78694690-a03b-4380-abc1-c73cdf2e66eb admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:20.585531 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-78694690-a03b-4380-abc1-c73cdf2e66eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:20.599185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78694690-a03b-4380-abc1-c73cdf2e66eb admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:20.612926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:20.661041 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab86faf-62bf-45ab-afab-2971822a7597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:20.661586 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab86faf-62bf-45ab-afab-2971822a7597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:20.661933 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab86faf-62bf-45ab-afab-2971822a7597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:20.662150 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab86faf-62bf-45ab-afab-2971822a7597 admin admin] PATH_INFO: `/v3/projects/f0d45f40abe643f78c852a16d70dc60b` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:20.663577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab86faf-62bf-45ab-afab-2971822a7597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0d45f40abe643f78c852a16d70dc60b)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:20.666082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab86faf-62bf-45ab-afab-2971822a7597 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:20.720997 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-aab86faf-62bf-45ab-afab-2971822a7597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0d45f40abe643f78c852a16d70dc60b', 'request_id': 'req-aab86faf-62bf-45ab-afab-2971822a7597'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:20.726952 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-aab86faf-62bf-45ab-afab-2971822a7597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0d45f40abe643f78c852a16d70dc60b', 'request_id': 'req-aab86faf-62bf-45ab-afab-2971822a7597'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:20.733810 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-aab86faf-62bf-45ab-afab-2971822a7597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0d45f40abe643f78c852a16d70dc60b', 'request_id': 'req-aab86faf-62bf-45ab-afab-2971822a7597'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:20.748080 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-aab86faf-62bf-45ab-afab-2971822a7597 admin admin] The token cache is being invalidate because project f0d45f40abe643f78c852a16d70dc60b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:36:20.748445 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-aab86faf-62bf-45ab-afab-2971822a7597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:20.749062 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-aab86faf-62bf-45ab-afab-2971822a7597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:20.750563 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1414/2840] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:36:20 2022] DELETE /identity/v3/projects/f0d45f40abe643f78c852a16d70dc60b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:20.755754 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5cc71-9de1-46c4-b683-9cc5f22ec9f9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:20.756235 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5cc71-9de1-46c4-b683-9cc5f22ec9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:20.756354 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5cc71-9de1-46c4-b683-9cc5f22ec9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:20.776307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-fbf5cc71-9de1-46c4-b683-9cc5f22ec9f9 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:20.777531 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fbf5cc71-9de1-46c4-b683-9cc5f22ec9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:20.834876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1427/2841] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:36:20.842972 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec712c1-fb72-440b-bcaf-4ae7a7ebf1a7 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:20.843261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec712c1-fb72-440b-bcaf-4ae7a7ebf1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:20.843537 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec712c1-fb72-440b-bcaf-4ae7a7ebf1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:20.865525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-3ec712c1-fb72-440b-bcaf-4ae7a7ebf1a7 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:20.867015 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3ec712c1-fb72-440b-bcaf-4ae7a7ebf1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:20.876252 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1415/2842] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:20.880637 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5cc71-9de1-46c4-b683-9cc5f22ec9f9 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:20.890506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5cc71-9de1-46c4-b683-9cc5f22ec9f9 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:20.895874 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b9fba-7c82-42fd-8dcf-eb71cab8f7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:20.896516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9fba-7c82-42fd-8dcf-eb71cab8f7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:20.896804 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9fba-7c82-42fd-8dcf-eb71cab8f7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:20.897086 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9fba-7c82-42fd-8dcf-eb71cab8f7a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:20.897777 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b9fba-7c82-42fd-8dcf-eb71cab8f7a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:36:20.898088 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b9fba-7c82-42fd-8dcf-eb71cab8f7a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:20.900229 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b9fba-7c82-42fd-8dcf-eb71cab8f7a4 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:20.912037 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1428/2843] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:36:20.916922 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec712c1-fb72-440b-bcaf-4ae7a7ebf1a7 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:20.926127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec712c1-fb72-440b-bcaf-4ae7a7ebf1a7 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:20.931082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c23a59-3321-4170-a165-309d8096da8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:20.931798 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c23a59-3321-4170-a165-309d8096da8d admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:20.932186 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c23a59-3321-4170-a165-309d8096da8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:20.932580 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c23a59-3321-4170-a165-309d8096da8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:20.933312 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c23a59-3321-4170-a165-309d8096da8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:20.935370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c23a59-3321-4170-a165-309d8096da8d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:20.962440 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1416/2844] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:36:20 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:36:20.966706 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b9fba-7c82-42fd-8dcf-eb71cab8f7a4 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:20.976662 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b9fba-7c82-42fd-8dcf-eb71cab8f7a4 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:21.034944 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1cfe8-2627-4091-89d5-b60a23a9a935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:21.035560 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1cfe8-2627-4091-89d5-b60a23a9a935 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:21.035841 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1cfe8-2627-4091-89d5-b60a23a9a935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:21.036117 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1cfe8-2627-4091-89d5-b60a23a9a935 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:21.036753 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1cfe8-2627-4091-89d5-b60a23a9a935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:21.038701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1cfe8-2627-4091-89d5-b60a23a9a935 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:21.065004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1429/2845] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:36:20 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:36:21.069607 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c23a59-3321-4170-a165-309d8096da8d admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:21.081796 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c23a59-3321-4170-a165-309d8096da8d admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:21.086517 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d6ddb-f713-421d-8152-4ad2520b36ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:21.087718 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d6ddb-f713-421d-8152-4ad2520b36ba admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:21.087998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d6ddb-f713-421d-8152-4ad2520b36ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:21.088261 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d6ddb-f713-421d-8152-4ad2520b36ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:21.088900 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d6ddb-f713-421d-8152-4ad2520b36ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:21.090529 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d6ddb-f713-421d-8152-4ad2520b36ba admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:21.101875 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1417/2846] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:21.106740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1cfe8-2627-4091-89d5-b60a23a9a935 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:21.118362 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1cfe8-2627-4091-89d5-b60a23a9a935 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:21.128452 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2107ffc-bae5-4834-bdf4-ddc549865540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:21.129383 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2107ffc-bae5-4834-bdf4-ddc549865540 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:21.129971 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2107ffc-bae5-4834-bdf4-ddc549865540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:21.130262 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2107ffc-bae5-4834-bdf4-ddc549865540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:21.131326 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2107ffc-bae5-4834-bdf4-ddc549865540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:21.134196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2107ffc-bae5-4834-bdf4-ddc549865540 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:21.146044 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1430/2847] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:21.151107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d6ddb-f713-421d-8152-4ad2520b36ba admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:21.161679 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d6ddb-f713-421d-8152-4ad2520b36ba admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:21.166448 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34f8d4-06e9-4512-a64c-3643199cf62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:21.167134 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34f8d4-06e9-4512-a64c-3643199cf62b admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:21.167423 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34f8d4-06e9-4512-a64c-3643199cf62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:21.167705 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34f8d4-06e9-4512-a64c-3643199cf62b admin admin] PATH_INFO: `/v3/projects/82668f097b124d7fa199dcca77897322/users/dd19e5610c5448b5929e3a43c11f7be5/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:21.182125 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34f8d4-06e9-4512-a64c-3643199cf62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=82668f097b124d7fa199dcca77897322, user_id=dd19e5610c5448b5929e3a43c11f7be5, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:21.184812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34f8d4-06e9-4512-a64c-3643199cf62b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:21.198297 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1418/2848] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:36:21 2022] PUT /identity/v3/projects/82668f097b124d7fa199dcca77897322/users/dd19e5610c5448b5929e3a43c11f7be5/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:21.208746 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638810-77db-43a1-8e38-aa7d237cbfcc None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:21.209038 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638810-77db-43a1-8e38-aa7d237cbfcc None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:21.209318 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638810-77db-43a1-8e38-aa7d237cbfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:21.237028 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d0638810-77db-43a1-8e38-aa7d237cbfcc None None] MFA Rules not processed for user `dd19e5610c5448b5929e3a43c11f7be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:21.238227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d0638810-77db-43a1-8e38-aa7d237cbfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:21.289354 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:21.314344 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1431/2849] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:21.319463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34f8d4-06e9-4512-a64c-3643199cf62b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:21.368787 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:21.389567 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34f8d4-06e9-4512-a64c-3643199cf62b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:21.394692 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07163de1-7e96-4e6f-b0fd-fc696f007316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:21.395505 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07163de1-7e96-4e6f-b0fd-fc696f007316 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:21.395815 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07163de1-7e96-4e6f-b0fd-fc696f007316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:21.396093 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07163de1-7e96-4e6f-b0fd-fc696f007316 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:21.396783 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07163de1-7e96-4e6f-b0fd-fc696f007316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:21.398777 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07163de1-7e96-4e6f-b0fd-fc696f007316 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:21.426258 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1419/2850] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:36:21 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:36:21.429618 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638810-77db-43a1-8e38-aa7d237cbfcc None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:21.440930 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638810-77db-43a1-8e38-aa7d237cbfcc None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:21.501423 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40b12b-db8c-4e61-86da-55cf2c9fb799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:21.502033 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40b12b-db8c-4e61-86da-55cf2c9fb799 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:21.502315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40b12b-db8c-4e61-86da-55cf2c9fb799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:21.502594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40b12b-db8c-4e61-86da-55cf2c9fb799 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:21.503267 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40b12b-db8c-4e61-86da-55cf2c9fb799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:21.505192 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40b12b-db8c-4e61-86da-55cf2c9fb799 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:21.527190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1432/2851] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:36:21 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:36:21.531552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07163de1-7e96-4e6f-b0fd-fc696f007316 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:21.542898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07163de1-7e96-4e6f-b0fd-fc696f007316 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:21.547911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502651ed-3bac-4e8c-ae30-ed7145f044e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:21.548577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502651ed-3bac-4e8c-ae30-ed7145f044e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:21.548863 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502651ed-3bac-4e8c-ae30-ed7145f044e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:21.549194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502651ed-3bac-4e8c-ae30-ed7145f044e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:21.549936 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502651ed-3bac-4e8c-ae30-ed7145f044e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:21.551702 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502651ed-3bac-4e8c-ae30-ed7145f044e9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:21.564514 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1420/2852] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:21.568615 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40b12b-db8c-4e61-86da-55cf2c9fb799 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:21.579858 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40b12b-db8c-4e61-86da-55cf2c9fb799 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:21.584857 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325ee11-48fc-4fd2-8b67-69021e4ad4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:21.585507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325ee11-48fc-4fd2-8b67-69021e4ad4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:21.585788 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325ee11-48fc-4fd2-8b67-69021e4ad4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:21.586064 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325ee11-48fc-4fd2-8b67-69021e4ad4cd admin admin] PATH_INFO: `/v3/projects/ba13744f2d4a4242ad9b3fc148481c36/users/b42460c1cec44ed0a0c0a4cac4fc6bfb/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:21.600851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325ee11-48fc-4fd2-8b67-69021e4ad4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba13744f2d4a4242ad9b3fc148481c36, user_id=b42460c1cec44ed0a0c0a4cac4fc6bfb, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:21.603588 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325ee11-48fc-4fd2-8b67-69021e4ad4cd admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:21.616464 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1433/2853] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:36:21 2022] PUT /identity/v3/projects/ba13744f2d4a4242ad9b3fc148481c36/users/b42460c1cec44ed0a0c0a4cac4fc6bfb/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:21.620893 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502651ed-3bac-4e8c-ae30-ed7145f044e9 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:21.630992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502651ed-3bac-4e8c-ae30-ed7145f044e9 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:21.687337 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53a64a-a110-48f6-a281-9541c13d9711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:21.687993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53a64a-a110-48f6-a281-9541c13d9711 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:21.688292 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53a64a-a110-48f6-a281-9541c13d9711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:21.688700 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53a64a-a110-48f6-a281-9541c13d9711 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:21.689362 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53a64a-a110-48f6-a281-9541c13d9711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:21.691225 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53a64a-a110-48f6-a281-9541c13d9711 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:21.702243 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1421/2854] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:21.707026 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325ee11-48fc-4fd2-8b67-69021e4ad4cd admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:21.717895 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325ee11-48fc-4fd2-8b67-69021e4ad4cd admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:21.723122 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947724a4-85e0-4a9b-9c17-dacf87d72ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:21.723845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947724a4-85e0-4a9b-9c17-dacf87d72ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:21.724168 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947724a4-85e0-4a9b-9c17-dacf87d72ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:21.724487 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947724a4-85e0-4a9b-9c17-dacf87d72ae0 admin admin] PATH_INFO: `/v3/projects/ba13744f2d4a4242ad9b3fc148481c36/users/b42460c1cec44ed0a0c0a4cac4fc6bfb/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:21.727048 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947724a4-85e0-4a9b-9c17-dacf87d72ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba13744f2d4a4242ad9b3fc148481c36, user_id=b42460c1cec44ed0a0c0a4cac4fc6bfb, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:21.729760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947724a4-85e0-4a9b-9c17-dacf87d72ae0 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:21.740839 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1434/2855] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:36:21 2022] PUT /identity/v3/projects/ba13744f2d4a4242ad9b3fc148481c36/users/b42460c1cec44ed0a0c0a4cac4fc6bfb/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:21.807134 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ac455-c295-4be4-8d9f-df946577bc31 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:21.807453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ac455-c295-4be4-8d9f-df946577bc31 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:21.807731 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ac455-c295-4be4-8d9f-df946577bc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:21.837067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-ee7ac455-c295-4be4-8d9f-df946577bc31 None None] MFA Rules not processed for user `b42460c1cec44ed0a0c0a4cac4fc6bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:21.838283 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ee7ac455-c295-4be4-8d9f-df946577bc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:21.919347 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1422/2856] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:21.930305 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947724a4-85e0-4a9b-9c17-dacf87d72ae0 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:21.932725 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-947724a4-85e0-4a9b-9c17-dacf87d72ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:21.991286 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947724a4-85e0-4a9b-9c17-dacf87d72ae0 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:21.995500 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3c766-b934-40a1-86c9-d81f6499c29b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:21.996095 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3c766-b934-40a1-86c9-d81f6499c29b service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:21.996377 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3c766-b934-40a1-86c9-d81f6499c29b service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:21.996651 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3c766-b934-40a1-86c9-d81f6499c29b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:22.042300 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:22.054480 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3c766-b934-40a1-86c9-d81f6499c29b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:22.056852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3c766-b934-40a1-86c9-d81f6499c29b service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:22.065817 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1435/2857] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:36:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:36:26.326807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ac455-c295-4be4-8d9f-df946577bc31 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:26.328231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ee7ac455-c295-4be4-8d9f-df946577bc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:26.340815 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ac455-c295-4be4-8d9f-df946577bc31 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:26.344405 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3348ced-771f-48b1-886d-113271f33ca3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:26.345000 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3348ced-771f-48b1-886d-113271f33ca3 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:26.345292 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3348ced-771f-48b1-886d-113271f33ca3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:26.345613 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3348ced-771f-48b1-886d-113271f33ca3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:26.354343 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3348ced-771f-48b1-886d-113271f33ca3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:26.355838 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3348ced-771f-48b1-886d-113271f33ca3 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:26.365124 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1423/2858] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:36:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:36:31.245037 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3c766-b934-40a1-86c9-d81f6499c29b service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:31.306977 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3c766-b934-40a1-86c9-d81f6499c29b service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:31.311545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdb550-e854-42ba-9fa9-855ff82d7aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:31.312167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdb550-e854-42ba-9fa9-855ff82d7aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:31.312450 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdb550-e854-42ba-9fa9-855ff82d7aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:31.312728 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdb550-e854-42ba-9fa9-855ff82d7aeb admin admin] PATH_INFO: `/v3/users/dd19e5610c5448b5929e3a43c11f7be5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:31.313845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdb550-e854-42ba-9fa9-855ff82d7aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd19e5610c5448b5929e3a43c11f7be5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:31.315879 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdb550-e854-42ba-9fa9-855ff82d7aeb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:31.360731 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-17bdb550-e854-42ba-9fa9-855ff82d7aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd19e5610c5448b5929e3a43c11f7be5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:31.367553 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-17bdb550-e854-42ba-9fa9-855ff82d7aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd19e5610c5448b5929e3a43c11f7be5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:31.379922 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-17bdb550-e854-42ba-9fa9-855ff82d7aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd19e5610c5448b5929e3a43c11f7be5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:31.380587 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-17bdb550-e854-42ba-9fa9-855ff82d7aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd19e5610c5448b5929e3a43c11f7be5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:31.387772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-17bdb550-e854-42ba-9fa9-855ff82d7aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd19e5610c5448b5929e3a43c11f7be5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:31.394707 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1436/2859] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:36:31 2022] DELETE /identity/v3/users/dd19e5610c5448b5929e3a43c11f7be5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:31.398957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4d081-2520-4498-8400-4920e6f05c9b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:31.400009 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4d081-2520-4498-8400-4920e6f05c9b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:31.400009 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4d081-2520-4498-8400-4920e6f05c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:31.422336 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-14b4d081-2520-4498-8400-4920e6f05c9b None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:31.423591 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-14b4d081-2520-4498-8400-4920e6f05c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:31.442171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:31.483284 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1424/2860] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:31.492760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdb550-e854-42ba-9fa9-855ff82d7aeb admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:31.494164 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-17bdb550-e854-42ba-9fa9-855ff82d7aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:31.552687 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdb550-e854-42ba-9fa9-855ff82d7aeb admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:31.556366 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cc6b6-f876-40e2-8cef-b7b711538f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:31.556968 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cc6b6-f876-40e2-8cef-b7b711538f53 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:31.557251 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cc6b6-f876-40e2-8cef-b7b711538f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:31.557551 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cc6b6-f876-40e2-8cef-b7b711538f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:31.566471 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cc6b6-f876-40e2-8cef-b7b711538f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:31.567940 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cc6b6-f876-40e2-8cef-b7b711538f53 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:31.579118 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1437/2861] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:36:31.837799 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4d081-2520-4498-8400-4920e6f05c9b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:31.839345 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-14b4d081-2520-4498-8400-4920e6f05c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:31.856348 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4d081-2520-4498-8400-4920e6f05c9b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:31.861226 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb597e4-640f-416c-bd61-1455c21b7fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:31.861846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb597e4-640f-416c-bd61-1455c21b7fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:31.862231 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb597e4-640f-416c-bd61-1455c21b7fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:31.862392 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb597e4-640f-416c-bd61-1455c21b7fd3 admin admin] PATH_INFO: `/v3/projects/82668f097b124d7fa199dcca77897322` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:31.864036 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb597e4-640f-416c-bd61-1455c21b7fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82668f097b124d7fa199dcca77897322)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:31.865975 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb597e4-640f-416c-bd61-1455c21b7fd3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:31.913331 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ccb597e4-640f-416c-bd61-1455c21b7fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82668f097b124d7fa199dcca77897322', 'request_id': 'req-ccb597e4-640f-416c-bd61-1455c21b7fd3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:31.918702 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ccb597e4-640f-416c-bd61-1455c21b7fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82668f097b124d7fa199dcca77897322', 'request_id': 'req-ccb597e4-640f-416c-bd61-1455c21b7fd3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:31.924790 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ccb597e4-640f-416c-bd61-1455c21b7fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82668f097b124d7fa199dcca77897322', 'request_id': 'req-ccb597e4-640f-416c-bd61-1455c21b7fd3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:31.937107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ccb597e4-640f-416c-bd61-1455c21b7fd3 admin admin] The token cache is being invalidate because project 82668f097b124d7fa199dcca77897322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:36:31.937401 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ccb597e4-640f-416c-bd61-1455c21b7fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:31.938020 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ccb597e4-640f-416c-bd61-1455c21b7fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:31.939522 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1425/2862] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:36:31 2022] DELETE /identity/v3/projects/82668f097b124d7fa199dcca77897322 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:31.943533 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cc6b6-f876-40e2-8cef-b7b711538f53 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:31.953803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cc6b6-f876-40e2-8cef-b7b711538f53 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:31.961506 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:32.011149 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14d0ad-dd0c-42db-8f71-e95b1a0b873b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:32.011773 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14d0ad-dd0c-42db-8f71-e95b1a0b873b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:32.012055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14d0ad-dd0c-42db-8f71-e95b1a0b873b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:32.012334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14d0ad-dd0c-42db-8f71-e95b1a0b873b admin admin] PATH_INFO: `/v3/users/b42460c1cec44ed0a0c0a4cac4fc6bfb` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:32.013479 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14d0ad-dd0c-42db-8f71-e95b1a0b873b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42460c1cec44ed0a0c0a4cac4fc6bfb)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:32.015448 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14d0ad-dd0c-42db-8f71-e95b1a0b873b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:32.060320 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5c14d0ad-dd0c-42db-8f71-e95b1a0b873b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42460c1cec44ed0a0c0a4cac4fc6bfb'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:32.067036 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5c14d0ad-dd0c-42db-8f71-e95b1a0b873b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42460c1cec44ed0a0c0a4cac4fc6bfb'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:32.078766 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5c14d0ad-dd0c-42db-8f71-e95b1a0b873b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42460c1cec44ed0a0c0a4cac4fc6bfb'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:32.079429 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5c14d0ad-dd0c-42db-8f71-e95b1a0b873b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42460c1cec44ed0a0c0a4cac4fc6bfb'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:32.087373 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5c14d0ad-dd0c-42db-8f71-e95b1a0b873b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42460c1cec44ed0a0c0a4cac4fc6bfb'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:32.093183 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1438/2863] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:36:31 2022] DELETE /identity/v3/users/b42460c1cec44ed0a0c0a4cac4fc6bfb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:32.357717 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb597e4-640f-416c-bd61-1455c21b7fd3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:32.359187 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ccb597e4-640f-416c-bd61-1455c21b7fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:32.372436 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb597e4-640f-416c-bd61-1455c21b7fd3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:32.429034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16d980-fc03-4d76-880c-ae1c55565336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:32.429683 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16d980-fc03-4d76-880c-ae1c55565336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:32.429927 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16d980-fc03-4d76-880c-ae1c55565336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:32.430218 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16d980-fc03-4d76-880c-ae1c55565336 admin admin] PATH_INFO: `/v3/projects/ba13744f2d4a4242ad9b3fc148481c36` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:32.431346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16d980-fc03-4d76-880c-ae1c55565336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba13744f2d4a4242ad9b3fc148481c36)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:32.433268 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16d980-fc03-4d76-880c-ae1c55565336 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:32.480685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fc16d980-fc03-4d76-880c-ae1c55565336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba13744f2d4a4242ad9b3fc148481c36', 'request_id': 'req-fc16d980-fc03-4d76-880c-ae1c55565336'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:32.481879 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:32.487521 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fc16d980-fc03-4d76-880c-ae1c55565336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba13744f2d4a4242ad9b3fc148481c36', 'request_id': 'req-fc16d980-fc03-4d76-880c-ae1c55565336'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:32.495626 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fc16d980-fc03-4d76-880c-ae1c55565336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba13744f2d4a4242ad9b3fc148481c36', 'request_id': 'req-fc16d980-fc03-4d76-880c-ae1c55565336'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:32.507971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fc16d980-fc03-4d76-880c-ae1c55565336 admin admin] The token cache is being invalidate because project ba13744f2d4a4242ad9b3fc148481c36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:36:32.508254 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fc16d980-fc03-4d76-880c-ae1c55565336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:32.508909 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fc16d980-fc03-4d76-880c-ae1c55565336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:32.510394 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1426/2864] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:36:32 2022] DELETE /identity/v3/projects/ba13744f2d4a4242ad9b3fc148481c36 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:32.516558 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee07b1-6851-4308-80f8-84e7f17170d3 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:32.517085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee07b1-6851-4308-80f8-84e7f17170d3 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:32.517246 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee07b1-6851-4308-80f8-84e7f17170d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:32.536572 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-56ee07b1-6851-4308-80f8-84e7f17170d3 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:32.537763 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-56ee07b1-6851-4308-80f8-84e7f17170d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:32.596462 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1439/2865] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:36:32.605306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12b70f-0465-49fb-86be-646ce57461aa None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:32.605528 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12b70f-0465-49fb-86be-646ce57461aa None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:32.605940 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12b70f-0465-49fb-86be-646ce57461aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:32.626127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-ce12b70f-0465-49fb-86be-646ce57461aa None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:32.627409 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ce12b70f-0465-49fb-86be-646ce57461aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:32.635171 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1427/2866] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:32.639305 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee07b1-6851-4308-80f8-84e7f17170d3 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:32.649645 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee07b1-6851-4308-80f8-84e7f17170d3 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:32.654156 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc407d-7bfa-4d52-bff3-3f5b1ffc53e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:32.654769 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc407d-7bfa-4d52-bff3-3f5b1ffc53e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:32.655085 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc407d-7bfa-4d52-bff3-3f5b1ffc53e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:32.655355 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc407d-7bfa-4d52-bff3-3f5b1ffc53e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:32.656002 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc407d-7bfa-4d52-bff3-3f5b1ffc53e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:36:32.656308 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc407d-7bfa-4d52-bff3-3f5b1ffc53e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:32.657888 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc407d-7bfa-4d52-bff3-3f5b1ffc53e1 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:32.669389 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1440/2867] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:36:32.673552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12b70f-0465-49fb-86be-646ce57461aa None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:32.683104 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12b70f-0465-49fb-86be-646ce57461aa None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:32.687696 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caab98-1aa3-4eb8-841e-8465e6b2ea35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:32.688284 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caab98-1aa3-4eb8-841e-8465e6b2ea35 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:32.688564 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caab98-1aa3-4eb8-841e-8465e6b2ea35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:32.688838 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caab98-1aa3-4eb8-841e-8465e6b2ea35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:32.689469 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4caab98-1aa3-4eb8-841e-8465e6b2ea35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:32.691433 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4caab98-1aa3-4eb8-841e-8465e6b2ea35 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:32.717607 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1428/2868] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:36:32 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:36:32.721877 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc407d-7bfa-4d52-bff3-3f5b1ffc53e1 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:32.731987 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc407d-7bfa-4d52-bff3-3f5b1ffc53e1 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:32.744570 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:32.790350 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c69f3-99c6-43af-8103-28516972eeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:32.791004 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c69f3-99c6-43af-8103-28516972eeb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:32.791311 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c69f3-99c6-43af-8103-28516972eeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:32.791586 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c69f3-99c6-43af-8103-28516972eeb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:32.792227 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c69f3-99c6-43af-8103-28516972eeb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:32.794139 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c69f3-99c6-43af-8103-28516972eeb3 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:32.814680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1441/2869] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:36:32 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:36:32.818786 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caab98-1aa3-4eb8-841e-8465e6b2ea35 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:32.829737 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caab98-1aa3-4eb8-841e-8465e6b2ea35 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:32.834344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80432ddb-c10f-4ed9-9741-90a1cf1ca606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:32.834973 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80432ddb-c10f-4ed9-9741-90a1cf1ca606 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:32.835260 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80432ddb-c10f-4ed9-9741-90a1cf1ca606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:32.835535 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80432ddb-c10f-4ed9-9741-90a1cf1ca606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:32.836181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80432ddb-c10f-4ed9-9741-90a1cf1ca606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:32.837817 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80432ddb-c10f-4ed9-9741-90a1cf1ca606 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:32.847530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1429/2870] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:32.851239 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c69f3-99c6-43af-8103-28516972eeb3 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:32.861163 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c69f3-99c6-43af-8103-28516972eeb3 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:32.865772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac68e3-6b67-4b2d-98ef-8e5283b0220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:32.866367 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac68e3-6b67-4b2d-98ef-8e5283b0220e admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:32.866650 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac68e3-6b67-4b2d-98ef-8e5283b0220e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:32.866952 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac68e3-6b67-4b2d-98ef-8e5283b0220e admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:32.867593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac68e3-6b67-4b2d-98ef-8e5283b0220e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:32.869686 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac68e3-6b67-4b2d-98ef-8e5283b0220e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:32.880231 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1442/2871] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:32.885371 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80432ddb-c10f-4ed9-9741-90a1cf1ca606 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:32.897295 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80432ddb-c10f-4ed9-9741-90a1cf1ca606 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:32.904807 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47713c74-895a-441e-b1a7-156a4dbcefff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:32.905475 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713c74-895a-441e-b1a7-156a4dbcefff admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:32.905758 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713c74-895a-441e-b1a7-156a4dbcefff admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:32.906653 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713c74-895a-441e-b1a7-156a4dbcefff admin admin] PATH_INFO: `/v3/projects/227d44e29daa401fbcbcb8bf07b69ab1/users/4da8dc6faa5548418d226abd8773b2b1/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:32.922943 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47713c74-895a-441e-b1a7-156a4dbcefff admin admin] RBAC: Authorizing `identity:create_grant(project_id=227d44e29daa401fbcbcb8bf07b69ab1, user_id=4da8dc6faa5548418d226abd8773b2b1, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:32.925681 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47713c74-895a-441e-b1a7-156a4dbcefff admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:32.938913 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1430/2872] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:36:32 2022] PUT /identity/v3/projects/227d44e29daa401fbcbcb8bf07b69ab1/users/4da8dc6faa5548418d226abd8773b2b1/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:32.950145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7edd6-f090-4b80-9015-40cf7b32dbd5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:32.950428 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7edd6-f090-4b80-9015-40cf7b32dbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:32.950698 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7edd6-f090-4b80-9015-40cf7b32dbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:32.977415 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8ee7edd6-f090-4b80-9015-40cf7b32dbd5 None None] MFA Rules not processed for user `4da8dc6faa5548418d226abd8773b2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:32.978610 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8ee7edd6-f090-4b80-9015-40cf7b32dbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:33.041072 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1443/2873] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:36:33.045463 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47713c74-895a-441e-b1a7-156a4dbcefff admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:33.107627 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47713c74-895a-441e-b1a7-156a4dbcefff admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:33.112283 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a690dd6-31c1-48e6-b8c8-dcaed8c5616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:33.112830 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a690dd6-31c1-48e6-b8c8-dcaed8c5616e admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:33.113110 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a690dd6-31c1-48e6-b8c8-dcaed8c5616e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:33.113385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a690dd6-31c1-48e6-b8c8-dcaed8c5616e admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:33.114023 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a690dd6-31c1-48e6-b8c8-dcaed8c5616e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:33.115976 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a690dd6-31c1-48e6-b8c8-dcaed8c5616e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:33.142134 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1431/2874] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:36:33 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:36:33.146132 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7edd6-f090-4b80-9015-40cf7b32dbd5 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:33.157413 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7edd6-f090-4b80-9015-40cf7b32dbd5 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:33.236929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501911c-24ee-470b-9c42-f8a62d12a0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:33.237544 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501911c-24ee-470b-9c42-f8a62d12a0fd admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:33.237825 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501911c-24ee-470b-9c42-f8a62d12a0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:33.238127 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501911c-24ee-470b-9c42-f8a62d12a0fd admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:33.238780 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501911c-24ee-470b-9c42-f8a62d12a0fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:33.240764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501911c-24ee-470b-9c42-f8a62d12a0fd admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:33.266916 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1444/2875] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:36:33 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:36:33.271182 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a690dd6-31c1-48e6-b8c8-dcaed8c5616e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:33.281859 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a690dd6-31c1-48e6-b8c8-dcaed8c5616e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:33.286369 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df0202-79cf-4958-860c-7a3558074887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:33.286995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df0202-79cf-4958-860c-7a3558074887 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:33.287277 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df0202-79cf-4958-860c-7a3558074887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:33.287550 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df0202-79cf-4958-860c-7a3558074887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:33.288192 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df0202-79cf-4958-860c-7a3558074887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:33.292211 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df0202-79cf-4958-860c-7a3558074887 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:33.303467 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1432/2876] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:33.308050 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501911c-24ee-470b-9c42-f8a62d12a0fd admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:33.317890 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501911c-24ee-470b-9c42-f8a62d12a0fd admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:33.322449 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eb0d8-3115-4b03-ae95-a8c8d751bdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:33.323077 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eb0d8-3115-4b03-ae95-a8c8d751bdac admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:33.323357 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eb0d8-3115-4b03-ae95-a8c8d751bdac admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:33.323632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eb0d8-3115-4b03-ae95-a8c8d751bdac admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:33.324278 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2eb0d8-3115-4b03-ae95-a8c8d751bdac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:33.325870 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2eb0d8-3115-4b03-ae95-a8c8d751bdac admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:33.335516 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1445/2877] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:36:33.339356 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df0202-79cf-4958-860c-7a3558074887 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:33.349035 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df0202-79cf-4958-860c-7a3558074887 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:33.354019 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bebd7-a7d3-4931-bf57-507e428c1545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:33.354647 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bebd7-a7d3-4931-bf57-507e428c1545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:33.354958 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bebd7-a7d3-4931-bf57-507e428c1545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:33.355233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bebd7-a7d3-4931-bf57-507e428c1545 admin admin] PATH_INFO: `/v3/projects/916e75214ab24248b1800fda0feb3b33/users/4792d6c74d7545e9b7400e440a2b10ab/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:33.369866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bebd7-a7d3-4931-bf57-507e428c1545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=916e75214ab24248b1800fda0feb3b33, user_id=4792d6c74d7545e9b7400e440a2b10ab, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:33.372742 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bebd7-a7d3-4931-bf57-507e428c1545 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:33.384965 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1433/2878] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:36:33 2022] PUT /identity/v3/projects/916e75214ab24248b1800fda0feb3b33/users/4792d6c74d7545e9b7400e440a2b10ab/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:33.396469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506554f4-6d64-440f-85cb-36a14a33acd6 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:33.396759 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506554f4-6d64-440f-85cb-36a14a33acd6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:33.397039 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506554f4-6d64-440f-85cb-36a14a33acd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:33.406365 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:33.427742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-506554f4-6d64-440f-85cb-36a14a33acd6 None None] MFA Rules not processed for user `4792d6c74d7545e9b7400e440a2b10ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:33.428942 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-506554f4-6d64-440f-85cb-36a14a33acd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:33.490975 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1446/2879] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:33.495518 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bebd7-a7d3-4931-bf57-507e428c1545 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:33.521820 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:33.560732 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bebd7-a7d3-4931-bf57-507e428c1545 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:33.565422 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5b0f7-a82f-4031-8db6-438b97737a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:33.566034 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5b0f7-a82f-4031-8db6-438b97737a70 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:33.566320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5b0f7-a82f-4031-8db6-438b97737a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:33.566597 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5b0f7-a82f-4031-8db6-438b97737a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:33.567272 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5b0f7-a82f-4031-8db6-438b97737a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:33.569189 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5b0f7-a82f-4031-8db6-438b97737a70 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:33.599673 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1434/2880] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:36:33 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:36:33.601232 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506554f4-6d64-440f-85cb-36a14a33acd6 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:33.612555 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506554f4-6d64-440f-85cb-36a14a33acd6 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:33.667772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d66c33-ece3-4ea1-824f-1a653afbe805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:33.668376 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d66c33-ece3-4ea1-824f-1a653afbe805 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:33.668659 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d66c33-ece3-4ea1-824f-1a653afbe805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:33.668936 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d66c33-ece3-4ea1-824f-1a653afbe805 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:33.669569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d66c33-ece3-4ea1-824f-1a653afbe805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:33.671571 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d66c33-ece3-4ea1-824f-1a653afbe805 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:33.692273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1447/2881] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:36:33 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:36:33.696215 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5b0f7-a82f-4031-8db6-438b97737a70 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:33.706457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5b0f7-a82f-4031-8db6-438b97737a70 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:33.711151 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f12b77-0369-49e7-a3a7-6e599cf4f9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:33.712239 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f12b77-0369-49e7-a3a7-6e599cf4f9ba admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:33.712525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f12b77-0369-49e7-a3a7-6e599cf4f9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:33.712803 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f12b77-0369-49e7-a3a7-6e599cf4f9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:33.713453 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f12b77-0369-49e7-a3a7-6e599cf4f9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:33.715096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f12b77-0369-49e7-a3a7-6e599cf4f9ba admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:33.726320 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1435/2882] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:33.730334 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d66c33-ece3-4ea1-824f-1a653afbe805 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:33.740186 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d66c33-ece3-4ea1-824f-1a653afbe805 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:33.745233 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2b81d-9769-4602-ab20-cdb45413d6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:33.745867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2b81d-9769-4602-ab20-cdb45413d6c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:33.746145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2b81d-9769-4602-ab20-cdb45413d6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:33.746418 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2b81d-9769-4602-ab20-cdb45413d6c7 admin admin] PATH_INFO: `/v3/projects/62e86e834fef4bf4ba44e565cdc29715/users/d86b21b6fa9a4e7a9d0686a77ee6aa24/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:33.761852 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2b81d-9769-4602-ab20-cdb45413d6c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e86e834fef4bf4ba44e565cdc29715, user_id=d86b21b6fa9a4e7a9d0686a77ee6aa24, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:33.764628 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2b81d-9769-4602-ab20-cdb45413d6c7 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:33.777006 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1448/2883] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:36:33 2022] PUT /identity/v3/projects/62e86e834fef4bf4ba44e565cdc29715/users/d86b21b6fa9a4e7a9d0686a77ee6aa24/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:33.781027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f12b77-0369-49e7-a3a7-6e599cf4f9ba admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:33.791789 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f12b77-0369-49e7-a3a7-6e599cf4f9ba admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:33.847966 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745afd8-0db7-4d55-aaaf-c77ce985cf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:33.848644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745afd8-0db7-4d55-aaaf-c77ce985cf5f admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:33.848909 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745afd8-0db7-4d55-aaaf-c77ce985cf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:33.849183 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745afd8-0db7-4d55-aaaf-c77ce985cf5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:33.849824 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745afd8-0db7-4d55-aaaf-c77ce985cf5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:33.851459 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745afd8-0db7-4d55-aaaf-c77ce985cf5f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:33.861662 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1436/2884] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:33.865816 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2b81d-9769-4602-ab20-cdb45413d6c7 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:33.876914 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2b81d-9769-4602-ab20-cdb45413d6c7 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:33.881452 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459f308-9760-4254-9d64-af318a219be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:33.882096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459f308-9760-4254-9d64-af318a219be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:33.882381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459f308-9760-4254-9d64-af318a219be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:33.882656 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459f308-9760-4254-9d64-af318a219be0 admin admin] PATH_INFO: `/v3/projects/62e86e834fef4bf4ba44e565cdc29715/users/d86b21b6fa9a4e7a9d0686a77ee6aa24/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:33.884594 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459f308-9760-4254-9d64-af318a219be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e86e834fef4bf4ba44e565cdc29715, user_id=d86b21b6fa9a4e7a9d0686a77ee6aa24, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:33.887258 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459f308-9760-4254-9d64-af318a219be0 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:33.897591 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1449/2885] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:36:33 2022] PUT /identity/v3/projects/62e86e834fef4bf4ba44e565cdc29715/users/d86b21b6fa9a4e7a9d0686a77ee6aa24/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:33.908084 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19b0c1-4ad5-40cd-9f25-b192a0b0780d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:33.908378 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19b0c1-4ad5-40cd-9f25-b192a0b0780d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:33.908661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19b0c1-4ad5-40cd-9f25-b192a0b0780d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:33.937182 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-ee19b0c1-4ad5-40cd-9f25-b192a0b0780d None None] MFA Rules not processed for user `d86b21b6fa9a4e7a9d0686a77ee6aa24`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:33.938328 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ee19b0c1-4ad5-40cd-9f25-b192a0b0780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:34.005420 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1437/2886] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:34.017469 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459f308-9760-4254-9d64-af318a219be0 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:34.019262 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7459f308-9760-4254-9d64-af318a219be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:34.071909 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:34.077588 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459f308-9760-4254-9d64-af318a219be0 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:34.081529 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312151ff-f87e-429c-a6d1-bc24798b1aa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:34.082120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312151ff-f87e-429c-a6d1-bc24798b1aa8 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:34.082398 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312151ff-f87e-429c-a6d1-bc24798b1aa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:34.082666 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312151ff-f87e-429c-a6d1-bc24798b1aa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:34.137993 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312151ff-f87e-429c-a6d1-bc24798b1aa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:34.139437 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312151ff-f87e-429c-a6d1-bc24798b1aa8 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:34.148000 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1450/2887] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:36:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:36:35.636294 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19b0c1-4ad5-40cd-9f25-b192a0b0780d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:35.637706 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ee19b0c1-4ad5-40cd-9f25-b192a0b0780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:35.649986 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19b0c1-4ad5-40cd-9f25-b192a0b0780d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:35.653541 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17ec3d-1bb7-4d98-bc29-c95818c8c24f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:35.654133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17ec3d-1bb7-4d98-bc29-c95818c8c24f service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:35.654414 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17ec3d-1bb7-4d98-bc29-c95818c8c24f service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:35.654689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17ec3d-1bb7-4d98-bc29-c95818c8c24f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:35.672890 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:35.712845 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17ec3d-1bb7-4d98-bc29-c95818c8c24f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:35.714274 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17ec3d-1bb7-4d98-bc29-c95818c8c24f service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:35.723024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1438/2888] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:36:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:36:36.249446 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312151ff-f87e-429c-a6d1-bc24798b1aa8 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:36.257965 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312151ff-f87e-429c-a6d1-bc24798b1aa8 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:36.262458 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac097c-88dc-4a25-b822-919d6478a6d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:36.263154 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac097c-88dc-4a25-b822-919d6478a6d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:36.263436 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac097c-88dc-4a25-b822-919d6478a6d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:36.263709 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac097c-88dc-4a25-b822-919d6478a6d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:36.272678 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac097c-88dc-4a25-b822-919d6478a6d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:36.274677 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac097c-88dc-4a25-b822-919d6478a6d2 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:36.284000 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1451/2889] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:36:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:36:40.162535 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17ec3d-1bb7-4d98-bc29-c95818c8c24f service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:40.224410 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17ec3d-1bb7-4d98-bc29-c95818c8c24f service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:40.229194 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ecfd7-8cc9-4a52-81ae-69885a195f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:40.229822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ecfd7-8cc9-4a52-81ae-69885a195f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:40.230096 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ecfd7-8cc9-4a52-81ae-69885a195f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:40.230370 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ecfd7-8cc9-4a52-81ae-69885a195f7d admin admin] PATH_INFO: `/v3/users/4da8dc6faa5548418d226abd8773b2b1` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:40.231808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ecfd7-8cc9-4a52-81ae-69885a195f7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4da8dc6faa5548418d226abd8773b2b1)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:40.233741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ecfd7-8cc9-4a52-81ae-69885a195f7d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:40.283681 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f51ecfd7-8cc9-4a52-81ae-69885a195f7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4da8dc6faa5548418d226abd8773b2b1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:40.290397 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f51ecfd7-8cc9-4a52-81ae-69885a195f7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4da8dc6faa5548418d226abd8773b2b1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:40.291083 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f51ecfd7-8cc9-4a52-81ae-69885a195f7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4da8dc6faa5548418d226abd8773b2b1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:40.303552 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f51ecfd7-8cc9-4a52-81ae-69885a195f7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4da8dc6faa5548418d226abd8773b2b1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:40.311436 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f51ecfd7-8cc9-4a52-81ae-69885a195f7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4da8dc6faa5548418d226abd8773b2b1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:40.323504 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1439/2890] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:36:40 2022] DELETE /identity/v3/users/4da8dc6faa5548418d226abd8773b2b1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:36:40.328139 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7630333-8857-48bd-8348-870b12a4306d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:40.328646 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7630333-8857-48bd-8348-870b12a4306d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:40.328749 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7630333-8857-48bd-8348-870b12a4306d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:40.349603 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c7630333-8857-48bd-8348-870b12a4306d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:40.350778 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c7630333-8857-48bd-8348-870b12a4306d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:40.410292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1452/2891] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:36:40.420068 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ecfd7-8cc9-4a52-81ae-69885a195f7d admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:40.421488 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f51ecfd7-8cc9-4a52-81ae-69885a195f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:40.464601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:40.481796 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ecfd7-8cc9-4a52-81ae-69885a195f7d admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:40.485458 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c251c-829f-476e-904d-69f1b5ddac86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:40.486070 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c251c-829f-476e-904d-69f1b5ddac86 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:40.486355 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c251c-829f-476e-904d-69f1b5ddac86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:40.486633 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c251c-829f-476e-904d-69f1b5ddac86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:40.496199 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c251c-829f-476e-904d-69f1b5ddac86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:40.497898 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c251c-829f-476e-904d-69f1b5ddac86 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:40.507424 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1440/2892] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:36:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:36:40.767851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7630333-8857-48bd-8348-870b12a4306d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:40.769315 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c7630333-8857-48bd-8348-870b12a4306d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:40.783633 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7630333-8857-48bd-8348-870b12a4306d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:40.788455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770dac0-3d83-42e1-b782-4433f477250b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:40.789093 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770dac0-3d83-42e1-b782-4433f477250b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:40.789884 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770dac0-3d83-42e1-b782-4433f477250b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:40.790162 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770dac0-3d83-42e1-b782-4433f477250b admin admin] PATH_INFO: `/v3/projects/227d44e29daa401fbcbcb8bf07b69ab1` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:40.791342 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770dac0-3d83-42e1-b782-4433f477250b admin admin] RBAC: Authorizing `identity:delete_project(project_id=227d44e29daa401fbcbcb8bf07b69ab1)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:40.793271 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770dac0-3d83-42e1-b782-4433f477250b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:40.839319 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e770dac0-3d83-42e1-b782-4433f477250b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227d44e29daa401fbcbcb8bf07b69ab1', 'request_id': 'req-e770dac0-3d83-42e1-b782-4433f477250b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:40.845379 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e770dac0-3d83-42e1-b782-4433f477250b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227d44e29daa401fbcbcb8bf07b69ab1', 'request_id': 'req-e770dac0-3d83-42e1-b782-4433f477250b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:40.854041 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e770dac0-3d83-42e1-b782-4433f477250b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227d44e29daa401fbcbcb8bf07b69ab1', 'request_id': 'req-e770dac0-3d83-42e1-b782-4433f477250b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:40.865035 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e770dac0-3d83-42e1-b782-4433f477250b admin admin] The token cache is being invalidate because project 227d44e29daa401fbcbcb8bf07b69ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:36:40.865331 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e770dac0-3d83-42e1-b782-4433f477250b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:40.865972 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e770dac0-3d83-42e1-b782-4433f477250b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:40.868073 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1453/2893] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:36:40 2022] DELETE /identity/v3/projects/227d44e29daa401fbcbcb8bf07b69ab1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:40.872489 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c251c-829f-476e-904d-69f1b5ddac86 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:40.882273 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c251c-829f-476e-904d-69f1b5ddac86 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:40.937851 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c36520-0004-4585-89e3-34788ab983fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:40.938505 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c36520-0004-4585-89e3-34788ab983fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:40.938822 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c36520-0004-4585-89e3-34788ab983fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:40.939101 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c36520-0004-4585-89e3-34788ab983fa admin admin] PATH_INFO: `/v3/users/4792d6c74d7545e9b7400e440a2b10ab` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:40.940298 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c36520-0004-4585-89e3-34788ab983fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4792d6c74d7545e9b7400e440a2b10ab)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:40.942233 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c36520-0004-4585-89e3-34788ab983fa admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:40.987503 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d8c36520-0004-4585-89e3-34788ab983fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4792d6c74d7545e9b7400e440a2b10ab'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:40.994394 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d8c36520-0004-4585-89e3-34788ab983fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4792d6c74d7545e9b7400e440a2b10ab'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:40.995082 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d8c36520-0004-4585-89e3-34788ab983fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4792d6c74d7545e9b7400e440a2b10ab'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:41.007151 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d8c36520-0004-4585-89e3-34788ab983fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4792d6c74d7545e9b7400e440a2b10ab'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:41.014169 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d8c36520-0004-4585-89e3-34788ab983fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4792d6c74d7545e9b7400e440a2b10ab'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:41.020012 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1441/2894] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:36:40 2022] DELETE /identity/v3/users/4792d6c74d7545e9b7400e440a2b10ab => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:41.527593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770dac0-3d83-42e1-b782-4433f477250b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:41.529197 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e770dac0-3d83-42e1-b782-4433f477250b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:41.542153 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770dac0-3d83-42e1-b782-4433f477250b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:41.551180 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:41.604372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedd1ca-a948-49ad-9c97-d2ced52acdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:41.605005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedd1ca-a948-49ad-9c97-d2ced52acdf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:41.605285 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedd1ca-a948-49ad-9c97-d2ced52acdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:41.605557 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedd1ca-a948-49ad-9c97-d2ced52acdf2 admin admin] PATH_INFO: `/v3/projects/916e75214ab24248b1800fda0feb3b33` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:41.606656 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedd1ca-a948-49ad-9c97-d2ced52acdf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=916e75214ab24248b1800fda0feb3b33)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:41.608648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedd1ca-a948-49ad-9c97-d2ced52acdf2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:41.656182 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6aedd1ca-a948-49ad-9c97-d2ced52acdf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '916e75214ab24248b1800fda0feb3b33', 'request_id': 'req-6aedd1ca-a948-49ad-9c97-d2ced52acdf2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:41.662298 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6aedd1ca-a948-49ad-9c97-d2ced52acdf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '916e75214ab24248b1800fda0feb3b33', 'request_id': 'req-6aedd1ca-a948-49ad-9c97-d2ced52acdf2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:41.669957 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6aedd1ca-a948-49ad-9c97-d2ced52acdf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '916e75214ab24248b1800fda0feb3b33', 'request_id': 'req-6aedd1ca-a948-49ad-9c97-d2ced52acdf2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:41.680894 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6aedd1ca-a948-49ad-9c97-d2ced52acdf2 admin admin] The token cache is being invalidate because project 916e75214ab24248b1800fda0feb3b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:36:41.681504 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6aedd1ca-a948-49ad-9c97-d2ced52acdf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:41.682151 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6aedd1ca-a948-49ad-9c97-d2ced52acdf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:41.683703 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1454/2895] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:36:41 2022] DELETE /identity/v3/projects/916e75214ab24248b1800fda0feb3b33 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:41.687756 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c36520-0004-4585-89e3-34788ab983fa admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:41.689191 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d8c36520-0004-4585-89e3-34788ab983fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:41.702928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c36520-0004-4585-89e3-34788ab983fa admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:41.759426 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294711c-a04d-47ac-a7bc-708b0b4b4a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:41.760061 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294711c-a04d-47ac-a7bc-708b0b4b4a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:41.760344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294711c-a04d-47ac-a7bc-708b0b4b4a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:41.760622 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294711c-a04d-47ac-a7bc-708b0b4b4a77 admin admin] PATH_INFO: `/v3/users/d86b21b6fa9a4e7a9d0686a77ee6aa24` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:41.761769 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294711c-a04d-47ac-a7bc-708b0b4b4a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86b21b6fa9a4e7a9d0686a77ee6aa24)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:41.763743 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294711c-a04d-47ac-a7bc-708b0b4b4a77 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:41.765237 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:41.811097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3294711c-a04d-47ac-a7bc-708b0b4b4a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86b21b6fa9a4e7a9d0686a77ee6aa24'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:41.818085 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3294711c-a04d-47ac-a7bc-708b0b4b4a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86b21b6fa9a4e7a9d0686a77ee6aa24'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:41.818828 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3294711c-a04d-47ac-a7bc-708b0b4b4a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86b21b6fa9a4e7a9d0686a77ee6aa24'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:41.831310 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3294711c-a04d-47ac-a7bc-708b0b4b4a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86b21b6fa9a4e7a9d0686a77ee6aa24'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:41.838982 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3294711c-a04d-47ac-a7bc-708b0b4b4a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86b21b6fa9a4e7a9d0686a77ee6aa24'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:41.844989 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1442/2896] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:36:41 2022] DELETE /identity/v3/users/d86b21b6fa9a4e7a9d0686a77ee6aa24 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:42.124106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedd1ca-a948-49ad-9c97-d2ced52acdf2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:42.125662 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6aedd1ca-a948-49ad-9c97-d2ced52acdf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:42.138709 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedd1ca-a948-49ad-9c97-d2ced52acdf2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:42.197897 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9909fba-38d4-4433-9d31-c911ebf26b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:42.198534 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9909fba-38d4-4433-9d31-c911ebf26b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:42.198850 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9909fba-38d4-4433-9d31-c911ebf26b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:42.199132 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9909fba-38d4-4433-9d31-c911ebf26b42 admin admin] PATH_INFO: `/v3/projects/62e86e834fef4bf4ba44e565cdc29715` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:42.200262 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9909fba-38d4-4433-9d31-c911ebf26b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e86e834fef4bf4ba44e565cdc29715)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:42.202194 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9909fba-38d4-4433-9d31-c911ebf26b42 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:42.245983 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:42.250648 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d9909fba-38d4-4433-9d31-c911ebf26b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e86e834fef4bf4ba44e565cdc29715', 'request_id': 'req-d9909fba-38d4-4433-9d31-c911ebf26b42'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:42.257416 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d9909fba-38d4-4433-9d31-c911ebf26b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e86e834fef4bf4ba44e565cdc29715', 'request_id': 'req-d9909fba-38d4-4433-9d31-c911ebf26b42'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:42.265512 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d9909fba-38d4-4433-9d31-c911ebf26b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e86e834fef4bf4ba44e565cdc29715', 'request_id': 'req-d9909fba-38d4-4433-9d31-c911ebf26b42'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:42.276360 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d9909fba-38d4-4433-9d31-c911ebf26b42 admin admin] The token cache is being invalidate because project 62e86e834fef4bf4ba44e565cdc29715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:36:42.276664 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d9909fba-38d4-4433-9d31-c911ebf26b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:42.277287 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d9909fba-38d4-4433-9d31-c911ebf26b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:42.278836 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1455/2897] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:36:42 2022] DELETE /identity/v3/projects/62e86e834fef4bf4ba44e565cdc29715 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:42.284006 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fba9b-795a-4680-9b5b-252efc7bfd71 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:42.284300 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fba9b-795a-4680-9b5b-252efc7bfd71 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:42.284583 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fba9b-795a-4680-9b5b-252efc7bfd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:42.308037 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-0e0fba9b-795a-4680-9b5b-252efc7bfd71 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:42.309459 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0e0fba9b-795a-4680-9b5b-252efc7bfd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:42.374755 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1443/2898] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:42.383254 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ae2da-c013-4d9a-88f8-f61f42ae50e9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:42.383562 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ae2da-c013-4d9a-88f8-f61f42ae50e9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:42.383836 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ae2da-c013-4d9a-88f8-f61f42ae50e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:42.405593 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-373ae2da-c013-4d9a-88f8-f61f42ae50e9 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:42.406845 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-373ae2da-c013-4d9a-88f8-f61f42ae50e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:42.415486 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1456/2899] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:42.419863 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fba9b-795a-4680-9b5b-252efc7bfd71 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:42.429685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fba9b-795a-4680-9b5b-252efc7bfd71 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:42.434482 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f863dd0-ddad-43e7-b4cb-040921789e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:42.435133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f863dd0-ddad-43e7-b4cb-040921789e3d admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:42.435446 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f863dd0-ddad-43e7-b4cb-040921789e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:42.435727 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f863dd0-ddad-43e7-b4cb-040921789e3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:42.436385 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f863dd0-ddad-43e7-b4cb-040921789e3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:36:42.436695 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f863dd0-ddad-43e7-b4cb-040921789e3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:42.438304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f863dd0-ddad-43e7-b4cb-040921789e3d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:42.450634 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1444/2900] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:36:42.454975 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ae2da-c013-4d9a-88f8-f61f42ae50e9 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:42.464962 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ae2da-c013-4d9a-88f8-f61f42ae50e9 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:42.469652 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63121467-8bbc-452e-8086-7762dd8b4b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:42.470264 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63121467-8bbc-452e-8086-7762dd8b4b85 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:42.470547 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63121467-8bbc-452e-8086-7762dd8b4b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:42.470862 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63121467-8bbc-452e-8086-7762dd8b4b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:42.471520 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63121467-8bbc-452e-8086-7762dd8b4b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:42.473482 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63121467-8bbc-452e-8086-7762dd8b4b85 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:42.501765 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1457/2901] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:36:42 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:36:42.506009 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f863dd0-ddad-43e7-b4cb-040921789e3d admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:42.516112 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f863dd0-ddad-43e7-b4cb-040921789e3d admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:42.572291 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441f344-2f63-4c30-864e-20d746485957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:42.572905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441f344-2f63-4c30-864e-20d746485957 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:42.573193 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441f344-2f63-4c30-864e-20d746485957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:42.573468 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441f344-2f63-4c30-864e-20d746485957 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:42.574127 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441f344-2f63-4c30-864e-20d746485957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:42.576097 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441f344-2f63-4c30-864e-20d746485957 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:42.587909 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:42.599109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1445/2902] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:36:42 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:36:42.603876 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63121467-8bbc-452e-8086-7762dd8b4b85 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:42.614573 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63121467-8bbc-452e-8086-7762dd8b4b85 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:42.619273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bb578-e4b7-4218-a300-fa9596adb8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:42.619868 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bb578-e4b7-4218-a300-fa9596adb8ab admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:42.620151 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bb578-e4b7-4218-a300-fa9596adb8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:42.620427 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bb578-e4b7-4218-a300-fa9596adb8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:42.621076 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8bb578-e4b7-4218-a300-fa9596adb8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:42.622969 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8bb578-e4b7-4218-a300-fa9596adb8ab admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:42.634641 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1458/2903] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:42.638577 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441f344-2f63-4c30-864e-20d746485957 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:42.650067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441f344-2f63-4c30-864e-20d746485957 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:42.654706 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65bd82-e5a8-4e57-b154-adf71b0c7e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:42.655336 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65bd82-e5a8-4e57-b154-adf71b0c7e66 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:42.655617 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65bd82-e5a8-4e57-b154-adf71b0c7e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:42.655889 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65bd82-e5a8-4e57-b154-adf71b0c7e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:42.656530 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65bd82-e5a8-4e57-b154-adf71b0c7e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:42.658131 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65bd82-e5a8-4e57-b154-adf71b0c7e66 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:42.669646 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1446/2904] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:42.673867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bb578-e4b7-4218-a300-fa9596adb8ab admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:42.684161 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bb578-e4b7-4218-a300-fa9596adb8ab admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:42.688921 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8bc56-6b18-4807-99f9-47b33238bef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:42.689579 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8bc56-6b18-4807-99f9-47b33238bef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:42.689866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8bc56-6b18-4807-99f9-47b33238bef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:42.690148 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8bc56-6b18-4807-99f9-47b33238bef4 admin admin] PATH_INFO: `/v3/projects/7993ad333f8845b69efb2344097019d1/users/bce92738e56c484197959bf3131605d4/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:42.705275 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8bc56-6b18-4807-99f9-47b33238bef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7993ad333f8845b69efb2344097019d1, user_id=bce92738e56c484197959bf3131605d4, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:42.708009 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8bc56-6b18-4807-99f9-47b33238bef4 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:42.721772 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1459/2905] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:36:42 2022] PUT /identity/v3/projects/7993ad333f8845b69efb2344097019d1/users/bce92738e56c484197959bf3131605d4/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:42.732656 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8832c-99d7-43bb-b1a1-8e72d9f78c9e None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:42.733141 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8832c-99d7-43bb-b1a1-8e72d9f78c9e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:42.733255 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8832c-99d7-43bb-b1a1-8e72d9f78c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:42.761553 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-34c8832c-99d7-43bb-b1a1-8e72d9f78c9e None None] MFA Rules not processed for user `bce92738e56c484197959bf3131605d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:42.762885 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-34c8832c-99d7-43bb-b1a1-8e72d9f78c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:42.827843 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1447/2906] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:42.839798 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8bc56-6b18-4807-99f9-47b33238bef4 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:42.841473 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-26c8bc56-6b18-4807-99f9-47b33238bef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:42.899708 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8bc56-6b18-4807-99f9-47b33238bef4 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:42.903266 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d92c1b-0190-4cce-8acb-bc35e7e79958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5ccc88318a4b96969facf8df7bd504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:42.903869 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d92c1b-0190-4cce-8acb-bc35e7e79958 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:42.904147 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d92c1b-0190-4cce-8acb-bc35e7e79958 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:42.904417 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d92c1b-0190-4cce-8acb-bc35e7e79958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:42.912656 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d92c1b-0190-4cce-8acb-bc35e7e79958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:42.914079 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d92c1b-0190-4cce-8acb-bc35e7e79958 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:42.922803 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1460/2907] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:36:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:36:45.471396 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8832c-99d7-43bb-b1a1-8e72d9f78c9e None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:45.532413 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8832c-99d7-43bb-b1a1-8e72d9f78c9e None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:45.536791 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0692bc9-e90e-47b0-a4c8-731722fa5038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:45.537417 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0692bc9-e90e-47b0-a4c8-731722fa5038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:45.537701 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0692bc9-e90e-47b0-a4c8-731722fa5038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:45.537979 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0692bc9-e90e-47b0-a4c8-731722fa5038 admin admin] PATH_INFO: `/v3/users/bce92738e56c484197959bf3131605d4` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:45.539122 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0692bc9-e90e-47b0-a4c8-731722fa5038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bce92738e56c484197959bf3131605d4)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:45.541719 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0692bc9-e90e-47b0-a4c8-731722fa5038 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:45.587185 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e0692bc9-e90e-47b0-a4c8-731722fa5038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bce92738e56c484197959bf3131605d4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:45.594109 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e0692bc9-e90e-47b0-a4c8-731722fa5038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bce92738e56c484197959bf3131605d4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:45.594812 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e0692bc9-e90e-47b0-a4c8-731722fa5038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bce92738e56c484197959bf3131605d4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:45.607133 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e0692bc9-e90e-47b0-a4c8-731722fa5038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bce92738e56c484197959bf3131605d4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:45.609727 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:45.614908 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e0692bc9-e90e-47b0-a4c8-731722fa5038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bce92738e56c484197959bf3131605d4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:45.621828 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1448/2908] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:36:45 2022] DELETE /identity/v3/users/bce92738e56c484197959bf3131605d4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:45.626587 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcd67d-9a8b-409c-9e53-f29957f591be None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:45.627081 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcd67d-9a8b-409c-9e53-f29957f591be None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:45.627309 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcd67d-9a8b-409c-9e53-f29957f591be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:45.647629 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-51bcd67d-9a8b-409c-9e53-f29957f591be None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:45.649323 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-51bcd67d-9a8b-409c-9e53-f29957f591be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:45.706833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1461/2909] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:45.717129 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0692bc9-e90e-47b0-a4c8-731722fa5038 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:45.718525 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e0692bc9-e90e-47b0-a4c8-731722fa5038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:45.778149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0692bc9-e90e-47b0-a4c8-731722fa5038 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:45.781741 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca7cca-ff46-46c1-9473-b381525e2d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:45.782346 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca7cca-ff46-46c1-9473-b381525e2d76 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:45.782679 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca7cca-ff46-46c1-9473-b381525e2d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:45.782928 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca7cca-ff46-46c1-9473-b381525e2d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:45.791891 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca7cca-ff46-46c1-9473-b381525e2d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:45.793324 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca7cca-ff46-46c1-9473-b381525e2d76 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:45.802506 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1449/2910] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:36:46.065861 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcd67d-9a8b-409c-9e53-f29957f591be None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:46.067323 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-51bcd67d-9a8b-409c-9e53-f29957f591be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:46.079729 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcd67d-9a8b-409c-9e53-f29957f591be None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:46.084419 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b1a49-6f8c-48d7-973c-8f6bbb8b2020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:46.085126 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b1a49-6f8c-48d7-973c-8f6bbb8b2020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:46.085485 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b1a49-6f8c-48d7-973c-8f6bbb8b2020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:46.085833 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b1a49-6f8c-48d7-973c-8f6bbb8b2020 admin admin] PATH_INFO: `/v3/projects/7993ad333f8845b69efb2344097019d1` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:46.087503 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b1a49-6f8c-48d7-973c-8f6bbb8b2020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7993ad333f8845b69efb2344097019d1)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:46.089421 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b1a49-6f8c-48d7-973c-8f6bbb8b2020 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:46.096235 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:46.140585 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8b5b1a49-6f8c-48d7-973c-8f6bbb8b2020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7993ad333f8845b69efb2344097019d1', 'request_id': 'req-8b5b1a49-6f8c-48d7-973c-8f6bbb8b2020'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:46.146646 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8b5b1a49-6f8c-48d7-973c-8f6bbb8b2020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7993ad333f8845b69efb2344097019d1', 'request_id': 'req-8b5b1a49-6f8c-48d7-973c-8f6bbb8b2020'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:46.155198 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8b5b1a49-6f8c-48d7-973c-8f6bbb8b2020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7993ad333f8845b69efb2344097019d1', 'request_id': 'req-8b5b1a49-6f8c-48d7-973c-8f6bbb8b2020'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:46.165981 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8b5b1a49-6f8c-48d7-973c-8f6bbb8b2020 admin admin] The token cache is being invalidate because project 7993ad333f8845b69efb2344097019d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:36:46.166268 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8b5b1a49-6f8c-48d7-973c-8f6bbb8b2020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:46.166923 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8b5b1a49-6f8c-48d7-973c-8f6bbb8b2020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:36:46.168407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1462/2911] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:36:46 2022] DELETE /identity/v3/projects/7993ad333f8845b69efb2344097019d1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:46.173545 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e6124-3885-4ba5-a390-7e03324744aa None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:46.173832 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e6124-3885-4ba5-a390-7e03324744aa None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:46.174107 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e6124-3885-4ba5-a390-7e03324744aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:46.193981 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-443e6124-3885-4ba5-a390-7e03324744aa None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:46.195213 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-443e6124-3885-4ba5-a390-7e03324744aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:46.253957 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1450/2912] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:46.262367 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde6e16-888b-440e-9888-813a104b3f22 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:46.262805 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde6e16-888b-440e-9888-813a104b3f22 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:46.263116 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde6e16-888b-440e-9888-813a104b3f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:46.283078 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-9cde6e16-888b-440e-9888-813a104b3f22 None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:46.284282 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9cde6e16-888b-440e-9888-813a104b3f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:46.292787 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1463/2913] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:46.297010 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e6124-3885-4ba5-a390-7e03324744aa None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:46.306685 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e6124-3885-4ba5-a390-7e03324744aa None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:46.311306 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a245825-001c-488b-894b-c54857c2c24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:46.311844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a245825-001c-488b-894b-c54857c2c24c admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:46.312126 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a245825-001c-488b-894b-c54857c2c24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:46.312403 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a245825-001c-488b-894b-c54857c2c24c admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:46.313053 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a245825-001c-488b-894b-c54857c2c24c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:36:46.313398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a245825-001c-488b-894b-c54857c2c24c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:46.315029 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a245825-001c-488b-894b-c54857c2c24c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:46.326465 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1451/2914] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 27 04:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:36:46.330661 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde6e16-888b-440e-9888-813a104b3f22 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:46.340422 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde6e16-888b-440e-9888-813a104b3f22 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:46.346675 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96aaf14-eeed-4a97-890a-66fb657cabde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:46.347714 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aaf14-eeed-4a97-890a-66fb657cabde admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:46.347999 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aaf14-eeed-4a97-890a-66fb657cabde admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:46.348275 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aaf14-eeed-4a97-890a-66fb657cabde admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:46.348924 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96aaf14-eeed-4a97-890a-66fb657cabde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:46.350870 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96aaf14-eeed-4a97-890a-66fb657cabde admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:46.378325 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1464/2915] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:36:46 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:36:46.382479 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a245825-001c-488b-894b-c54857c2c24c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:46.392402 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a245825-001c-488b-894b-c54857c2c24c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:46.449160 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556bdda-2b3d-4b9e-ab5f-dfa6bec051bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:46.449765 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556bdda-2b3d-4b9e-ab5f-dfa6bec051bb admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:46.450051 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556bdda-2b3d-4b9e-ab5f-dfa6bec051bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:46.450330 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556bdda-2b3d-4b9e-ab5f-dfa6bec051bb admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:46.450988 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556bdda-2b3d-4b9e-ab5f-dfa6bec051bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:46.452961 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556bdda-2b3d-4b9e-ab5f-dfa6bec051bb admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:46.473951 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1452/2916] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:36:46 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:36:46.478742 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96aaf14-eeed-4a97-890a-66fb657cabde admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:46.489013 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96aaf14-eeed-4a97-890a-66fb657cabde admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:46.493930 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25607d8-2bd2-49fa-bd0e-a06f7ec20abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:46.494527 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25607d8-2bd2-49fa-bd0e-a06f7ec20abf admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:46.494844 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25607d8-2bd2-49fa-bd0e-a06f7ec20abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:46.495120 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25607d8-2bd2-49fa-bd0e-a06f7ec20abf admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:46.495854 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25607d8-2bd2-49fa-bd0e-a06f7ec20abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:46.497739 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25607d8-2bd2-49fa-bd0e-a06f7ec20abf admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:46.507676 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1465/2917] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:46.512103 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556bdda-2b3d-4b9e-ab5f-dfa6bec051bb admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:46.522866 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556bdda-2b3d-4b9e-ab5f-dfa6bec051bb admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:46.528149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ac12e-4673-4236-887e-e3a085136139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:46.528744 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ac12e-4673-4236-887e-e3a085136139 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:46.529044 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ac12e-4673-4236-887e-e3a085136139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:46.529310 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ac12e-4673-4236-887e-e3a085136139 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:46.529961 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ac12e-4673-4236-887e-e3a085136139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:46.531595 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ac12e-4673-4236-887e-e3a085136139 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:46.543144 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1453/2918] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:46.547348 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25607d8-2bd2-49fa-bd0e-a06f7ec20abf admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:46.557439 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25607d8-2bd2-49fa-bd0e-a06f7ec20abf admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:46.562112 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ac13c-7bbe-415b-b795-568c79036920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:46.562701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ac13c-7bbe-415b-b795-568c79036920 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:46.563020 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ac13c-7bbe-415b-b795-568c79036920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:46.563301 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ac13c-7bbe-415b-b795-568c79036920 admin admin] PATH_INFO: `/v3/projects/dc61b858e7e0443bbb4534812c52ebfe/users/2c3239d58c834791b2d7c5f9b1a1ee68/roles/71cc6516aeff47eea3961db1a3d57f21` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:46.578006 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ac13c-7bbe-415b-b795-568c79036920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc61b858e7e0443bbb4534812c52ebfe, user_id=2c3239d58c834791b2d7c5f9b1a1ee68, role_id=71cc6516aeff47eea3961db1a3d57f21)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:46.580732 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ac13c-7bbe-415b-b795-568c79036920 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:46.594114 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1466/2919] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:36:46 2022] PUT /identity/v3/projects/dc61b858e7e0443bbb4534812c52ebfe/users/2c3239d58c834791b2d7c5f9b1a1ee68/roles/71cc6516aeff47eea3961db1a3d57f21 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:46.599181 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cf2ae-b553-46ff-90b2-5c42919f7e4d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:46.599464 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cf2ae-b553-46ff-90b2-5c42919f7e4d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:46.599737 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cf2ae-b553-46ff-90b2-5c42919f7e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:46.606996 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:46.621184 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a48cf2ae-b553-46ff-90b2-5c42919f7e4d None None] MFA Rules not processed for user `0a22ab389c9c45629af99658c60df95d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:46.622667 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a48cf2ae-b553-46ff-90b2-5c42919f7e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:46.680069 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1454/2920] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:46.689863 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ac13c-7bbe-415b-b795-568c79036920 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:46.691614 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-119ac13c-7bbe-415b-b795-568c79036920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:46.747567 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ac13c-7bbe-415b-b795-568c79036920 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:46.751145 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c3e82-1da7-4ba7-ba71-8e2f4bb71ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:46.751740 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c3e82-1da7-4ba7-ba71-8e2f4bb71ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:46.752020 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c3e82-1da7-4ba7-ba71-8e2f4bb71ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:46.752292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c3e82-1da7-4ba7-ba71-8e2f4bb71ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:46.761659 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c3e82-1da7-4ba7-ba71-8e2f4bb71ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:46.763137 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c3e82-1da7-4ba7-ba71-8e2f4bb71ac3 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:46.772640 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1467/2921] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:36:50.473796 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a0424-4389-4653-be30-517a8f000ab6 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:50.474238 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a0424-4389-4653-be30-517a8f000ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:50.474238 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a0424-4389-4653-be30-517a8f000ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:50.504765 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1c4a0424-4389-4653-be30-517a8f000ab6 None None] MFA Rules not processed for user `2c3239d58c834791b2d7c5f9b1a1ee68`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:50.506001 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1c4a0424-4389-4653-be30-517a8f000ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:50.573149 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1455/2922] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:50.577608 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c3e82-1da7-4ba7-ba71-8e2f4bb71ac3 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:50.588263 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c3e82-1da7-4ba7-ba71-8e2f4bb71ac3 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:50.592982 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf77e1-1457-4601-9be3-796f9c695c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:50.593588 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf77e1-1457-4601-9be3-796f9c695c2f admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:50.593867 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf77e1-1457-4601-9be3-796f9c695c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:50.594142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf77e1-1457-4601-9be3-796f9c695c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:50.594807 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf77e1-1457-4601-9be3-796f9c695c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:50.596715 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf77e1-1457-4601-9be3-796f9c695c2f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:50.625439 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1468/2923] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 27 04:36:50 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:36:50.629304 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a0424-4389-4653-be30-517a8f000ab6 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:50.641017 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a0424-4389-4653-be30-517a8f000ab6 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:50.699992 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30226c-cee2-4009-886d-59e6a6f40892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:50.700612 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30226c-cee2-4009-886d-59e6a6f40892 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:50.700897 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30226c-cee2-4009-886d-59e6a6f40892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:50.701173 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30226c-cee2-4009-886d-59e6a6f40892 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:50.701830 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30226c-cee2-4009-886d-59e6a6f40892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:50.703977 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30226c-cee2-4009-886d-59e6a6f40892 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:50.730284 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1456/2924] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 27 04:36:50 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:36:50.731558 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf77e1-1457-4601-9be3-796f9c695c2f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:50.742982 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf77e1-1457-4601-9be3-796f9c695c2f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:50.747979 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8673e6-f6dc-4f69-be93-bb25b5db23be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:50.748606 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8673e6-f6dc-4f69-be93-bb25b5db23be admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:50.748891 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8673e6-f6dc-4f69-be93-bb25b5db23be admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:50.749168 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8673e6-f6dc-4f69-be93-bb25b5db23be admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:50.749816 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8673e6-f6dc-4f69-be93-bb25b5db23be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:50.751455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8673e6-f6dc-4f69-be93-bb25b5db23be admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:50.758463 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:50.772937 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1469/2925] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:50.774329 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30226c-cee2-4009-886d-59e6a6f40892 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:50.784960 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30226c-cee2-4009-886d-59e6a6f40892 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:50.789788 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7567f-d0a3-4a99-bd6a-c98ea9c8d2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:50.790457 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7567f-d0a3-4a99-bd6a-c98ea9c8d2e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:50.790768 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7567f-d0a3-4a99-bd6a-c98ea9c8d2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:50.791052 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7567f-d0a3-4a99-bd6a-c98ea9c8d2e4 admin admin] PATH_INFO: `/v3/projects/9aaed47e6ce34e9087780816846b03a7/users/508d5fe4cb2042fdb8d4d9bb7b1ce24d/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:50.807675 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7567f-d0a3-4a99-bd6a-c98ea9c8d2e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aaed47e6ce34e9087780816846b03a7, user_id=508d5fe4cb2042fdb8d4d9bb7b1ce24d, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:50.810344 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7567f-d0a3-4a99-bd6a-c98ea9c8d2e4 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:50.818546 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:50.828465 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1457/2926] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:36:50 2022] PUT /identity/v3/projects/9aaed47e6ce34e9087780816846b03a7/users/508d5fe4cb2042fdb8d4d9bb7b1ce24d/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:50.832904 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8673e6-f6dc-4f69-be93-bb25b5db23be admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:50.843091 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8673e6-f6dc-4f69-be93-bb25b5db23be admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:50.902925 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19941c2d-77ef-481a-8b81-ca9d7a32ac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:50.903537 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19941c2d-77ef-481a-8b81-ca9d7a32ac6e admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:50.903834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19941c2d-77ef-481a-8b81-ca9d7a32ac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:50.904110 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19941c2d-77ef-481a-8b81-ca9d7a32ac6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:50.904756 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19941c2d-77ef-481a-8b81-ca9d7a32ac6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:50.906347 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19941c2d-77ef-481a-8b81-ca9d7a32ac6e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:50.916812 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1470/2927] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 27 04:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:36:50.920881 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7567f-d0a3-4a99-bd6a-c98ea9c8d2e4 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:50.932249 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7567f-d0a3-4a99-bd6a-c98ea9c8d2e4 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:50.937211 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dd2f1-4813-4013-8227-fa0d96efba51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:50.937861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dd2f1-4813-4013-8227-fa0d96efba51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:50.938142 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dd2f1-4813-4013-8227-fa0d96efba51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:50.938418 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dd2f1-4813-4013-8227-fa0d96efba51 admin admin] PATH_INFO: `/v3/projects/9aaed47e6ce34e9087780816846b03a7/users/508d5fe4cb2042fdb8d4d9bb7b1ce24d/roles/2613cf4a98d44744a094c7782b19b4b5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:50.940353 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94dd2f1-4813-4013-8227-fa0d96efba51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aaed47e6ce34e9087780816846b03a7, user_id=508d5fe4cb2042fdb8d4d9bb7b1ce24d, role_id=2613cf4a98d44744a094c7782b19b4b5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:50.943030 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94dd2f1-4813-4013-8227-fa0d96efba51 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:50.954427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1458/2928] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 27 04:36:50 2022] PUT /identity/v3/projects/9aaed47e6ce34e9087780816846b03a7/users/508d5fe4cb2042fdb8d4d9bb7b1ce24d/roles/2613cf4a98d44744a094c7782b19b4b5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:36:55.692683 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cfca4-f2b2-4641-b7d9-5406b642495c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:55.693167 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cfca4-f2b2-4641-b7d9-5406b642495c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:55.693302 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cfca4-f2b2-4641-b7d9-5406b642495c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:55.731493 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-3a0cfca4-f2b2-4641-b7d9-5406b642495c None None] MFA Rules not processed for user `508d5fe4cb2042fdb8d4d9bb7b1ce24d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:55.732851 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3a0cfca4-f2b2-4641-b7d9-5406b642495c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:55.838054 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1471/2929] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:36:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:55.851911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dd2f1-4813-4013-8227-fa0d96efba51 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:55.853769 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d94dd2f1-4813-4013-8227-fa0d96efba51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:55.942958 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dd2f1-4813-4013-8227-fa0d96efba51 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:55.946754 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a88a9-9b1c-4df2-af51-0d745ef056a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '405499a1b5dc4fb6ac7af73910c3d992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:55.947373 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a88a9-9b1c-4df2-af51-0d745ef056a2 service glance] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:55.947658 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a88a9-9b1c-4df2-af51-0d745ef056a2 service glance] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:55.947940 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a88a9-9b1c-4df2-af51-0d745ef056a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:56.011235 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a88a9-9b1c-4df2-af51-0d745ef056a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:56.012723 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a88a9-9b1c-4df2-af51-0d745ef056a2 service glance] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:56.023122 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1459/2930] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:36:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:36:56.161980 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd8172-c604-48a9-9017-fb08038ddd6f None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:56.162273 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd8172-c604-48a9-9017-fb08038ddd6f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:56.162608 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd8172-c604-48a9-9017-fb08038ddd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:56.216349 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-30bd8172-c604-48a9-9017-fb08038ddd6f None None] MFA Rules not processed for user `71c7a54c598642a4b9219ae21c34f0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:36:56.217569 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-30bd8172-c604-48a9-9017-fb08038ddd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:56.278818 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:56.289552 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1472/2931] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 27 04:36:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:36:56.335013 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a88a9-9b1c-4df2-af51-0d745ef056a2 service glance] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:36:56.337058 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f06a88a9-9b1c-4df2-af51-0d745ef056a2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:36:56.422502 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:36:56.427302 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a88a9-9b1c-4df2-af51-0d745ef056a2 service glance] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:36:56.434059 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14f1ff-0263-411a-aeef-bc7b54c29f0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c295a3063c3b45be96b406f586180142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:36:56.434706 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14f1ff-0263-411a-aeef-bc7b54c29f0d service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:36:56.435093 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14f1ff-0263-411a-aeef-bc7b54c29f0d service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:36:56.435375 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14f1ff-0263-411a-aeef-bc7b54c29f0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:36:56.444333 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14f1ff-0263-411a-aeef-bc7b54c29f0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:36:56.446505 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14f1ff-0263-411a-aeef-bc7b54c29f0d service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:36:56.454926 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1460/2932] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 27 04:36:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:37:05.031089 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dd0cc-16ac-4be0-9834-070a6775bf2d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:37:05.031641 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dd0cc-16ac-4be0-9834-070a6775bf2d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:37:05.031759 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dd0cc-16ac-4be0-9834-070a6775bf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:37:05.050162 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d40dd0cc-16ac-4be0-9834-070a6775bf2d None None] MFA Rules not processed for user `2c3239d58c834791b2d7c5f9b1a1ee68`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:37:05.051381 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d40dd0cc-16ac-4be0-9834-070a6775bf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:37:05.058834 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1473/2933] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 27 04:37:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:37:05.097689 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14f1ff-0263-411a-aeef-bc7b54c29f0d service swift] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:37:05.107161 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14f1ff-0263-411a-aeef-bc7b54c29f0d service swift] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:37:05.110907 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8095b5-038b-43a1-8dd4-343290dc4dd7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '405499a1b5dc4fb6ac7af73910c3d992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:37:05.111500 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8095b5-038b-43a1-8dd4-343290dc4dd7 service glance] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:37:05.111779 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8095b5-038b-43a1-8dd4-343290dc4dd7 service glance] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:37:05.112067 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8095b5-038b-43a1-8dd4-343290dc4dd7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:37:05.113742 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7c8095b5-038b-43a1-8dd4-343290dc4dd7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:37:05.184636 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8095b5-038b-43a1-8dd4-343290dc4dd7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:37:05.186076 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8095b5-038b-43a1-8dd4-343290dc4dd7 service glance] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:37:05.197533 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1461/2934] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:37:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:37:07.963578 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9bbba-5ab1-4b5b-ae6b-a67be0308282 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:37:07.964071 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9bbba-5ab1-4b5b-ae6b-a67be0308282 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:37:07.964171 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9bbba-5ab1-4b5b-ae6b-a67be0308282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:37:07.984091 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-89a9bbba-5ab1-4b5b-ae6b-a67be0308282 None None] MFA Rules not processed for user `71c7a54c598642a4b9219ae21c34f0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:37:07.985284 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-89a9bbba-5ab1-4b5b-ae6b-a67be0308282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:37:07.992435 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1474/2935] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 27 04:37:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:37:08.005311 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8095b5-038b-43a1-8dd4-343290dc4dd7 service glance] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:37:08.016543 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8095b5-038b-43a1-8dd4-343290dc4dd7 service glance] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:37:08.021510 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643776f7-0833-4922-b685-877a90ec4767 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c295a3063c3b45be96b406f586180142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:37:08.022106 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643776f7-0833-4922-b685-877a90ec4767 service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:37:08.022386 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643776f7-0833-4922-b685-877a90ec4767 service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:37:08.022661 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643776f7-0833-4922-b685-877a90ec4767 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:37:08.031267 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643776f7-0833-4922-b685-877a90ec4767 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:37:08.032861 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643776f7-0833-4922-b685-877a90ec4767 service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:37:08.041602 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1462/2936] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 27 04:37:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:37:17.978701 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=9 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:37:18.037678 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=45 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:37:18.335052 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9bbba-5ab1-4b5b-ae6b-a67be0308282 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:37:18.390780 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9bbba-5ab1-4b5b-ae6b-a67be0308282 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:37:18.394407 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f90feb-20d4-49df-83c7-12b817fd1302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:37:18.395055 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f90feb-20d4-49df-83c7-12b817fd1302 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:37:18.395337 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f90feb-20d4-49df-83c7-12b817fd1302 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:37:18.395613 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f90feb-20d4-49df-83c7-12b817fd1302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:37:18.397424 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c3f90feb-20d4-49df-83c7-12b817fd1302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:37:18.408096 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f90feb-20d4-49df-83c7-12b817fd1302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:37:18.409532 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f90feb-20d4-49df-83c7-12b817fd1302 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:37:18.417960 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1475/2937] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:37:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:37:28.414561 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=26 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:37:32.782830 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643776f7-0833-4922-b685-877a90ec4767 service swift] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:37:32.784234 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-643776f7-0833-4922-b685-877a90ec4767 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:37:32.795911 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643776f7-0833-4922-b685-877a90ec4767 service swift] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:37:32.799411 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5f4c9-ca61-4e00-8002-7e51e2fb89b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94f9a63cb4847c6916a84735d00b48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:37:32.799995 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5f4c9-ca61-4e00-8002-7e51e2fb89b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:37:32.800278 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5f4c9-ca61-4e00-8002-7e51e2fb89b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:37:32.800549 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5f4c9-ca61-4e00-8002-7e51e2fb89b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:37:32.809880 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5f4c9-ca61-4e00-8002-7e51e2fb89b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:37:32.811374 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5f4c9-ca61-4e00-8002-7e51e2fb89b0 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:37:32.821430 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1463/2938] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:37:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:37:42.816653 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=6 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:39:26.319270 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f90feb-20d4-49df-83c7-12b817fd1302 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:39:26.320795 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c3f90feb-20d4-49df-83c7-12b817fd1302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:39:26.479195 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f90feb-20d4-49df-83c7-12b817fd1302 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:39:26.484760 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4ba9f-1134-4322-9377-1857ae64c39e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efd209a50a994b7c8485f2996697218b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:39:26.485106 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ba9f-1134-4322-9377-1857ae64c39e service placement] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:39:26.485441 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ba9f-1134-4322-9377-1857ae64c39e service placement] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:39:26.486190 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ba9f-1134-4322-9377-1857ae64c39e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:39:26.491142 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c1b4ba9f-1134-4322-9377-1857ae64c39e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:39:26.503680 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4ba9f-1134-4322-9377-1857ae64c39e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:39:26.505300 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4ba9f-1134-4322-9377-1857ae64c39e service placement] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:39:26.516066 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1476/2939] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:39:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:39:36.511643 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=63 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:39:59.197504 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5f4c9-ca61-4e00-8002-7e51e2fb89b0 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:39:59.200758 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-bbd5f4c9-ca61-4e00-8002-7e51e2fb89b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:39:59.300905 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5f4c9-ca61-4e00-8002-7e51e2fb89b0 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:39:59.308172 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dee1f-64d9-4dbc-9905-80e225beda3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:39:59.309621 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dee1f-64d9-4dbc-9905-80e225beda3a service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:39:59.310134 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dee1f-64d9-4dbc-9905-80e225beda3a service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:39:59.310620 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dee1f-64d9-4dbc-9905-80e225beda3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:39:59.312998 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ea3dee1f-64d9-4dbc-9905-80e225beda3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:39:59.334398 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3dee1f-64d9-4dbc-9905-80e225beda3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:39:59.336574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3dee1f-64d9-4dbc-9905-80e225beda3a service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:39:59.359105 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1464/2940] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:39:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:40:05.339426 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4ba9f-1134-4322-9377-1857ae64c39e service placement] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:40:05.359324 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4ba9f-1134-4322-9377-1857ae64c39e service placement] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:40:05.366455 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60647ea5-556c-4cff-a2e6-fc830dd6b8c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3960d52dee8443cf9ec8930a389a7b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:40:05.367435 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60647ea5-556c-4cff-a2e6-fc830dd6b8c7 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:40:05.367621 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60647ea5-556c-4cff-a2e6-fc830dd6b8c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:40:05.367764 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60647ea5-556c-4cff-a2e6-fc830dd6b8c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:40:05.369588 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-60647ea5-556c-4cff-a2e6-fc830dd6b8c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:40:05.382917 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60647ea5-556c-4cff-a2e6-fc830dd6b8c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:40:05.384507 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60647ea5-556c-4cff-a2e6-fc830dd6b8c7 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:40:05.395871 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1477/2941] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:40:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:40:06.653509 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81971677-565d-4ede-acf0-72b92512db71 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:40:06.654024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81971677-565d-4ede-acf0-72b92512db71 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:40:06.654024 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81971677-565d-4ede-acf0-72b92512db71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:40:06.684731 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-81971677-565d-4ede-acf0-72b92512db71 None None] MFA Rules not processed for user `71c7a54c598642a4b9219ae21c34f0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:40:06.686113 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-81971677-565d-4ede-acf0-72b92512db71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:40:06.693601 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1465/2942] 10.222.0.48 () {58 vars in 967 bytes} [Tue Sep 27 04:40:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:40:06.734047 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60647ea5-556c-4cff-a2e6-fc830dd6b8c7 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:40:06.746005 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60647ea5-556c-4cff-a2e6-fc830dd6b8c7 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:40:06.752213 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555e9ff-52f7-4210-8dd4-796e9c916863 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c295a3063c3b45be96b406f586180142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:40:06.753437 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555e9ff-52f7-4210-8dd4-796e9c916863 service swift] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:40:06.753854 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555e9ff-52f7-4210-8dd4-796e9c916863 service swift] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:40:06.754234 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555e9ff-52f7-4210-8dd4-796e9c916863 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:40:06.763963 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555e9ff-52f7-4210-8dd4-796e9c916863 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:40:06.765543 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555e9ff-52f7-4210-8dd4-796e9c916863 service swift] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:40:06.774386 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1478/2943] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 27 04:40:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:40:10.361877 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81971677-565d-4ede-acf0-72b92512db71 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:40:10.375670 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81971677-565d-4ede-acf0-72b92512db71 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:40:10.381399 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856485e0-4dda-4b18-a441-671997375bcb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efd209a50a994b7c8485f2996697218b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:40:10.382141 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856485e0-4dda-4b18-a441-671997375bcb service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:40:10.382427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856485e0-4dda-4b18-a441-671997375bcb service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:40:10.382703 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856485e0-4dda-4b18-a441-671997375bcb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:40:10.384451 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-856485e0-4dda-4b18-a441-671997375bcb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:40:10.403027 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856485e0-4dda-4b18-a441-671997375bcb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:40:10.405057 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856485e0-4dda-4b18-a441-671997375bcb service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:40:10.418098 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1466/2944] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:40:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:40:13.567705 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555e9ff-52f7-4210-8dd4-796e9c916863 service swift] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:40:13.583866 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555e9ff-52f7-4210-8dd4-796e9c916863 service swift] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:40:13.591468 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b572604-a011-4963-941f-25d33ed09c7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efd209a50a994b7c8485f2996697218b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:40:13.592332 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b572604-a011-4963-941f-25d33ed09c7a service placement] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:40:13.592957 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b572604-a011-4963-941f-25d33ed09c7a service placement] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:40:13.593545 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b572604-a011-4963-941f-25d33ed09c7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:40:13.595699 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2b572604-a011-4963-941f-25d33ed09c7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:40:13.613602 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b572604-a011-4963-941f-25d33ed09c7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:40:13.616043 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b572604-a011-4963-941f-25d33ed09c7a service placement] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:40:13.635123 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1479/2945] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:40:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:40:13.669927 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856485e0-4dda-4b18-a441-671997375bcb service placement] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:40:13.754377 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856485e0-4dda-4b18-a441-671997375bcb service placement] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:40:13.759312 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b07567-ddf1-4059-82a8-fc1da3e93d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:40:13.759987 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b07567-ddf1-4059-82a8-fc1da3e93d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:40:13.760270 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b07567-ddf1-4059-82a8-fc1da3e93d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:40:13.760554 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b07567-ddf1-4059-82a8-fc1da3e93d80 admin admin] PATH_INFO: `/v3/users/2c3239d58c834791b2d7c5f9b1a1ee68` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:40:13.761844 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b07567-ddf1-4059-82a8-fc1da3e93d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c3239d58c834791b2d7c5f9b1a1ee68)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:40:13.763993 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b07567-ddf1-4059-82a8-fc1da3e93d80 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:40:13.811047 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:40:13.813293 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-14b07567-ddf1-4059-82a8-fc1da3e93d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c3239d58c834791b2d7c5f9b1a1ee68'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:13.821606 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-14b07567-ddf1-4059-82a8-fc1da3e93d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c3239d58c834791b2d7c5f9b1a1ee68'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:13.822288 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-14b07567-ddf1-4059-82a8-fc1da3e93d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c3239d58c834791b2d7c5f9b1a1ee68'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:13.833846 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-14b07567-ddf1-4059-82a8-fc1da3e93d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c3239d58c834791b2d7c5f9b1a1ee68'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:13.840894 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-14b07567-ddf1-4059-82a8-fc1da3e93d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c3239d58c834791b2d7c5f9b1a1ee68'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:13.847303 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1467/2946] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:40:13 2022] DELETE /identity/v3/users/2c3239d58c834791b2d7c5f9b1a1ee68 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:40:14.031340 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b572604-a011-4963-941f-25d33ed09c7a service placement] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:40:14.044087 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b572604-a011-4963-941f-25d33ed09c7a service placement] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:40:14.113752 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581b9ae-73d8-4018-aafd-c4c58da4f067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:40:14.114307 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581b9ae-73d8-4018-aafd-c4c58da4f067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:40:14.114590 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581b9ae-73d8-4018-aafd-c4c58da4f067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:40:14.114913 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581b9ae-73d8-4018-aafd-c4c58da4f067 admin admin] PATH_INFO: `/v3/projects/dc61b858e7e0443bbb4534812c52ebfe` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:40:14.116059 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581b9ae-73d8-4018-aafd-c4c58da4f067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc61b858e7e0443bbb4534812c52ebfe)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:40:14.117967 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581b9ae-73d8-4018-aafd-c4c58da4f067 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:40:14.164514 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e581b9ae-73d8-4018-aafd-c4c58da4f067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc61b858e7e0443bbb4534812c52ebfe', 'request_id': 'req-e581b9ae-73d8-4018-aafd-c4c58da4f067'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:14.170481 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e581b9ae-73d8-4018-aafd-c4c58da4f067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc61b858e7e0443bbb4534812c52ebfe', 'request_id': 'req-e581b9ae-73d8-4018-aafd-c4c58da4f067'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:14.177774 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e581b9ae-73d8-4018-aafd-c4c58da4f067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc61b858e7e0443bbb4534812c52ebfe', 'request_id': 'req-e581b9ae-73d8-4018-aafd-c4c58da4f067'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:14.200339 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e581b9ae-73d8-4018-aafd-c4c58da4f067 admin admin] The token cache is being invalidate because project dc61b858e7e0443bbb4534812c52ebfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:40:14.200632 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e581b9ae-73d8-4018-aafd-c4c58da4f067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:14.201282 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e581b9ae-73d8-4018-aafd-c4c58da4f067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:14.202781 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1480/2947] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:40:14 2022] DELETE /identity/v3/projects/dc61b858e7e0443bbb4534812c52ebfe => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:40:14.207281 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b07567-ddf1-4059-82a8-fc1da3e93d80 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:40:14.208681 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-14b07567-ddf1-4059-82a8-fc1da3e93d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:40:14.221427 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b07567-ddf1-4059-82a8-fc1da3e93d80 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:40:14.277651 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c67f8a-6157-4ebd-a7d9-dd7d3c245261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:40:14.278280 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c67f8a-6157-4ebd-a7d9-dd7d3c245261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:40:14.278565 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c67f8a-6157-4ebd-a7d9-dd7d3c245261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:40:14.278880 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c67f8a-6157-4ebd-a7d9-dd7d3c245261 admin admin] PATH_INFO: `/v3/users/508d5fe4cb2042fdb8d4d9bb7b1ce24d` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:40:14.280039 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c67f8a-6157-4ebd-a7d9-dd7d3c245261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=508d5fe4cb2042fdb8d4d9bb7b1ce24d)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:40:14.282135 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c67f8a-6157-4ebd-a7d9-dd7d3c245261 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:40:14.327971 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-21c67f8a-6157-4ebd-a7d9-dd7d3c245261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '508d5fe4cb2042fdb8d4d9bb7b1ce24d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:14.335947 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-21c67f8a-6157-4ebd-a7d9-dd7d3c245261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '508d5fe4cb2042fdb8d4d9bb7b1ce24d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:14.336626 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-21c67f8a-6157-4ebd-a7d9-dd7d3c245261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '508d5fe4cb2042fdb8d4d9bb7b1ce24d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:14.348607 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-21c67f8a-6157-4ebd-a7d9-dd7d3c245261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '508d5fe4cb2042fdb8d4d9bb7b1ce24d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:14.356020 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-21c67f8a-6157-4ebd-a7d9-dd7d3c245261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '508d5fe4cb2042fdb8d4d9bb7b1ce24d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:14.362116 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1468/2948] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 27 04:40:14 2022] DELETE /identity/v3/users/508d5fe4cb2042fdb8d4d9bb7b1ce24d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:40:14.539179 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581b9ae-73d8-4018-aafd-c4c58da4f067 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:40:14.540670 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e581b9ae-73d8-4018-aafd-c4c58da4f067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:40:14.554888 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581b9ae-73d8-4018-aafd-c4c58da4f067 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:40:14.594929 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:40:14.619372 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6ba24-9f97-42d5-9f88-085ee2895a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a22ab389c9c45629af99658c60df95d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e2274f8eaa462ba6cf2944e7e36afb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:40:14.619966 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6ba24-9f97-42d5-9f88-085ee2895a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:40:14.620421 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6ba24-9f97-42d5-9f88-085ee2895a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:40:14.620897 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6ba24-9f97-42d5-9f88-085ee2895a96 admin admin] PATH_INFO: `/v3/projects/9aaed47e6ce34e9087780816846b03a7` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:40:14.622292 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6ba24-9f97-42d5-9f88-085ee2895a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aaed47e6ce34e9087780816846b03a7)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:40:14.624729 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6ba24-9f97-42d5-9f88-085ee2895a96 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:40:14.688149 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-97b6ba24-9f97-42d5-9f88-085ee2895a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aaed47e6ce34e9087780816846b03a7', 'request_id': 'req-97b6ba24-9f97-42d5-9f88-085ee2895a96'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:14.695927 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-97b6ba24-9f97-42d5-9f88-085ee2895a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aaed47e6ce34e9087780816846b03a7', 'request_id': 'req-97b6ba24-9f97-42d5-9f88-085ee2895a96'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:14.704193 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-97b6ba24-9f97-42d5-9f88-085ee2895a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aaed47e6ce34e9087780816846b03a7', 'request_id': 'req-97b6ba24-9f97-42d5-9f88-085ee2895a96'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:14.716485 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-97b6ba24-9f97-42d5-9f88-085ee2895a96 admin admin] The token cache is being invalidate because project 9aaed47e6ce34e9087780816846b03a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 04:40:14.716771 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-97b6ba24-9f97-42d5-9f88-085ee2895a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:14.717405 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-97b6ba24-9f97-42d5-9f88-085ee2895a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 04:40:14.718910 dv-cinder-859186-3-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1481/2949] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 27 04:40:14 2022] DELETE /identity/v3/projects/9aaed47e6ce34e9087780816846b03a7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:40:24.358574 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=66,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:40:24.713196 dv-cinder-859186-3-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 04:44:31.296100 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c67f8a-6157-4ebd-a7d9-dd7d3c245261 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:44:31.297644 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-21c67f8a-6157-4ebd-a7d9-dd7d3c245261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:44:31.368808 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c67f8a-6157-4ebd-a7d9-dd7d3c245261 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:44:31.431165 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84839fce-9d86-495f-9c04-1dd9b59c25b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efd209a50a994b7c8485f2996697218b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37e7a8d1446d4cdea0ba00124411cd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:44:31.431780 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84839fce-9d86-495f-9c04-1dd9b59c25b0 service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:44:31.432064 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84839fce-9d86-495f-9c04-1dd9b59c25b0 service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:44:31.432341 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84839fce-9d86-495f-9c04-1dd9b59c25b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:44:31.434085 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-84839fce-9d86-495f-9c04-1dd9b59c25b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:44:31.447061 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84839fce-9d86-495f-9c04-1dd9b59c25b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:44:31.448674 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84839fce-9d86-495f-9c04-1dd9b59c25b0 service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:44:31.459249 dv-cinder-859186-3-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1469/2950] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 27 04:44:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:44:41.454498 dv-cinder-859186-3-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=58 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}